2024-04-25T01:46:23.883 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T01:46:23.883 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351 -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/orig.config.yaml 2024-04-25T01:46:23.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T01:46:24.050 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672351' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - slow metadata IO - SLOW_OPS - slow request sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATqofvyLPilflkqKG2YgKB70vFTEpC4WceMbVuRl7Pu4V1wYZtUqT/fTfwtPCaazS+YDW+cZeomgpd24YpEdGc= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkqbO+NbXxYVhp91b35e50pMvrr44kJCnsq6esg0Z3cXiOoone9o7hGmCWDc+NhP6dC2gW9zzs5Kkc+QIgPOiI= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY9lw0Z26HiTCDSpnDf0c5t2vMK85vor2XjFlaadfxIfr80kdo0QkBSOW9Fw6g04xkvzB0RPeZoAQic0+8GpAs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/fs/workload/overrides/pg_health.yaml meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T01:46:24.050 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T01:46:24.051 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T01:46:24.051 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T01:46:24.053 INFO:teuthology.task.internal:Checking packages... 2024-04-25T01:46:24.079 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T01:46:24.080 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T01:46:24.080 INFO:teuthology.packaging:ref: None 2024-04-25T01:46:24.080 INFO:teuthology.packaging:tag: None 2024-04-25T01:46:24.080 INFO:teuthology.packaging:branch: squid 2024-04-25T01:46:24.080 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:46:24.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-25T01:46:24.437 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T01:46:24.438 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T01:46:24.446 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T01:46:24.446 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T01:46:24.458 INFO:teuthology.task.internal:Saving configuration 2024-04-25T01:46:24.481 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T01:46:24.488 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T01:46:24.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.515873', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATqofvyLPilflkqKG2YgKB70vFTEpC4WceMbVuRl7Pu4V1wYZtUqT/fTfwtPCaazS+YDW+cZeomgpd24YpEdGc='} 2024-04-25T01:46:24.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.519005', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkqbO+NbXxYVhp91b35e50pMvrr44kJCnsq6esg0Z3cXiOoone9o7hGmCWDc+NhP6dC2gW9zzs5Kkc+QIgPOiI='} 2024-04-25T01:46:24.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.517543', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY9lw0Z26HiTCDSpnDf0c5t2vMK85vor2XjFlaadfxIfr80kdo0QkBSOW9Fw6g04xkvzB0RPeZoAQic0+8GpAs='} 2024-04-25T01:46:24.555 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T01:46:24.583 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-25T01:46:24.584 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-25T01:46:24.584 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-25T01:46:24.584 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T01:46:24.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd31436f160>, signals=[15]) 2024-04-25T01:46:24.691 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T01:46:24.698 INFO:teuthology.task.internal:Opening connections... 2024-04-25T01:46:24.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T01:46:24.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:46:24.776 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-04-25T01:46:24.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:46:24.851 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-04-25T01:46:24.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:46:24.928 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T01:46:24.934 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-25T01:46:24.953 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-25T01:46:24.953 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-25T01:46:25.010 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-25T01:46:25.010 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-25T01:46:25.010 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-25T01:46:25.010 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:46:25.010 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:46:25.011 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:46:25.012 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-25T01:46:25.042 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-04-25T01:46:25.060 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-04-25T01:46:25.060 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:46:25.118 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:46:25.119 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:46:25.119 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:46:25.119 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-04-25T01:46:25.140 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-04-25T01:46:25.159 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-04-25T01:46:25.159 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-04-25T01:46:25.216 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T01:46:25.217 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T01:46:25.217 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T01:46:25.217 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-04-25T01:46:25.257 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T01:46:25.269 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T01:46:25.281 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T01:46:25.282 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:46:25.284 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:46:25.287 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-04-25T01:46:25.303 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T01:46:25.314 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T01:46:25.314 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:46:25.341 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:46:25.344 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-04-25T01:46:25.451 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T01:46:25.515 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T01:46:25.532 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-04-25T01:46:25.532 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-25T01:46:25.533 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-25T01:46:25.533 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:46:25.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:46:25.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-25T01:46:25.812 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:46:25.812 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T01:46:25.812 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-25T01:46:25.830 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-437.el9.x86_64 2024-04-25T01:46:25.830 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:46:25.830 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T01:46:25.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum upgrade -y linux-firmware 2024-04-25T01:46:31.192 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-04-25T01:46:37.973 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 19 MB 00:05 2024-04-25T01:46:47.873 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 1.0 MB/s | 6.2 MB 00:06 2024-04-25T01:46:49.574 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-25T01:46:52.361 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-04-25T01:46:57.409 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T01:46:59.371 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-25T01:46:59.372 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-25T01:46:59.372 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-25T01:46:59.478 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T01:46:59.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T01:46:59.711 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-25T01:46:59.711 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-25T01:46:59.714 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi137.front.sepia.ceph.com to complete... 2024-04-25T01:47:12.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25 01:47:12 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-25T01:47:12.876 INFO:teuthology.orchestra.run.smithi137.stderr:FINISHED --2024-04-25 01:47:12-- 2024-04-25T01:47:12.876 INFO:teuthology.orchestra.run.smithi137.stderr:Total wall clock time: 13s 2024-04-25T01:47:12.877 INFO:teuthology.orchestra.run.smithi137.stderr:Downloaded: 1 files, 341M in 13s (26.7 MB/s) 2024-04-25T01:47:12.879 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T01:47:12.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-25T01:47:14.957 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying... ######################################## 2024-04-25T01:47:15.077 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing... ######################################## 2024-04-25T01:47:15.188 INFO:teuthology.orchestra.run.smithi137.stdout:Updating / installing... 2024-04-25T01:47:23.112 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-25T01:48:02.347 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-25T01:48:02.347 DEBUG:teuthology.orchestra.run.smithi137:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-25T01:48:02.429 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.429 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.429 INFO:teuthology.orchestra.run.smithi137.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-25T01:48:02.429 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-25T01:48:02.430 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-25T01:48:02.431 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T01:48:02.432 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T01:48:02.433 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T01:48:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T01:48:02.435 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T01:48:02.436 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T01:48:02.437 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T01:48:02.438 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T01:48:02.439 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-25T01:48:02.440 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T01:48:02.441 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-25T01:48:02.442 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T01:48:02.443 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T01:48:02.444 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-25T01:48:02.445 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T01:48:02.446 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T01:48:02.447 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T01:48:02.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T01:48:02.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T01:48:02.449 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T01:48:02.450 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T01:48:02.451 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T01:48:02.452 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T01:48:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T01:48:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-25T01:48:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T01:48:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T01:48:02.457 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T01:48:02.458 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T01:48:02.459 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T01:48:02.460 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T01:48:02.461 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T01:48:02.462 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T01:48:02.463 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T01:48:02.464 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T01:48:02.465 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T01:48:02.466 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T01:48:02.467 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T01:48:02.468 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T01:48:02.469 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T01:48:02.470 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T01:48:02.471 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T01:48:02.472 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-25T01:48:02.473 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T01:48:02.474 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T01:48:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-25T01:48:02.476 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-25T01:48:02.477 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-25T01:48:02.478 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T01:48:02.479 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T01:48:02.480 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-25T01:48:02.481 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T01:48:02.482 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T01:48:02.483 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-25T01:48:02.484 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-25T01:48:02.485 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T01:48:02.486 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T01:48:02.487 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T01:48:02.488 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-25T01:48:02.489 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-25T01:48:02.490 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T01:48:02.491 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T01:48:02.492 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T01:48:02.493 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T01:48:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T01:48:02.495 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T01:48:02.496 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T01:48:02.497 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T01:48:02.498 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T01:48:02.499 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T01:48:02.500 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T01:48:02.501 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T01:48:02.502 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T01:48:02.503 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-25T01:48:02.504 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-25T01:48:02.505 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T01:48:02.506 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T01:48:02.507 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T01:48:02.508 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T01:48:02.509 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-25T01:48:02.510 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T01:48:02.511 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T01:48:02.512 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-25T01:48:02.513 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T01:48:02.514 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T01:48:02.515 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-25T01:48:02.516 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T01:48:02.517 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T01:48:02.518 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T01:48:02.519 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T01:48:02.520 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T01:48:02.521 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-25T01:48:02.522 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T01:48:02.523 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T01:48:02.524 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T01:48:02.525 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-25T01:48:02.526 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T01:48:02.527 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-25T01:48:02.528 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-25T01:48:02.529 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T01:48:02.530 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T01:48:02.531 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T01:48:02.532 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T01:48:02.533 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T01:48:02.534 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T01:48:02.535 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T01:48:02.536 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T01:48:02.537 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T01:48:02.538 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T01:48:02.539 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T01:48:02.540 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T01:48:02.541 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T01:48:02.542 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T01:48:02.543 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T01:48:02.544 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T01:48:02.545 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T01:48:02.546 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T01:48:02.547 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T01:48:02.548 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T01:48:02.549 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T01:48:02.550 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-25T01:48:02.551 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T01:48:02.552 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T01:48:02.553 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T01:48:02.554 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T01:48:02.555 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T01:48:02.556 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T01:48:02.557 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T01:48:02.558 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T01:48:02.559 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T01:48:02.560 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T01:48:02.561 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T01:48:02.562 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T01:48:02.563 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T01:48:02.564 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T01:48:02.565 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T01:48:02.566 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T01:48:02.567 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-25T01:48:02.568 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T01:48:02.569 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T01:48:02.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T01:48:02.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T01:48:02.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T01:48:02.570 INFO:teuthology.orchestra.run.smithi137.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T01:48:02.574 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.574 DEBUG:teuthology.orchestra.run.smithi137:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:postinstall scriptlet (using /bin/sh): 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:for file in vmlinuz System.map config; do 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: fi 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-25T01:48:02.597 INFO:teuthology.orchestra.run.smithi137.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.598 INFO:teuthology.orchestra.run.smithi137.stdout:fi 2024-04-25T01:48:02.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 68.el9 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-25T01:48:02.674 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8264254 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T01:48:02.675 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T01:48:02.676 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-04-25T01:48:02.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:48:02.676 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T01:48:02.677 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T01:48:02.677 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:02.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T01:48:03.206 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-25T01:48:04.565 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-25T01:48:04.585 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-25T01:48:04.588 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-25T01:48:04.617 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.OPhRsYnnam 2024-04-25T01:48:04.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OPhRsYnnam 2024-04-25T01:48:04.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.OPhRsYnnam 2024-04-25T01:48:04.829 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.OPhRsYnnam is 6KB 2024-04-25T01:48:04.861 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.OPhRsYnnam 2024-04-25T01:48:04.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T01:48:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-25T01:48:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-25T01:48:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-25T01:48:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-25T01:48:04.947 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-25T01:48:05.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-04-25T01:48:35.116 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T01:48:35.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:48:35.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:48:53.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-25T01:49:02.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:49:02.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:49:05.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-25T01:49:17.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:49:17.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:49:36.163 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-25T01:49:51.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:49:51.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:49:51.523 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-25T01:49:52.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:49:52.161 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T01:49:52.162 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-25T01:49:52.200 INFO:teuthology.orchestra.run.smithi137.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T01:49:52.200 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T01:49:52.200 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T01:49:52.201 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T01:49:53.201 DEBUG:teuthology.parallel:result is None 2024-04-25T01:49:53.202 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T01:49:53.209 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T01:49:53.210 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:49:53.216 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:49:53.218 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T01:49:53.260 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T01:49:53.267 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T01:49:53.276 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T01:49:53.276 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:49:53.281 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:49:53.283 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T01:49:53.335 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T01:49:53.341 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T01:49:53.342 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:49:53.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:49:53.362 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T01:49:53.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:49:53.379 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:49:53.386 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:49:53.405 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T01:49:53.439 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.458 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.466 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.471 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.558 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.613 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T01:49:53.617 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T01:49:53.626 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T01:49:53.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:49:53.631 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:49:53.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T01:49:53.693 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T01:49:53.702 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T01:49:53.703 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:49:53.707 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:49:53.709 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T01:49:53.746 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:53.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:53.916 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:53.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:54.047 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:49:54.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:49:54.125 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:54.171 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:54.222 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:54.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:54.347 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:49:54.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:49:54.412 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:54.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T01:49:54.514 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:54.599 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T01:49:54.641 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:49:54.641 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T01:49:54.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-25T01:49:54.713 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-04-25T01:49:54.715 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-04-25T01:49:54.751 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:49:54.780 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:49:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T01:49:55.276 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T01:49:55.284 INFO:teuthology.task.internal:Starting timer... 2024-04-25T01:49:55.284 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T01:49:55.299 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T01:49:55.308 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T01:49:55.308 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-04-25T01:49:55.444 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-04-25T01:49:55.449 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-04-25T01:49:55.539 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-04-25T01:49:55.542 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-04-25T01:49:55.605 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-04-25T01:49:55.607 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T01:49:55.607 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-04-25T01:49:55.657 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-04-25T01:49:55.658 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-04-25T01:49:55.686 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-04-25T01:49:55.686 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-04-25T01:49:55.727 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-04-25T01:49:55.727 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-04-25T01:49:55.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:49:55.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:49:55.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:49:55.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:49:55.827 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T01:49:55.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T01:49:55.856 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T01:49:55.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:49:55.922 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:49:55.952 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-04-25T01:49:55.978 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T01:49:55.988 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T01:49:56.005 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T01:49:56.006 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi163.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T01:54:57.116 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-04-25T01:54:57.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:54:57.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:54:57.224 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-25T01:54:57.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-25T01:54:57.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-25T01:54:57.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:54:57.455 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-04-25T01:54:57.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-25T01:54:57.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-25T01:54:57.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T01:54:57.619 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-04-25T01:54:57.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-04-25T01:54:57.703 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T01:54:57.775 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T01:54:57.776 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:54:57.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:54:57.784 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:54:57.784 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:54:57.787 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T01:54:57.787 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T01:54:57.815 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:54:57.817 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:54:57.830 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:54:57.832 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:54:57.854 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-04-25T01:54:57.856 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-04-25T01:54:57.865 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-04-25T01:54:57.867 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-04-25T01:54:57.875 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T01:54:57.879 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:54:57.880 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:54:57.892 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:54:57.894 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:54:57.917 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T01:54:57.945 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:54:57.948 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:54:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-25T01:54:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.949 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.958 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.962 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:57.989 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-04-25T01:54:58.020 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-04-25T01:54:58.058 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T01:54:58.098 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T01:54:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-25T01:54:58.241 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T01:54:58.241 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-25T01:54:58.241 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:58.242 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:58.242 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:58.242 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T01:54:58.243 INFO:teuthology.run_tasks:Running task install... 2024-04-25T01:54:58.251 DEBUG:teuthology.task.install:project ceph 2024-04-25T01:54:58.251 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T01:54:58.252 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T01:54:58.252 INFO:teuthology.task.install:Using flavor: default 2024-04-25T01:54:58.257 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T01:54:58.257 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T01:54:58.257 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:54:58.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:54:58.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:54:58.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:54:58.261 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T01:54:58.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:54:58.417 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T01:54:58.417 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T01:54:58.493 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T01:54:58.493 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T01:54:58.496 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/ 2024-04-25T01:54:58.496 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2445.gd2c45d97 2024-04-25T01:54:58.592 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:54:58.593 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:54:58.593 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:54:58.619 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T01:54:58.619 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:54:58.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:54:58.664 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:54:58.665 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:54:58.673 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T01:54:58.673 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:54:58.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T01:54:58.684 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:54:58.690 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T01:54:58.690 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:54:58.755 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:54:58.758 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:54:58.764 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T01:54:58.764 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2c45d977142e024a59b68a8f1dce8f0b9840551/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T01:54:58.821 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-04-25T01:54:58.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-04-25T01:54:58.828 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:54:58.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T01:54:58.893 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-04-25T01:54:58.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-04-25T01:54:59.002 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T01:54:59.045 INFO:teuthology.orchestra.run.smithi163.stdout:48 files removed 2024-04-25T01:54:59.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T01:54:59.075 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-04-25T01:54:59.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-04-25T01:54:59.118 INFO:teuthology.orchestra.run.smithi174.stdout:48 files removed 2024-04-25T01:54:59.146 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T01:54:59.388 INFO:teuthology.orchestra.run.smithi137.stdout:48 files removed 2024-04-25T01:54:59.426 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T01:54:59.723 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 216 kB/s | 83 kB 00:00 2024-04-25T01:54:59.876 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-04-25T01:55:00.090 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-25T01:55:00.210 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-04-25T01:55:00.243 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 218 kB/s | 83 kB 00:00 2024-04-25T01:55:00.549 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-04-25T01:55:00.644 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-25T01:55:00.810 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-04-25T01:55:01.194 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-25T01:55:01.287 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-25T01:55:01.976 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T01:55:02.057 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-25T01:55:04.227 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-25T01:55:04.303 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-04-25T01:55:09.229 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.2 MB 00:01 2024-04-25T01:55:10.863 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-25T01:55:10.975 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-04-25T01:55:12.258 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T01:55:13.030 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-25T01:55:15.168 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T01:55:17.366 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-25T01:55:19.459 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:19.460 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:19.470 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T01:55:19.471 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T01:55:19.472 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T01:55:19.473 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T01:55:19.474 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T01:55:19.477 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T01:55:19.477 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T01:55:19.537 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T01:55:19.556 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T01:55:19.557 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T01:55:19.558 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T01:55:19.559 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T01:55:19.560 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T01:55:19.561 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T01:55:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T01:55:19.563 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:55:19.564 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:55:19.565 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T01:55:19.566 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:55:19.567 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:55:19.568 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout:Install 148 Packages 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 4 Packages 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 220 M 2024-04-25T01:55:19.569 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-04-25T01:55:20.309 INFO:teuthology.orchestra.run.smithi174.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-25T01:55:20.723 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-04-25T01:55:21.171 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-25T01:55:21.401 INFO:teuthology.orchestra.run.smithi174.stdout:(2/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 3.7 MB/s | 5.4 MB 00:01 2024-04-25T01:55:21.476 INFO:teuthology.orchestra.run.smithi174.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.9 MB/s | 145 kB 00:00 2024-04-25T01:55:21.710 INFO:teuthology.orchestra.run.smithi174.stdout:(4/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 635 kB/s | 890 kB 00:01 2024-04-25T01:55:21.902 INFO:teuthology.orchestra.run.smithi174.stdout:(5/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 5.6 MB/s | 2.4 MB 00:00 2024-04-25T01:55:22.533 INFO:teuthology.orchestra.run.smithi174.stdout:(6/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 7.4 MB/s | 4.7 MB 00:00 2024-04-25T01:55:23.554 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:23.555 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:23.575 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T01:55:23.576 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T01:55:23.578 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T01:55:23.579 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T01:55:23.581 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T01:55:23.585 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T01:55:23.586 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T01:55:23.656 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T01:55:23.675 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T01:55:23.676 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T01:55:23.677 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:23.678 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T01:55:23.679 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:55:23.680 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T01:55:23.681 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:55:23.682 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:55:23.683 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:55:23.684 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:55:23.685 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:55:23.686 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 4 Packages 2024-04-25T01:55:23.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:55:23.688 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 220 M 2024-04-25T01:55:23.688 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-25T01:55:23.927 INFO:teuthology.orchestra.run.smithi174.stdout:(7/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 690 kB/s | 1.5 MB 00:02 2024-04-25T01:55:24.152 INFO:teuthology.orchestra.run.smithi174.stdout:(8/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x86 10 MB/s | 17 MB 00:01 2024-04-25T01:55:24.219 INFO:teuthology.orchestra.run.smithi174.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 379 kB/s | 25 kB 00:00 2024-04-25T01:55:25.056 INFO:teuthology.orchestra.run.smithi137.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-25T01:55:25.914 INFO:teuthology.orchestra.run.smithi137.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 890 kB 00:00 2024-04-25T01:55:26.023 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.2 MB 00:01 2024-04-25T01:55:26.031 INFO:teuthology.orchestra.run.smithi137.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 1.2 MB/s | 145 kB 00:00 2024-04-25T01:55:26.732 INFO:teuthology.orchestra.run.smithi137.stdout:(4/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-04-25T01:55:27.186 INFO:teuthology.orchestra.run.smithi174.stdout:(10/152): ceph-common-19.0.0-2445.gd2c45d97.el9 2.9 MB/s | 21 MB 00:07 2024-04-25T01:55:27.198 INFO:teuthology.orchestra.run.smithi137.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-04-25T01:55:27.274 INFO:teuthology.orchestra.run.smithi137.stdout:(6/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-04-25T01:55:27.303 INFO:teuthology.orchestra.run.smithi174.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 222 kB 00:00 2024-04-25T01:55:27.394 INFO:teuthology.orchestra.run.smithi174.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 296 kB/s | 27 kB 00:00 2024-04-25T01:55:27.478 INFO:teuthology.orchestra.run.smithi174.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 381 kB/s | 32 kB 00:00 2024-04-25T01:55:27.624 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-25T01:55:27.795 INFO:teuthology.orchestra.run.smithi174.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 2.3 MB/s | 745 kB 00:00 2024-04-25T01:55:27.879 INFO:teuthology.orchestra.run.smithi174.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.9 MB/s | 163 kB 00:00 2024-04-25T01:55:27.970 INFO:teuthology.orchestra.run.smithi174.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.4 MB/s | 127 kB 00:00 2024-04-25T01:55:28.065 INFO:teuthology.orchestra.run.smithi137.stdout:(7/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 5.4 MB/s | 4.7 MB 00:00 2024-04-25T01:55:28.146 INFO:teuthology.orchestra.run.smithi174.stdout:(17/152): libradosstriper1-19.0.0-2445.gd2c45d9 2.8 MB/s | 501 kB 00:00 2024-04-25T01:55:29.466 INFO:teuthology.orchestra.run.smithi137.stdout:(8/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el9 7.3 MB/s | 10 MB 00:01 2024-04-25T01:55:29.566 INFO:teuthology.orchestra.run.smithi137.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 254 kB/s | 25 kB 00:00 2024-04-25T01:55:29.729 INFO:teuthology.orchestra.run.smithi174.stdout:(18/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 3.4 MB/s | 5.3 MB 00:01 2024-04-25T01:55:29.829 INFO:teuthology.orchestra.run.smithi174.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 453 kB/s | 45 kB 00:00 2024-04-25T01:55:29.897 INFO:teuthology.orchestra.run.smithi174.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 1.9 MB/s | 133 kB 00:00 2024-04-25T01:55:29.972 INFO:teuthology.orchestra.run.smithi174.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 2.1 MB/s | 162 kB 00:00 2024-04-25T01:55:30.106 INFO:teuthology.orchestra.run.smithi174.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 2.4 MB/s | 321 kB 00:00 2024-04-25T01:55:30.240 INFO:teuthology.orchestra.run.smithi174.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.2 MB/s | 299 kB 00:00 2024-04-25T01:55:30.323 INFO:teuthology.orchestra.run.smithi174.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.2 MB/s | 99 kB 00:00 2024-04-25T01:55:30.407 INFO:teuthology.orchestra.run.smithi174.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-25T01:55:30.427 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-04-25T01:55:31.440 INFO:teuthology.orchestra.run.smithi174.stdout:(26/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 6.7 MB/s | 48 MB 00:07 2024-04-25T01:55:31.491 INFO:teuthology.orchestra.run.smithi174.stdout:(27/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 2.9 MB/s | 3.1 MB 00:01 2024-04-25T01:55:31.574 INFO:teuthology.orchestra.run.smithi174.stdout:(28/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 1.3 MB/s | 171 kB 00:00 2024-04-25T01:55:31.599 INFO:teuthology.orchestra.run.smithi174.stdout:(29/152): ceph-grafana-dashboards-19.0.0-2445.g 292 kB/s | 32 kB 00:00 2024-04-25T01:55:31.625 INFO:teuthology.orchestra.run.smithi174.stdout:(30/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 2.8 MB/s | 141 kB 00:00 2024-04-25T01:55:31.774 INFO:teuthology.orchestra.run.smithi137.stdout:(10/152): ceph-common-19.0.0-2445.gd2c45d97.el9 2.9 MB/s | 21 MB 00:07 2024-04-25T01:55:31.941 INFO:teuthology.orchestra.run.smithi137.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 1.3 MB/s | 222 kB 00:00 2024-04-25T01:55:32.033 INFO:teuthology.orchestra.run.smithi137.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 299 kB/s | 27 kB 00:00 2024-04-25T01:55:32.108 INFO:teuthology.orchestra.run.smithi137.stdout:(13/152): libcephfs-devel-19.0.0-2445.gd2c45d97 426 kB/s | 32 kB 00:00 2024-04-25T01:55:32.509 INFO:teuthology.orchestra.run.smithi137.stdout:(14/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 1.8 MB/s | 745 kB 00:00 2024-04-25T01:55:32.592 INFO:teuthology.orchestra.run.smithi174.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 3.5 MB/s | 3.5 MB 00:00 2024-04-25T01:55:32.609 INFO:teuthology.orchestra.run.smithi137.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 1.6 MB/s | 163 kB 00:00 2024-04-25T01:55:32.701 INFO:teuthology.orchestra.run.smithi137.stdout:(16/152): librados-devel-19.0.0-2445.gd2c45d97. 1.4 MB/s | 127 kB 00:00 2024-04-25T01:55:32.742 INFO:teuthology.orchestra.run.smithi174.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 1.6 MB/s | 249 kB 00:00 2024-04-25T01:55:32.817 INFO:teuthology.orchestra.run.smithi174.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 657 kB/s | 49 kB 00:00 2024-04-25T01:55:32.901 INFO:teuthology.orchestra.run.smithi174.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 184 kB/s | 15 kB 00:00 2024-04-25T01:55:32.942 INFO:teuthology.orchestra.run.smithi137.stdout:(17/152): libradosstriper1-19.0.0-2445.gd2c45d9 2.0 MB/s | 501 kB 00:00 2024-04-25T01:55:33.301 INFO:teuthology.orchestra.run.smithi174.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2024-04-25T01:55:33.334 INFO:teuthology.orchestra.run.smithi174.stdout:(36/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 608 kB/s | 264 kB 00:00 2024-04-25T01:55:33.426 INFO:teuthology.orchestra.run.smithi174.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 199 kB/s | 18 kB 00:00 2024-04-25T01:55:33.602 INFO:teuthology.orchestra.run.smithi174.stdout:(38/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 2.5 MB/s | 762 kB 00:00 2024-04-25T01:55:33.627 INFO:teuthology.orchestra.run.smithi174.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-04-25T01:55:33.760 INFO:teuthology.orchestra.run.smithi174.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-04-25T01:55:33.878 INFO:teuthology.orchestra.run.smithi174.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-04-25T01:55:34.086 INFO:teuthology.orchestra.run.smithi174.stdout:(42/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 1.0 MB/s | 10 MB 00:10 2024-04-25T01:55:34.161 INFO:teuthology.orchestra.run.smithi174.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-04-25T01:55:34.220 INFO:teuthology.orchestra.run.smithi174.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-04-25T01:55:34.287 INFO:teuthology.orchestra.run.smithi174.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 532 kB/s | 106 kB 00:00 2024-04-25T01:55:34.312 INFO:teuthology.orchestra.run.smithi174.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 900 kB/s | 135 kB 00:00 2024-04-25T01:55:34.337 INFO:teuthology.orchestra.run.smithi174.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-25T01:55:34.379 INFO:teuthology.orchestra.run.smithi174.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T01:55:34.676 INFO:teuthology.orchestra.run.smithi137.stdout:(18/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 9.5 MB/s | 48 MB 00:05 2024-04-25T01:55:34.818 INFO:teuthology.orchestra.run.smithi137.stdout:(19/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 2.8 MB/s | 5.3 MB 00:01 2024-04-25T01:55:34.844 INFO:teuthology.orchestra.run.smithi137.stdout:(20/152): python3-ceph-argparse-19.0.0-2445.gd2 272 kB/s | 45 kB 00:00 2024-04-25T01:55:34.877 INFO:teuthology.orchestra.run.smithi137.stdout:(21/152): python3-ceph-common-19.0.0-2445.gd2c4 2.2 MB/s | 133 kB 00:00 2024-04-25T01:55:34.913 INFO:teuthology.orchestra.run.smithi174.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 200 kB/s | 107 kB 00:00 2024-04-25T01:55:34.936 INFO:teuthology.orchestra.run.smithi137.stdout:(22/152): python3-cephfs-19.0.0-2445.gd2c45d97. 1.7 MB/s | 162 kB 00:00 2024-04-25T01:55:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:(23/152): python3-rados-19.0.0-2445.gd2c45d97.e 2.9 MB/s | 321 kB 00:00 2024-04-25T01:55:35.036 INFO:teuthology.orchestra.run.smithi137.stdout:(24/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.9 MB/s | 299 kB 00:00 2024-04-25T01:55:35.038 INFO:teuthology.orchestra.run.smithi174.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 172 kB/s | 21 kB 00:00 2024-04-25T01:55:35.070 INFO:teuthology.orchestra.run.smithi137.stdout:(25/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.2 MB/s | 99 kB 00:00 2024-04-25T01:55:35.103 INFO:teuthology.orchestra.run.smithi137.stdout:(26/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-25T01:55:35.170 INFO:teuthology.orchestra.run.smithi137.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 2.5 MB/s | 171 kB 00:00 2024-04-25T01:55:35.239 INFO:teuthology.orchestra.run.smithi174.stdout:(51/152): automake-1.16.2-8.el9.noarch.rpm 744 kB/s | 689 kB 00:00 2024-04-25T01:55:35.246 INFO:teuthology.orchestra.run.smithi137.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 429 kB/s | 32 kB 00:00 2024-04-25T01:55:35.272 INFO:teuthology.orchestra.run.smithi174.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-04-25T01:55:35.321 INFO:teuthology.orchestra.run.smithi137.stdout:(29/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 1.9 MB/s | 141 kB 00:00 2024-04-25T01:55:35.322 INFO:teuthology.orchestra.run.smithi174.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-04-25T01:55:35.348 INFO:teuthology.orchestra.run.smithi174.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-04-25T01:55:35.431 INFO:teuthology.orchestra.run.smithi174.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-04-25T01:55:35.465 INFO:teuthology.orchestra.run.smithi174.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-04-25T01:55:35.540 INFO:teuthology.orchestra.run.smithi174.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-25T01:55:35.565 INFO:teuthology.orchestra.run.smithi174.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-04-25T01:55:35.669 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T01:55:35.679 INFO:teuthology.orchestra.run.smithi137.stdout:(30/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 2.0 MB/s | 17 MB 00:08 2024-04-25T01:55:35.690 INFO:teuthology.orchestra.run.smithi174.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-04-25T01:55:35.790 INFO:teuthology.orchestra.run.smithi174.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 255 kB/s | 25 kB 00:00 2024-04-25T01:55:35.796 INFO:teuthology.orchestra.run.smithi137.stdout:(31/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 4.3 MB/s | 3.1 MB 00:00 2024-04-25T01:55:35.824 INFO:teuthology.orchestra.run.smithi174.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-04-25T01:55:35.850 INFO:teuthology.orchestra.run.smithi174.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-04-25T01:55:35.897 INFO:teuthology.orchestra.run.smithi137.stdout:(32/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 6.1 MB/s | 3.5 MB 00:00 2024-04-25T01:55:35.900 INFO:teuthology.orchestra.run.smithi174.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-04-25T01:55:35.930 INFO:teuthology.orchestra.run.smithi137.stdout:(33/152): ceph-mgr-modules-core-19.0.0-2445.gd2 1.8 MB/s | 249 kB 00:00 2024-04-25T01:55:35.933 INFO:teuthology.orchestra.run.smithi174.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-25T01:55:35.959 INFO:teuthology.orchestra.run.smithi174.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-25T01:55:35.972 INFO:teuthology.orchestra.run.smithi137.stdout:(34/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 665 kB/s | 49 kB 00:00 2024-04-25T01:55:35.997 INFO:teuthology.orchestra.run.smithi137.stdout:(35/152): ceph-prometheus-alerts-19.0.0-2445.gd 232 kB/s | 15 kB 00:00 2024-04-25T01:55:36.000 INFO:teuthology.orchestra.run.smithi174.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-25T01:55:36.056 INFO:teuthology.orchestra.run.smithi137.stdout:(36/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 3.1 MB/s | 264 kB 00:00 2024-04-25T01:55:36.123 INFO:teuthology.orchestra.run.smithi137.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 277 kB/s | 18 kB 00:00 2024-04-25T01:55:36.134 INFO:teuthology.orchestra.run.smithi174.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T01:55:36.165 INFO:teuthology.orchestra.run.smithi137.stdout:(38/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 4.5 MB/s | 762 kB 00:00 2024-04-25T01:55:36.324 INFO:teuthology.orchestra.run.smithi137.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 403 kB/s | 80 kB 00:00 2024-04-25T01:55:36.384 INFO:teuthology.orchestra.run.smithi174.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-25T01:55:36.474 INFO:teuthology.orchestra.run.smithi137.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-25T01:55:36.534 INFO:teuthology.orchestra.run.smithi174.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 7.9 MB/s | 4.7 MB 00:00 2024-04-25T01:55:36.541 INFO:teuthology.orchestra.run.smithi137.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-04-25T01:55:36.649 INFO:teuthology.orchestra.run.smithi137.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-04-25T01:55:36.676 INFO:teuthology.orchestra.run.smithi174.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 456 kB/s | 133 kB 00:00 2024-04-25T01:55:36.716 INFO:teuthology.orchestra.run.smithi137.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T01:55:36.767 INFO:teuthology.orchestra.run.smithi137.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 5.5 MB/s | 1.2 MB 00:00 2024-04-25T01:55:36.809 INFO:teuthology.orchestra.run.smithi137.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-04-25T01:55:36.842 INFO:teuthology.orchestra.run.smithi137.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-25T01:55:36.901 INFO:teuthology.orchestra.run.smithi137.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T01:55:37.143 INFO:teuthology.orchestra.run.smithi137.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-04-25T01:55:37.193 INFO:teuthology.orchestra.run.smithi137.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-25T01:55:37.235 INFO:teuthology.orchestra.run.smithi137.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-04-25T01:55:37.260 INFO:teuthology.orchestra.run.smithi137.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 325 kB/s | 21 kB 00:00 2024-04-25T01:55:37.310 INFO:teuthology.orchestra.run.smithi137.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 667 kB/s | 33 kB 00:00 2024-04-25T01:55:37.361 INFO:teuthology.orchestra.run.smithi137.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-04-25T01:55:37.411 INFO:teuthology.orchestra.run.smithi137.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 371 kB/s | 18 kB 00:00 2024-04-25T01:55:37.461 INFO:teuthology.orchestra.run.smithi137.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 227 kB/s | 11 kB 00:00 2024-04-25T01:55:37.468 INFO:teuthology.orchestra.run.smithi174.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 683 kB/s | 911 kB 00:01 2024-04-25T01:55:37.537 INFO:teuthology.orchestra.run.smithi137.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-25T01:55:37.587 INFO:teuthology.orchestra.run.smithi137.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 923 kB/s | 45 kB 00:00 2024-04-25T01:55:37.660 INFO:teuthology.orchestra.run.smithi174.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 87 kB 00:00 2024-04-25T01:55:37.754 INFO:teuthology.orchestra.run.smithi137.stdout:(58/152): ceph-mgr-diskprediction-local-19.0.0- 3.6 MB/s | 7.4 MB 00:02 2024-04-25T01:55:37.812 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:37.812 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T01:55:37.824 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T01:55:37.824 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T01:55:37.825 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T01:55:37.826 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T01:55:37.827 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T01:55:37.829 INFO:teuthology.orchestra.run.smithi137.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-04-25T01:55:37.830 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T01:55:37.831 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T01:55:37.888 INFO:teuthology.orchestra.run.smithi137.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-25T01:55:37.894 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-25T01:55:37.913 INFO:teuthology.orchestra.run.smithi137.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 308 kB/s | 25 kB 00:00 2024-04-25T01:55:37.916 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 6.6 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.4 M 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 890 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 145 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 1.5 M 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 141 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 3.5 M 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 7.4 M 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 49 k 2024-04-25T01:55:37.917 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 10 M 2024-04-25T01:55:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 48 M 2024-04-25T01:55:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 264 k 2024-04-25T01:55:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 762 k 2024-04-25T01:55:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 222 k 2024-04-25T01:55:37.918 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 27 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 18 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 32 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 745 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 127 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T01:55:37.919 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 162 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 321 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 299 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 99 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 85 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 171 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.4 M 2024-04-25T01:55:37.920 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 3.1 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 21 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 32 k 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 2.4 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 249 k 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 4.7 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 17 M 2024-04-25T01:55:37.921 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2445.gd2c45d97.el9 ceph-noarch 15 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 25 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 163 k 2024-04-25T01:55:37.922 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 501 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 5.3 M 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T01:55:37.923 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 45 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.0.0-2445.gd2c45d97.el9 ceph 133 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T01:55:37.924 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T01:55:37.925 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T01:55:37.926 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T01:55:37.927 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T01:55:37.928 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================= 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout:Install 148 Packages 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 4 Packages 2024-04-25T01:55:37.929 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:55:37.930 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 220 M 2024-04-25T01:55:37.930 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-25T01:55:37.972 INFO:teuthology.orchestra.run.smithi137.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 826 kB/s | 47 kB 00:00 2024-04-25T01:55:38.005 INFO:teuthology.orchestra.run.smithi137.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-25T01:55:38.047 INFO:teuthology.orchestra.run.smithi137.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-04-25T01:55:38.072 INFO:teuthology.orchestra.run.smithi137.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 35 kB 00:00 2024-04-25T01:55:38.110 INFO:teuthology.orchestra.run.smithi174.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 721 kB/s | 1.0 MB 00:01 2024-04-25T01:55:38.114 INFO:teuthology.orchestra.run.smithi137.stdout:(66/152): libtool-2.4.6-45.el9.x86_64.rpm 1.6 MB/s | 582 kB 00:00 2024-04-25T01:55:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T01:55:38.461 INFO:teuthology.orchestra.run.smithi174.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 698 kB/s | 244 kB 00:00 2024-04-25T01:55:38.465 INFO:teuthology.orchestra.run.smithi137.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-04-25T01:55:38.515 INFO:teuthology.orchestra.run.smithi137.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-04-25T01:55:38.549 INFO:teuthology.orchestra.run.smithi137.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-25T01:55:38.816 INFO:teuthology.orchestra.run.smithi137.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 6.2 MB/s | 4.7 MB 00:00 2024-04-25T01:55:38.866 INFO:teuthology.orchestra.run.smithi137.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-04-25T01:55:38.891 INFO:teuthology.orchestra.run.smithi137.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 87 kB 00:00 2024-04-25T01:55:38.894 INFO:teuthology.orchestra.run.smithi174.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 2.4 MB/s | 5.8 MB 00:02 2024-04-25T01:55:38.919 INFO:teuthology.orchestra.run.smithi174.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 540 kB/s | 248 kB 00:00 2024-04-25T01:55:39.025 INFO:teuthology.orchestra.run.smithi137.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-04-25T01:55:39.028 INFO:teuthology.orchestra.run.smithi174.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-04-25T01:55:39.053 INFO:teuthology.orchestra.run.smithi174.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-04-25T01:55:39.059 INFO:teuthology.orchestra.run.smithi137.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-04-25T01:55:39.092 INFO:teuthology.orchestra.run.smithi137.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-04-25T01:55:39.134 INFO:teuthology.orchestra.run.smithi137.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 348 kB/s | 26 kB 00:00 2024-04-25T01:55:39.159 INFO:teuthology.orchestra.run.smithi137.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 289 kB/s | 19 kB 00:00 2024-04-25T01:55:39.162 INFO:teuthology.orchestra.run.smithi174.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-25T01:55:39.187 INFO:teuthology.orchestra.run.smithi174.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 260 kB/s | 35 kB 00:00 2024-04-25T01:55:39.193 INFO:teuthology.orchestra.run.smithi137.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T01:55:39.218 INFO:teuthology.orchestra.run.smithi137.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 605 kB/s | 35 kB 00:00 2024-04-25T01:55:39.270 INFO:teuthology.orchestra.run.smithi163.stdout:(1/152): ceph-19.0.0-2445.gd2c45d97.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-25T01:55:39.285 INFO:teuthology.orchestra.run.smithi137.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.8 MB/s | 250 kB 00:00 2024-04-25T01:55:39.344 INFO:teuthology.orchestra.run.smithi137.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-25T01:55:39.394 INFO:teuthology.orchestra.run.smithi137.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T01:55:39.444 INFO:teuthology.orchestra.run.smithi137.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 861 kB/s | 42 kB 00:00 2024-04-25T01:55:39.504 INFO:teuthology.orchestra.run.smithi163.stdout:(2/152): ceph-fuse-19.0.0-2445.gd2c45d97.el9.x8 3.7 MB/s | 890 kB 00:00 2024-04-25T01:55:39.546 INFO:teuthology.orchestra.run.smithi174.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 699 kB/s | 250 kB 00:00 2024-04-25T01:55:39.554 INFO:teuthology.orchestra.run.smithi163.stdout:(3/152): ceph-immutable-object-cache-19.0.0-244 2.8 MB/s | 145 kB 00:00 2024-04-25T01:55:39.586 INFO:teuthology.orchestra.run.smithi137.stdout:(85/152): python3-babel-2.9.1-2.el9.noarch.rpm 8.3 MB/s | 6.0 MB 00:00 2024-04-25T01:55:39.619 INFO:teuthology.orchestra.run.smithi137.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-04-25T01:55:39.653 INFO:teuthology.orchestra.run.smithi137.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-04-25T01:55:39.715 INFO:teuthology.orchestra.run.smithi137.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.9 MB/s | 279 kB 00:00 2024-04-25T01:55:39.745 INFO:teuthology.orchestra.run.smithi137.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 561 kB/s | 51 kB 00:00 2024-04-25T01:55:39.771 INFO:teuthology.orchestra.run.smithi137.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 989 kB/s | 54 kB 00:00 2024-04-25T01:55:39.854 INFO:teuthology.orchestra.run.smithi163.stdout:(4/152): ceph-mds-19.0.0-2445.gd2c45d97.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-04-25T01:55:39.887 INFO:teuthology.orchestra.run.smithi174.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 651 kB/s | 222 kB 00:00 2024-04-25T01:55:39.996 INFO:teuthology.orchestra.run.smithi137.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.4 MB/s | 5.1 MB 00:00 2024-04-25T01:55:40.022 INFO:teuthology.orchestra.run.smithi137.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 167 kB/s | 42 kB 00:00 2024-04-25T01:55:40.047 INFO:teuthology.orchestra.run.smithi137.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 891 kB/s | 44 kB 00:00 2024-04-25T01:55:40.080 INFO:teuthology.orchestra.run.smithi137.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.8 MB/s | 221 kB 00:00 2024-04-25T01:55:40.088 INFO:teuthology.orchestra.run.smithi174.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 385 kB/s | 77 kB 00:00 2024-04-25T01:55:40.105 INFO:teuthology.orchestra.run.smithi137.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 625 kB/s | 36 kB 00:00 2024-04-25T01:55:40.131 INFO:teuthology.orchestra.run.smithi137.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-04-25T01:55:40.164 INFO:teuthology.orchestra.run.smithi137.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-04-25T01:55:40.188 INFO:teuthology.orchestra.run.smithi174.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-04-25T01:55:40.190 INFO:teuthology.orchestra.run.smithi137.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-25T01:55:40.223 INFO:teuthology.orchestra.run.smithi137.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T01:55:40.249 INFO:teuthology.orchestra.run.smithi137.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T01:55:40.274 INFO:teuthology.orchestra.run.smithi137.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 911 kB/s | 45 kB 00:00 2024-04-25T01:55:40.321 INFO:teuthology.orchestra.run.smithi163.stdout:(5/152): ceph-mgr-19.0.0-2445.gd2c45d97.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-04-25T01:55:40.430 INFO:teuthology.orchestra.run.smithi174.stdout:(85/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-04-25T01:55:40.539 INFO:teuthology.orchestra.run.smithi174.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-25T01:55:40.549 INFO:teuthology.orchestra.run.smithi137.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 75 kB/s | 22 kB 00:00 2024-04-25T01:55:40.647 INFO:teuthology.orchestra.run.smithi174.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-25T01:55:40.673 INFO:teuthology.orchestra.run.smithi174.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 556 kB/s | 269 kB 00:00 2024-04-25T01:55:40.748 INFO:teuthology.orchestra.run.smithi174.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-04-25T01:55:40.773 INFO:teuthology.orchestra.run.smithi174.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 535 kB/s | 54 kB 00:00 2024-04-25T01:55:40.841 INFO:teuthology.orchestra.run.smithi137.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-25T01:55:40.882 INFO:teuthology.orchestra.run.smithi174.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-04-25T01:55:40.925 INFO:teuthology.orchestra.run.smithi137.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.7 MB/s | 309 kB 00:00 2024-04-25T01:55:40.982 INFO:teuthology.orchestra.run.smithi174.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-04-25T01:55:40.983 INFO:teuthology.orchestra.run.smithi137.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 338 kB/s | 19 kB 00:00 2024-04-25T01:55:41.058 INFO:teuthology.orchestra.run.smithi137.stdout:(106/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-04-25T01:55:41.196 INFO:teuthology.orchestra.run.smithi163.stdout:(6/152): ceph-mon-19.0.0-2445.gd2c45d97.el9.x86 5.4 MB/s | 4.7 MB 00:00 2024-04-25T01:55:41.276 INFO:teuthology.orchestra.run.smithi137.stdout:(107/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-04-25T01:55:41.333 INFO:teuthology.orchestra.run.smithi174.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 631 kB/s | 221 kB 00:00 2024-04-25T01:55:41.392 INFO:teuthology.orchestra.run.smithi137.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 78 kB/s | 26 kB 00:00 2024-04-25T01:55:41.441 INFO:teuthology.orchestra.run.smithi174.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-04-25T01:55:41.443 INFO:teuthology.orchestra.run.smithi137.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 293 kB/s | 49 kB 00:00 2024-04-25T01:55:41.510 INFO:teuthology.orchestra.run.smithi137.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 583 kB/s | 67 kB 00:00 2024-04-25T01:55:41.541 INFO:teuthology.orchestra.run.smithi174.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-04-25T01:55:41.610 INFO:teuthology.orchestra.run.smithi137.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-04-25T01:55:41.635 INFO:teuthology.orchestra.run.smithi137.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 788 kB/s | 151 kB 00:00 2024-04-25T01:55:41.702 INFO:teuthology.orchestra.run.smithi137.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 5.9 MB/s | 548 kB 00:00 2024-04-25T01:55:41.728 INFO:teuthology.orchestra.run.smithi137.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 477 kB/s | 43 kB 00:00 2024-04-25T01:55:41.795 INFO:teuthology.orchestra.run.smithi137.stdout:(115/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2024-04-25T01:55:41.820 INFO:teuthology.orchestra.run.smithi137.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-04-25T01:55:41.845 INFO:teuthology.orchestra.run.smithi137.stdout:(117/152): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-04-25T01:55:41.879 INFO:teuthology.orchestra.run.smithi137.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T01:55:41.929 INFO:teuthology.orchestra.run.smithi137.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-04-25T01:55:41.954 INFO:teuthology.orchestra.run.smithi137.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 474 kB/s | 35 kB 00:00 2024-04-25T01:55:41.975 INFO:teuthology.orchestra.run.smithi174.stdout:(96/152): python3-babel-2.9.1-2.el9.noarch.rpm 1.4 MB/s | 6.0 MB 00:04 2024-04-25T01:55:41.988 INFO:teuthology.orchestra.run.smithi137.stdout:(121/152): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-04-25T01:55:42.000 INFO:teuthology.orchestra.run.smithi174.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 665 kB/s | 305 kB 00:00 2024-04-25T01:55:42.022 INFO:teuthology.orchestra.run.smithi137.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-04-25T01:55:42.055 INFO:teuthology.orchestra.run.smithi137.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-25T01:55:42.075 INFO:teuthology.orchestra.run.smithi174.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-04-25T01:55:42.081 INFO:teuthology.orchestra.run.smithi137.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-04-25T01:55:42.106 INFO:teuthology.orchestra.run.smithi137.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2024-04-25T01:55:42.173 INFO:teuthology.orchestra.run.smithi137.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-04-25T01:55:42.192 INFO:teuthology.orchestra.run.smithi174.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 488 kB/s | 94 kB 00:00 2024-04-25T01:55:42.198 INFO:teuthology.orchestra.run.smithi137.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-04-25T01:55:42.223 INFO:teuthology.orchestra.run.smithi137.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2024-04-25T01:55:42.248 INFO:teuthology.orchestra.run.smithi137.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2024-04-25T01:55:42.251 INFO:teuthology.orchestra.run.smithi174.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 363 kB/s | 64 kB 00:00 2024-04-25T01:55:42.282 INFO:teuthology.orchestra.run.smithi137.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 807 kB/s | 46 kB 00:00 2024-04-25T01:55:42.293 INFO:teuthology.orchestra.run.smithi174.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-04-25T01:55:42.307 INFO:teuthology.orchestra.run.smithi137.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-25T01:55:42.341 INFO:teuthology.orchestra.run.smithi137.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2024-04-25T01:55:42.383 INFO:teuthology.orchestra.run.smithi137.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 6.5 MB/s | 1.0 MB 00:00 2024-04-25T01:55:42.401 INFO:teuthology.orchestra.run.smithi174.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-25T01:55:42.408 INFO:teuthology.orchestra.run.smithi137.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2024-04-25T01:55:42.442 INFO:teuthology.orchestra.run.smithi137.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-04-25T01:55:42.467 INFO:teuthology.orchestra.run.smithi137.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 487 kB/s | 28 kB 00:00 2024-04-25T01:55:42.492 INFO:teuthology.orchestra.run.smithi137.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 831 kB/s | 90 kB 00:00 2024-04-25T01:55:42.518 INFO:teuthology.orchestra.run.smithi137.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-04-25T01:55:42.543 INFO:teuthology.orchestra.run.smithi137.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-25T01:55:42.568 INFO:teuthology.orchestra.run.smithi137.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 790 kB/s | 59 kB 00:00 2024-04-25T01:55:42.576 INFO:teuthology.orchestra.run.smithi174.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-04-25T01:55:42.593 INFO:teuthology.orchestra.run.smithi137.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-04-25T01:55:42.619 INFO:teuthology.orchestra.run.smithi137.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-04-25T01:55:42.652 INFO:teuthology.orchestra.run.smithi137.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-25T01:55:42.677 INFO:teuthology.orchestra.run.smithi137.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-04-25T01:55:42.711 INFO:teuthology.orchestra.run.smithi137.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-04-25T01:55:42.744 INFO:teuthology.orchestra.run.smithi137.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 219 kB/s | 20 kB 00:00 2024-04-25T01:55:42.793 INFO:teuthology.orchestra.run.smithi174.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-25T01:55:42.795 INFO:teuthology.orchestra.run.smithi137.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-25T01:55:42.827 INFO:teuthology.orchestra.run.smithi174.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-04-25T01:55:42.852 INFO:teuthology.orchestra.run.smithi174.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-25T01:55:42.878 INFO:teuthology.orchestra.run.smithi137.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-25T01:55:42.902 INFO:teuthology.orchestra.run.smithi174.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-04-25T01:55:42.928 INFO:teuthology.orchestra.run.smithi174.stdout:(108/152): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-04-25T01:55:42.961 INFO:teuthology.orchestra.run.smithi174.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-04-25T01:55:43.028 INFO:teuthology.orchestra.run.smithi174.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-25T01:55:43.054 INFO:teuthology.orchestra.run.smithi174.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 536 kB/s | 67 kB 00:00 2024-04-25T01:55:43.112 INFO:teuthology.orchestra.run.smithi174.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-25T01:55:43.171 INFO:teuthology.orchestra.run.smithi174.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 838 kB 00:00 2024-04-25T01:55:43.196 INFO:teuthology.orchestra.run.smithi174.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-04-25T01:55:43.230 INFO:teuthology.orchestra.run.smithi174.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-04-25T01:55:43.255 INFO:teuthology.orchestra.run.smithi174.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-04-25T01:55:43.280 INFO:teuthology.orchestra.run.smithi174.stdout:(117/152): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-04-25T01:55:43.306 INFO:teuthology.orchestra.run.smithi174.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T01:55:43.331 INFO:teuthology.orchestra.run.smithi174.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-25T01:55:43.356 INFO:teuthology.orchestra.run.smithi174.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-25T01:55:43.381 INFO:teuthology.orchestra.run.smithi174.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-25T01:55:43.387 INFO:teuthology.orchestra.run.smithi137.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 2.7 MB/s | 1.3 MB 00:00 2024-04-25T01:55:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T01:55:43.440 INFO:teuthology.orchestra.run.smithi174.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-25T01:55:43.549 INFO:teuthology.orchestra.run.smithi174.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-04-25T01:55:43.571 INFO:teuthology.orchestra.run.smithi163.stdout:(7/152): ceph-common-19.0.0-2445.gd2c45d97.el9. 4.4 MB/s | 21 MB 00:04 2024-04-25T01:55:43.574 INFO:teuthology.orchestra.run.smithi174.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2024-04-25T01:55:43.625 INFO:teuthology.orchestra.run.smithi174.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-04-25T01:55:43.650 INFO:teuthology.orchestra.run.smithi174.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-25T01:55:43.675 INFO:teuthology.orchestra.run.smithi174.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-25T01:55:43.700 INFO:teuthology.orchestra.run.smithi174.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-25T01:55:43.734 INFO:teuthology.orchestra.run.smithi174.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-04-25T01:55:43.750 INFO:teuthology.orchestra.run.smithi174.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-25T01:55:43.784 INFO:teuthology.orchestra.run.smithi174.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-04-25T01:55:43.809 INFO:teuthology.orchestra.run.smithi174.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2024-04-25T01:55:43.822 INFO:teuthology.orchestra.run.smithi163.stdout:(8/152): ceph-base-19.0.0-2445.gd2c45d97.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-04-25T01:55:43.835 INFO:teuthology.orchestra.run.smithi174.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-25T01:55:43.837 INFO:teuthology.orchestra.run.smithi137.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.3 MB/s | 2.4 MB 00:00 2024-04-25T01:55:43.860 INFO:teuthology.orchestra.run.smithi174.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-25T01:55:43.885 INFO:teuthology.orchestra.run.smithi174.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-25T01:55:43.888 INFO:teuthology.orchestra.run.smithi163.stdout:(9/152): ceph-selinux-19.0.0-2445.gd2c45d97.el9 380 kB/s | 25 kB 00:00 2024-04-25T01:55:43.902 INFO:teuthology.orchestra.run.smithi174.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-04-25T01:55:43.919 INFO:teuthology.orchestra.run.smithi174.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-04-25T01:55:43.937 INFO:teuthology.orchestra.run.smithi137.stdout:(151/152): librados2-19.0.0-2445.gd2c45d97.el9. 2.8 MB/s | 3.4 MB 00:01 2024-04-25T01:55:43.944 INFO:teuthology.orchestra.run.smithi174.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-25T01:55:43.994 INFO:teuthology.orchestra.run.smithi174.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-04-25T01:55:44.011 INFO:teuthology.orchestra.run.smithi174.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-25T01:55:44.028 INFO:teuthology.orchestra.run.smithi174.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 610 kB/s | 51 kB 00:00 2024-04-25T01:55:44.053 INFO:teuthology.orchestra.run.smithi174.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-25T01:55:44.071 INFO:teuthology.orchestra.run.smithi174.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-25T01:55:44.104 INFO:teuthology.orchestra.run.smithi174.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-25T01:55:44.130 INFO:teuthology.orchestra.run.smithi174.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-04-25T01:55:44.155 INFO:teuthology.orchestra.run.smithi174.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T01:55:44.197 INFO:teuthology.orchestra.run.smithi174.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-25T01:55:44.555 INFO:teuthology.orchestra.run.smithi174.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 1.3 MB 00:00 2024-04-25T01:55:44.956 INFO:teuthology.orchestra.run.smithi174.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 2.4 MB 00:00 2024-04-25T01:55:45.047 INFO:teuthology.orchestra.run.smithi174.stdout:(151/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-04-25T01:55:45.062 INFO:teuthology.orchestra.run.smithi137.stdout:(152/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-04-25T01:55:45.069 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:55:45.069 INFO:teuthology.orchestra.run.smithi137.stdout:Total 10 MB/s | 220 MB 00:21 2024-04-25T01:55:45.247 INFO:teuthology.orchestra.run.smithi163.stdout:(10/152): ceph-radosgw-19.0.0-2445.gd2c45d97.el 6.1 MB/s | 10 MB 00:01 2024-04-25T01:55:45.297 INFO:teuthology.orchestra.run.smithi163.stdout:(11/152): cephfs-mirror-19.0.0-2445.gd2c45d97.e 4.4 MB/s | 222 kB 00:00 2024-04-25T01:55:45.347 INFO:teuthology.orchestra.run.smithi163.stdout:(12/152): cephfs-shell-19.0.0-2445.gd2c45d97.el 544 kB/s | 27 kB 00:00 2024-04-25T01:55:45.498 INFO:teuthology.orchestra.run.smithi163.stdout:(13/152): ceph-osd-19.0.0-2445.gd2c45d97.el9.x8 3.9 MB/s | 17 MB 00:04 2024-04-25T01:55:45.523 INFO:teuthology.orchestra.run.smithi163.stdout:(14/152): libcephfs-devel-19.0.0-2445.gd2c45d97 181 kB/s | 32 kB 00:00 2024-04-25T01:55:45.573 INFO:teuthology.orchestra.run.smithi163.stdout:(15/152): libcephsqlite-19.0.0-2445.gd2c45d97.e 3.2 MB/s | 163 kB 00:00 2024-04-25T01:55:45.624 INFO:teuthology.orchestra.run.smithi163.stdout:(16/152): libcephfs2-19.0.0-2445.gd2c45d97.el9. 5.8 MB/s | 745 kB 00:00 2024-04-25T01:55:45.649 INFO:teuthology.orchestra.run.smithi163.stdout:(17/152): librados-devel-19.0.0-2445.gd2c45d97. 1.6 MB/s | 127 kB 00:00 2024-04-25T01:55:45.706 INFO:teuthology.orchestra.run.smithi174.stdout:(152/152): librados2-19.0.0-2445.gd2c45d97.el9. 2.1 MB/s | 3.4 MB 00:01 2024-04-25T01:55:45.708 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:55:45.709 INFO:teuthology.orchestra.run.smithi174.stdout:Total 8.4 MB/s | 220 MB 00:26 2024-04-25T01:55:45.716 INFO:teuthology.orchestra.run.smithi163.stdout:(18/152): libradosstriper1-19.0.0-2445.gd2c45d9 5.3 MB/s | 501 kB 00:00 2024-04-25T01:55:45.767 INFO:teuthology.orchestra.run.smithi163.stdout:(19/152): python3-ceph-argparse-19.0.0-2445.gd2 906 kB/s | 45 kB 00:00 2024-04-25T01:55:45.817 INFO:teuthology.orchestra.run.smithi163.stdout:(20/152): python3-ceph-common-19.0.0-2445.gd2c4 2.6 MB/s | 133 kB 00:00 2024-04-25T01:55:45.878 INFO:teuthology.orchestra.run.smithi163.stdout:(21/152): python3-cephfs-19.0.0-2445.gd2c45d97. 2.7 MB/s | 162 kB 00:00 2024-04-25T01:55:45.976 INFO:teuthology.orchestra.run.smithi163.stdout:(22/152): python3-rados-19.0.0-2445.gd2c45d97.e 3.1 MB/s | 321 kB 00:00 2024-04-25T01:55:46.076 INFO:teuthology.orchestra.run.smithi163.stdout:(23/152): python3-rbd-19.0.0-2445.gd2c45d97.el9 2.9 MB/s | 299 kB 00:00 2024-04-25T01:55:46.135 INFO:teuthology.orchestra.run.smithi163.stdout:(24/152): python3-rgw-19.0.0-2445.gd2c45d97.el9 1.7 MB/s | 99 kB 00:00 2024-04-25T01:55:46.193 INFO:teuthology.orchestra.run.smithi163.stdout:(25/152): rbd-fuse-19.0.0-2445.gd2c45d97.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-25T01:55:46.269 INFO:teuthology.orchestra.run.smithi163.stdout:(26/152): librgw2-19.0.0-2445.gd2c45d97.el9.x86 8.6 MB/s | 5.3 MB 00:00 2024-04-25T01:55:46.319 INFO:teuthology.orchestra.run.smithi163.stdout:(27/152): rbd-nbd-19.0.0-2445.gd2c45d97.el9.x86 3.4 MB/s | 171 kB 00:00 2024-04-25T01:55:46.361 INFO:teuthology.orchestra.run.smithi163.stdout:(28/152): ceph-grafana-dashboards-19.0.0-2445.g 768 kB/s | 32 kB 00:00 2024-04-25T01:55:46.411 INFO:teuthology.orchestra.run.smithi163.stdout:(29/152): ceph-mgr-cephadm-19.0.0-2445.gd2c45d9 2.8 MB/s | 141 kB 00:00 2024-04-25T01:55:46.669 INFO:teuthology.orchestra.run.smithi163.stdout:(30/152): rbd-mirror-19.0.0-2445.gd2c45d97.el9. 6.5 MB/s | 3.1 MB 00:00 2024-04-25T01:55:46.795 INFO:teuthology.orchestra.run.smithi163.stdout:(31/152): ceph-mgr-dashboard-19.0.0-2445.gd2c45 9.2 MB/s | 3.5 MB 00:00 2024-04-25T01:55:46.823 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-04-25T01:55:46.853 INFO:teuthology.orchestra.run.smithi163.stdout:(32/152): ceph-mgr-modules-core-19.0.0-2445.gd2 4.2 MB/s | 249 kB 00:00 2024-04-25T01:55:46.895 INFO:teuthology.orchestra.run.smithi163.stdout:(33/152): ceph-mgr-rook-19.0.0-2445.gd2c45d97.e 1.2 MB/s | 49 kB 00:00 2024-04-25T01:55:46.946 INFO:teuthology.orchestra.run.smithi163.stdout:(34/152): ceph-prometheus-alerts-19.0.0-2445.gd 307 kB/s | 15 kB 00:00 2024-04-25T01:55:46.967 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-04-25T01:55:46.967 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-04-25T01:55:47.004 INFO:teuthology.orchestra.run.smithi163.stdout:(35/152): ceph-volume-19.0.0-2445.gd2c45d97.el9 4.4 MB/s | 264 kB 00:00 2024-04-25T01:55:47.113 INFO:teuthology.orchestra.run.smithi163.stdout:(36/152): cephadm-19.0.0-2445.gd2c45d97.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-25T01:55:47.155 INFO:teuthology.orchestra.run.smithi163.stdout:(37/152): cephfs-top-19.0.0-2445.gd2c45d97.el9. 441 kB/s | 18 kB 00:00 2024-04-25T01:55:47.330 INFO:teuthology.orchestra.run.smithi163.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 460 kB/s | 80 kB 00:00 2024-04-25T01:55:47.555 INFO:teuthology.orchestra.run.smithi163.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-04-25T01:55:47.597 INFO:teuthology.orchestra.run.smithi163.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-25T01:55:47.664 INFO:teuthology.orchestra.run.smithi163.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-25T01:55:47.823 INFO:teuthology.orchestra.run.smithi163.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 732 kB/s | 195 kB 00:00 2024-04-25T01:55:47.890 INFO:teuthology.orchestra.run.smithi163.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-04-25T01:55:47.934 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-25T01:55:47.948 INFO:teuthology.orchestra.run.smithi163.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-04-25T01:55:47.974 INFO:teuthology.orchestra.run.smithi163.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-25T01:55:48.041 INFO:teuthology.orchestra.run.smithi163.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-25T01:55:48.066 INFO:teuthology.orchestra.run.smithi163.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-25T01:55:48.169 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-25T01:55:48.170 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-25T01:55:48.766 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-04-25T01:55:48.768 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-04-25T01:55:48.791 INFO:teuthology.orchestra.run.smithi163.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 918 kB/s | 689 kB 00:00 2024-04-25T01:55:48.891 INFO:teuthology.orchestra.run.smithi163.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-04-25T01:55:48.917 INFO:teuthology.orchestra.run.smithi163.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-04-25T01:55:49.009 INFO:teuthology.orchestra.run.smithi163.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 184 kB/s | 21 kB 00:00 2024-04-25T01:55:49.042 INFO:teuthology.orchestra.run.smithi163.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-04-25T01:55:49.126 INFO:teuthology.orchestra.run.smithi163.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-04-25T01:55:49.226 INFO:teuthology.orchestra.run.smithi163.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-04-25T01:55:49.360 INFO:teuthology.orchestra.run.smithi163.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2024-04-25T01:55:49.477 INFO:teuthology.orchestra.run.smithi163.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-04-25T01:55:49.502 INFO:teuthology.orchestra.run.smithi163.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-04-25T01:55:49.602 INFO:teuthology.orchestra.run.smithi163.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-04-25T01:55:49.719 INFO:teuthology.orchestra.run.smithi163.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-04-25T01:55:49.753 INFO:teuthology.orchestra.run.smithi163.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-04-25T01:55:49.820 INFO:teuthology.orchestra.run.smithi163.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-04-25T01:55:49.862 INFO:teuthology.orchestra.run.smithi163.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-04-25T01:55:49.929 INFO:teuthology.orchestra.run.smithi163.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-25T01:55:49.971 INFO:teuthology.orchestra.run.smithi163.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-25T01:55:50.029 INFO:teuthology.orchestra.run.smithi163.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-25T01:55:50.246 INFO:teuthology.orchestra.run.smithi163.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-25T01:55:50.388 INFO:teuthology.orchestra.run.smithi163.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T01:55:50.513 INFO:teuthology.orchestra.run.smithi163.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-04-25T01:55:50.580 INFO:teuthology.orchestra.run.smithi163.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-04-25T01:55:50.622 INFO:teuthology.orchestra.run.smithi163.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-25T01:55:50.747 INFO:teuthology.orchestra.run.smithi163.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-04-25T01:55:50.856 INFO:teuthology.orchestra.run.smithi163.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-04-25T01:55:51.000 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-25T01:55:51.000 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-25T01:55:51.106 INFO:teuthology.orchestra.run.smithi163.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-04-25T01:55:51.240 INFO:teuthology.orchestra.run.smithi163.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-25T01:55:51.349 INFO:teuthology.orchestra.run.smithi163.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-25T01:55:51.466 INFO:teuthology.orchestra.run.smithi163.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 680 kB/s | 244 kB 00:00 2024-04-25T01:55:51.491 INFO:teuthology.orchestra.run.smithi163.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-04-25T01:55:51.900 INFO:teuthology.orchestra.run.smithi163.stdout:(78/152): ceph-test-19.0.0-2445.gd2c45d97.el9.x 6.0 MB/s | 48 MB 00:08 2024-04-25T01:55:51.925 INFO:teuthology.orchestra.run.smithi163.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 42 kB/s | 19 kB 00:00 2024-04-25T01:55:51.950 INFO:teuthology.orchestra.run.smithi163.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 375 kB/s | 172 kB 00:00 2024-04-25T01:55:52.059 INFO:teuthology.orchestra.run.smithi163.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-25T01:55:52.167 INFO:teuthology.orchestra.run.smithi163.stdout:(82/152): python3-markupsafe-1.1.1-12.el9.x86_6 130 kB/s | 35 kB 00:00 2024-04-25T01:55:52.192 INFO:teuthology.orchestra.run.smithi163.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-04-25T01:55:52.301 INFO:teuthology.orchestra.run.smithi163.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-04-25T01:55:52.418 INFO:teuthology.orchestra.run.smithi163.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-04-25T01:55:52.443 INFO:teuthology.orchestra.run.smithi163.stdout:(86/152): python3-packaging-20.9-5.el9.noarch.r 280 kB/s | 77 kB 00:00 2024-04-25T01:55:52.526 INFO:teuthology.orchestra.run.smithi163.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-25T01:55:52.635 INFO:teuthology.orchestra.run.smithi163.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-04-25T01:55:52.744 INFO:teuthology.orchestra.run.smithi163.stdout:(89/152): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-04-25T01:55:52.786 INFO:teuthology.orchestra.run.smithi163.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 814 kB/s | 279 kB 00:00 2024-04-25T01:55:52.894 INFO:teuthology.orchestra.run.smithi163.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-04-25T01:55:52.995 INFO:teuthology.orchestra.run.smithi163.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-04-25T01:55:53.103 INFO:teuthology.orchestra.run.smithi163.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-25T01:55:53.203 INFO:teuthology.orchestra.run.smithi163.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-04-25T01:55:53.304 INFO:teuthology.orchestra.run.smithi163.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 475 kB/s | 47 kB 00:00 2024-04-25T01:55:53.412 INFO:teuthology.orchestra.run.smithi163.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-25T01:55:53.580 INFO:teuthology.orchestra.run.smithi163.stdout:(97/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-04-25T01:55:53.605 INFO:teuthology.orchestra.run.smithi163.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-04-25T01:55:53.680 INFO:teuthology.orchestra.run.smithi163.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 939 kB/s | 94 kB 00:00 2024-04-25T01:55:53.705 INFO:teuthology.orchestra.run.smithi163.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-04-25T01:55:53.780 INFO:teuthology.orchestra.run.smithi163.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-04-25T01:55:53.806 INFO:teuthology.orchestra.run.smithi163.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 356 kB/s | 45 kB 00:00 2024-04-25T01:55:53.906 INFO:teuthology.orchestra.run.smithi163.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-04-25T01:55:53.964 INFO:teuthology.orchestra.run.smithi163.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 3.4 MB/s | 548 kB 00:00 2024-04-25T01:55:54.007 INFO:teuthology.orchestra.run.smithi163.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 464 kB/s | 19 kB 00:00 2024-04-25T01:55:54.107 INFO:teuthology.orchestra.run.smithi163.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-04-25T01:55:54.149 INFO:teuthology.orchestra.run.smithi163.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-04-25T01:55:54.182 INFO:teuthology.orchestra.run.smithi163.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-04-25T01:55:54.233 INFO:teuthology.orchestra.run.smithi163.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-25T01:55:54.292 INFO:teuthology.orchestra.run.smithi163.stdout:(110/152): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-25T01:55:54.317 INFO:teuthology.orchestra.run.smithi163.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-25T01:55:54.375 INFO:teuthology.orchestra.run.smithi163.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-04-25T01:55:54.426 INFO:teuthology.orchestra.run.smithi163.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 874 kB/s | 43 kB 00:00 2024-04-25T01:55:54.459 INFO:teuthology.orchestra.run.smithi163.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 966 kB/s | 32 kB 00:00 2024-04-25T01:55:54.501 INFO:teuthology.orchestra.run.smithi163.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 359 kB/s | 15 kB 00:00 2024-04-25T01:55:54.526 INFO:teuthology.orchestra.run.smithi163.stdout:(116/152): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-25T01:55:54.552 INFO:teuthology.orchestra.run.smithi163.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-25T01:55:54.593 INFO:teuthology.orchestra.run.smithi163.stdout:(118/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.2 MB/s | 303 kB 00:00 2024-04-25T01:55:54.635 INFO:teuthology.orchestra.run.smithi163.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 848 kB/s | 35 kB 00:00 2024-04-25T01:55:54.661 INFO:teuthology.orchestra.run.smithi163.stdout:(120/152): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-04-25T01:55:54.686 INFO:teuthology.orchestra.run.smithi163.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-04-25T01:55:54.728 INFO:teuthology.orchestra.run.smithi163.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-04-25T01:55:54.770 INFO:teuthology.orchestra.run.smithi163.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-04-25T01:55:54.775 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-04-25T01:55:54.820 INFO:teuthology.orchestra.run.smithi163.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-04-25T01:55:54.851 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T01:55:54.862 INFO:teuthology.orchestra.run.smithi163.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 555 kB/s | 23 kB 00:00 2024-04-25T01:55:54.897 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T01:55:54.912 INFO:teuthology.orchestra.run.smithi163.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-04-25T01:55:54.963 INFO:teuthology.orchestra.run.smithi163.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 395 kB/s | 20 kB 00:00 2024-04-25T01:55:54.967 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T01:55:55.001 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T01:55:55.027 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T01:55:55.063 INFO:teuthology.orchestra.run.smithi163.stdout:(128/152): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-25T01:55:55.070 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T01:55:55.121 INFO:teuthology.orchestra.run.smithi163.stdout:(129/152): python3-numpy-1.20.1-5.el9.x86_64.rp 1.6 MB/s | 5.1 MB 00:03 2024-04-25T01:55:55.147 INFO:teuthology.orchestra.run.smithi163.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 555 kB/s | 46 kB 00:00 2024-04-25T01:55:55.205 INFO:teuthology.orchestra.run.smithi163.stdout:(131/152): python3-natsort-7.1.1-5.el9.noarch.r 995 kB/s | 58 kB 00:00 2024-04-25T01:55:55.264 INFO:teuthology.orchestra.run.smithi163.stdout:(132/152): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-04-25T01:55:55.373 INFO:teuthology.orchestra.run.smithi163.stdout:(133/152): python3-more-itertools-8.12.0-2.el9. 314 kB/s | 79 kB 00:00 2024-04-25T01:55:55.443 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T01:55:55.473 INFO:teuthology.orchestra.run.smithi163.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 78 kB/s | 16 kB 00:00 2024-04-25T01:55:55.511 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:55:55.532 INFO:teuthology.orchestra.run.smithi163.stdout:(135/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-25T01:55:55.557 INFO:teuthology.orchestra.run.smithi163.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 338 kB/s | 28 kB 00:00 2024-04-25T01:55:55.582 INFO:teuthology.orchestra.run.smithi163.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 430 kB/s | 90 kB 00:00 2024-04-25T01:55:55.608 INFO:teuthology.orchestra.run.smithi163.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T01:55:55.623 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:55:55.633 INFO:teuthology.orchestra.run.smithi163.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-25T01:55:55.658 INFO:teuthology.orchestra.run.smithi163.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-04-25T01:55:55.662 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:55:55.683 INFO:teuthology.orchestra.run.smithi163.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-25T01:55:55.700 INFO:teuthology.orchestra.run.smithi163.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 764 kB/s | 51 kB 00:00 2024-04-25T01:55:55.736 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:55:55.750 INFO:teuthology.orchestra.run.smithi163.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-25T01:55:55.766 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:55:55.776 INFO:teuthology.orchestra.run.smithi163.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-25T01:55:55.793 INFO:teuthology.orchestra.run.smithi163.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-04-25T01:55:55.851 INFO:teuthology.orchestra.run.smithi163.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-04-25T01:55:55.876 INFO:teuthology.orchestra.run.smithi163.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T01:55:55.911 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T01:55:55.918 INFO:teuthology.orchestra.run.smithi163.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T01:55:55.955 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T01:55:55.983 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:55:56.086 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:55:56.109 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:55:56.154 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:55:56.176 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:55:56.201 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:55:56.260 INFO:teuthology.orchestra.run.smithi163.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.0 MB/s | 1.3 MB 00:00 2024-04-25T01:55:56.393 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:55:56.426 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:55:56.535 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T01:55:56.569 INFO:teuthology.orchestra.run.smithi163.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-04-25T01:55:56.630 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T01:55:56.668 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T01:55:56.710 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T01:55:56.793 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T01:55:56.825 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T01:55:56.869 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T01:55:56.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T01:55:56.903 INFO:teuthology.orchestra.run.smithi163.stdout:(151/152): librbd1-19.0.0-2445.gd2c45d97.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-04-25T01:55:56.938 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T01:55:56.962 INFO:teuthology.orchestra.run.smithi163.stdout:(152/152): librados2-19.0.0-2445.gd2c45d97.el9. 3.0 MB/s | 3.4 MB 00:01 2024-04-25T01:55:56.965 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:55:56.965 INFO:teuthology.orchestra.run.smithi163.stdout:Total 12 MB/s | 220 MB 00:19 2024-04-25T01:55:57.005 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T01:55:57.059 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T01:55:57.091 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T01:55:57.125 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T01:55:57.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T01:55:57.237 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T01:55:57.280 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T01:55:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-25T01:55:57.308 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T01:55:57.376 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T01:55:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T01:55:57.423 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T01:55:57.498 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T01:55:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T01:55:57.635 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T01:55:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T01:55:57.691 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T01:55:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T01:55:57.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T01:55:57.923 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T01:55:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-25T01:55:58.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T01:55:58.258 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-25T01:55:58.258 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-25T01:55:58.287 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T01:55:58.333 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T01:55:58.358 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T01:55:58.376 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T01:55:58.414 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T01:55:58.452 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:55:58.455 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T01:55:58.607 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T01:55:58.658 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T01:55:58.658 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:55:58.703 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:55:58.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T01:55:58.776 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T01:55:58.809 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T01:55:58.834 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:55:58.845 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T01:55:58.886 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:55:58.891 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T01:55:58.928 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T01:55:58.971 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T01:55:59.013 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T01:55:59.148 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T01:55:59.193 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T01:55:59.223 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T01:55:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T01:55:59.264 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T01:55:59.357 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T01:55:59.383 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T01:55:59.398 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T01:55:59.438 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T01:55:59.464 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T01:55:59.489 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T01:55:59.516 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:55:59.562 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T01:55:59.680 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T01:55:59.700 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:55:59.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T01:55:59.725 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:55:59.740 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T01:55:59.774 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T01:55:59.797 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:55:59.813 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T01:55:59.826 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:55:59.845 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T01:55:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T01:55:59.891 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:55:59.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T01:55:59.943 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T01:55:59.984 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T01:56:00.019 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T01:56:00.028 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-25T01:56:00.029 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-25T01:56:00.104 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T01:56:00.148 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T01:56:00.180 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T01:56:00.187 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:56:00.227 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T01:56:00.245 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:56:00.325 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T01:56:00.381 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T01:56:00.442 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T01:56:00.567 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T01:56:00.604 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T01:56:00.651 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T01:56:00.753 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T01:56:00.799 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T01:56:00.859 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T01:56:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T01:56:00.943 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T01:56:01.058 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T01:56:01.089 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T01:56:01.124 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T01:56:01.129 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T01:56:01.162 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T01:56:01.163 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T01:56:01.222 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T01:56:01.260 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T01:56:01.303 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T01:56:01.338 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T01:56:01.373 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T01:56:01.389 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T01:56:01.422 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T01:56:01.423 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T01:56:01.455 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T01:56:01.544 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T01:56:01.599 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T01:56:01.608 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T01:56:01.637 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T01:56:01.703 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T01:56:01.715 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T01:56:01.880 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T01:56:01.945 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T01:56:02.348 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T01:56:02.472 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T01:56:02.632 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T01:56:02.734 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T01:56:02.770 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T01:56:02.815 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T01:56:02.856 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T01:56:02.916 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T01:56:03.135 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T01:56:03.213 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T01:56:03.311 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T01:56:03.406 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T01:56:03.449 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T01:56:03.512 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T01:56:03.582 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T01:56:03.628 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T01:56:03.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T01:56:03.691 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T01:56:03.757 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T01:56:03.774 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T01:56:03.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T01:56:03.834 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T01:56:03.946 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T01:56:03.991 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T01:56:04.028 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T01:56:04.067 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T01:56:04.138 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T01:56:04.189 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:04.191 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T01:56:04.229 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T01:56:04.279 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T01:56:04.280 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:04.310 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T01:56:04.320 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T01:56:04.346 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T01:56:04.352 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T01:56:04.544 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T01:56:04.712 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T01:56:04.750 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T01:56:04.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T01:56:04.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T01:56:04.823 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T01:56:04.842 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:04.881 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T01:56:04.913 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:04.936 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T01:56:04.943 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T01:56:04.978 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T01:56:05.024 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T01:56:05.074 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T01:56:05.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T01:56:05.199 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T01:56:05.340 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T01:56:05.405 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T01:56:05.456 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T01:56:05.527 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T01:56:05.671 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T01:56:05.733 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T01:56:05.987 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-25T01:56:06.081 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T01:56:06.120 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T01:56:06.199 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T01:56:06.232 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T01:56:06.266 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T01:56:06.309 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T01:56:06.635 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T01:56:06.644 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T01:56:06.693 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T01:56:06.726 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T01:56:06.759 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:56:06.843 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T01:56:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:56:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:56:06.921 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T01:56:07.001 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:56:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T01:56:07.030 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:56:07.053 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T01:56:07.182 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T01:56:07.227 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T01:56:07.249 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:07.264 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:56:07.271 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T01:56:07.290 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:07.300 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T01:56:07.367 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:56:07.390 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:56:07.414 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T01:56:07.436 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 14/156 2024-04-25T01:56:07.457 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:56:07.482 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T01:56:07.633 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:56:07.665 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T01:56:07.773 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T01:56:07.831 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:07.869 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T01:56:07.885 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:07.905 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T01:56:07.940 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T01:56:07.972 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:07.972 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:56:07.972 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:56:07.972 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:08.002 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:08.005 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T01:56:08.047 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T01:56:08.091 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T01:56:08.124 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T01:56:08.153 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T01:56:08.222 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T01:56:08.273 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T01:56:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T01:56:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T01:56:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T01:56:08.416 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T01:56:08.422 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T01:56:08.451 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 31/156 2024-04-25T01:56:08.495 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 32/156 2024-04-25T01:56:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 33/156 2024-04-25T01:56:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T01:56:08.638 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T01:56:08.712 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T01:56:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T01:56:08.907 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T01:56:09.438 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T01:56:09.528 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T01:56:09.556 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T01:56:09.599 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T01:56:09.637 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 43/156 2024-04-25T01:56:09.679 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T01:56:09.844 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T01:56:09.899 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T01:56:09.953 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T01:56:10.027 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T01:56:10.054 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T01:56:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T01:56:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T01:56:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T01:56:10.165 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T01:56:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T01:56:10.218 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T01:56:10.219 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T01:56:10.261 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T01:56:10.262 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T01:56:10.398 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T01:56:10.442 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T01:56:10.473 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T01:56:10.514 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T01:56:10.610 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T01:56:10.648 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T01:56:10.648 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T01:56:10.688 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T01:56:10.693 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:10.713 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T01:56:10.738 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T01:56:10.813 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T01:56:10.849 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:10.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T01:56:10.943 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T01:56:10.948 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T01:56:10.978 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T01:56:11.006 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T01:56:11.040 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T01:56:11.080 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T01:56:11.112 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T01:56:11.141 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T01:56:11.176 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T01:56:11.209 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T01:56:11.250 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T01:56:11.286 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T01:56:11.372 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T01:56:11.416 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T01:56:11.447 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T01:56:11.478 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T01:56:11.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T01:56:11.513 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:11.593 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T01:56:11.639 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:11.648 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T01:56:11.665 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T01:56:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T01:56:12.429 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T01:56:12.462 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T01:56:12.563 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T01:56:12.621 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T01:56:12.709 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T01:56:12.739 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T01:56:12.917 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T01:56:12.954 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T01:56:13.033 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T01:56:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T01:56:13.811 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T01:56:14.392 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:14.428 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:15.053 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T01:56:15.107 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:15.141 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T01:56:15.148 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:15.168 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T01:56:15.202 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T01:56:15.362 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:15.363 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:56:15.363 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:56:15.363 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:15.390 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T01:56:15.549 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:15.639 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 99/156 2024-04-25T01:56:15.670 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 100/156 2024-04-25T01:56:15.706 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T01:56:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T01:56:16.210 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:16.281 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 103/156 2024-04-25T01:56:16.311 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 104/156 2024-04-25T01:56:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:19.111 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:19.111 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-04-25T01:56:19.111 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-04-25T01:56:19.111 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-04-25T01:56:19.111 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-04-25T01:56:19.112 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-04-25T01:56:19.112 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-04-25T01:56:19.112 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-04-25T01:56:19.112 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 105/156 2024-04-25T01:56:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 106/156 2024-04-25T01:56:19.251 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T01:56:19.251 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T01:56:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:19.271 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:19.287 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:19.287 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:19.287 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T01:56:19.287 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:20.774 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:20.800 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:21.047 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:21.048 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:21.048 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:56:21.048 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:21.048 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:21.048 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:21.492 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:21.514 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:21.515 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:21.515 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:56:21.515 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:21.515 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:21.515 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:21.614 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T01:56:21.661 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T01:56:21.718 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T01:56:21.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T01:56:21.942 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T01:56:22.012 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T01:56:22.100 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:22.238 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:22.275 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T01:56:22.307 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T01:56:22.335 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T01:56:22.742 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:22.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:22.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T01:56:22.867 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T01:56:22.923 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:23.983 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:24.949 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:24.975 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:25.077 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:25.245 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T01:56:25.277 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:25.300 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:25.344 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:25.356 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:25.453 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T01:56:25.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T01:56:26.394 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T01:56:26.431 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:26.453 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:26.453 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:26.454 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:56:26.454 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:26.454 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:26.454 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:26.497 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:26.519 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:26.520 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:26.520 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:56:26.520 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:26.565 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:26.588 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:26.588 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:26.588 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T01:56:26.589 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:26.589 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:26.589 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:26.899 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:26.922 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:28.066 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-04-25T01:56:28.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:28.295 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:28.344 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:28.344 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T01:56:28.344 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:30.006 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:30.084 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:30.084 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:30.085 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:56:30.085 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:30.085 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:30.085 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:30.323 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:30.389 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:30.779 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 107/156 2024-04-25T01:56:30.779 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-04-25T01:56:30.779 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-04-25T01:56:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:30.874 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:30.940 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:30.940 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:30.941 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:56:30.941 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:30.941 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:30.941 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:30.941 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:30.955 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 108/156 2024-04-25T01:56:30.956 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:30.956 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T01:56:30.956 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:31.074 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T01:56:31.136 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T01:56:31.211 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T01:56:31.419 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T01:56:31.445 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T01:56:31.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T01:56:31.510 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T01:56:31.511 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T01:56:31.542 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T01:56:31.569 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T01:56:31.597 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T01:56:31.706 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:31.750 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T01:56:31.798 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T01:56:31.828 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T01:56:31.874 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:31.929 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T01:56:31.976 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T01:56:32.009 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T01:56:32.432 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:32.435 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:32.460 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 109/156 2024-04-25T01:56:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T01:56:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:32.460 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T01:56:32.461 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:32.467 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:32.487 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:32.619 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:32.654 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:32.685 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:32.707 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 110/156 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T01:56:32.708 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:32.820 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T01:56:32.857 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:33.166 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 111/156 2024-04-25T01:56:33.166 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:33.167 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T01:56:33.167 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:33.167 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T01:56:33.167 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:33.283 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T01:56:33.313 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T01:56:33.340 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T01:56:33.395 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T01:56:33.404 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T01:56:33.446 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T01:56:33.528 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T01:56:33.559 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T01:56:33.559 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:33.599 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T01:56:33.634 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:33.653 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T01:56:33.667 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:33.668 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:33.731 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T01:56:33.742 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:33.807 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:33.820 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T01:56:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T01:56:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T01:56:34.115 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:34.158 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:34.462 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:34.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 123/156 2024-04-25T01:56:34.526 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 124/156 2024-04-25T01:56:34.589 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 125/156 2024-04-25T01:56:34.618 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:35.263 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:35.300 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:35.448 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:35.629 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T01:56:35.660 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:35.661 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 126/156 2024-04-25T01:56:35.702 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:35.731 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:35.786 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:35.823 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:35.964 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T01:56:36.041 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T01:56:36.662 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 127/156 2024-04-25T01:56:36.717 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:36.819 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 128/156 2024-04-25T01:56:36.982 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 129/156 2024-04-25T01:56:37.013 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:37.025 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 130/156 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T01:56:37.036 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:37.064 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:37.081 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:37.092 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 131/156 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:37.130 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:37.181 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:37.188 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 132/156 2024-04-25T01:56:37.237 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 133/156 2024-04-25T01:56:37.248 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:37.248 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:37.249 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:56:37.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:37.323 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:37.398 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T01:56:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:37.399 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:37.399 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:37.774 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:37.845 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:37.845 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:37.845 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:56:37.845 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:37.846 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:37.846 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T01:56:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 135/156 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T01:56:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:38.234 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:38.255 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 136/156 2024-04-25T01:56:38.255 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:38.255 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T01:56:38.255 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:38.301 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 137/156 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T01:56:38.323 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:38.626 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 138/156 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T01:56:38.649 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:39.423 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:56:39.424 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T01:56:39.425 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T01:56:39.426 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T01:56:39.438 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T01:56:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T01:56:39.440 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T01:56:39.441 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T01:56:39.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T01:56:39.443 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T01:56:39.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T01:56:39.445 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T01:56:39.446 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:39.447 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T01:56:41.591 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T01:56:41.592 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.593 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T01:56:41.594 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:56:41.595 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T01:56:41.596 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T01:56:41.597 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T01:56:41.598 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:56:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:56:41.600 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T01:56:41.602 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T01:56:41.603 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:56:41.604 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T01:56:41.604 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T01:56:41.604 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-04-25T01:56:42.035 DEBUG:teuthology.parallel:result is None 2024-04-25T01:56:42.821 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T01:56:42.866 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T01:56:42.967 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T01:56:43.010 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T01:56:43.059 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T01:56:43.189 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 139/156 2024-04-25T01:56:43.230 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 140/156 2024-04-25T01:56:43.271 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 141/156 2024-04-25T01:56:43.319 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T01:56:43.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T01:56:43.393 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T01:56:43.442 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T01:56:43.470 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T01:56:43.527 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 144/156 2024-04-25T01:56:43.576 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T01:56:43.614 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 146/156 2024-04-25T01:56:44.248 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:44.306 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:44.360 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:44.410 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:44.466 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T01:56:45.162 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T01:56:45.252 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T01:56:45.293 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T01:56:45.376 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T01:56:45.414 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T01:56:45.414 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:45.498 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:45.531 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:45.531 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:45.617 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:45.696 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:45.768 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 148/156 2024-04-25T01:56:45.867 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T01:56:45.935 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T01:56:46.093 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T01:56:46.156 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T01:56:46.156 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:46.282 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T01:56:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:46.322 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:46.462 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T01:56:46.565 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:46.819 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:46.820 INFO:teuthology.orchestra.run.smithi137.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-25T01:56:46.820 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T01:56:51.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:56:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T01:56:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T01:56:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T01:56:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T01:56:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T01:56:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T01:56:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T01:56:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T01:56:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T01:56:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T01:56:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T01:56:52.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 1/156 2024-04-25T01:56:52.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2/156 2024-04-25T01:56:52.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 3/156 2024-04-25T01:56:52.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 4/156 2024-04-25T01:56:52.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2445.gd2c45 5/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 6/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 7/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 8/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 9/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 10/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 11/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 12/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 13/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 14/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_ 15/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 16/156 2024-04-25T01:56:52.605 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 17/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_6 18/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86 19/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 20/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el 21/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9. 22/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_6 23/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 24/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 25/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 26/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 27/156 2024-04-25T01:56:52.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 28/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 29/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97. 30/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noa 31/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.n 32/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c 33/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el 34/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 35/156 2024-04-25T01:56:52.619 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.e 36/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 37/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 38/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 39/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T01:56:52.620 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T01:56:52.621 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T01:56:52.622 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T01:56:52.623 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T01:56:52.624 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T01:56:52.625 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T01:56:52.626 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 149/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 151/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T01:56:52.627 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:53.745 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.746 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T01:56:53.747 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:56:53.748 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T01:56:53.749 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:56:53.750 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T01:56:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:53.752 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.753 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:56:53.754 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T01:56:53.755 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:56:53.756 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T01:56:53.756 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-25T01:56:53.756 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-25T01:56:54.139 DEBUG:teuthology.parallel:result is None 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-25T01:56:55.025 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.026 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.0.0-2445.gd2c45d97.el9.noarch 2024-04-25T01:56:55.027 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.028 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T01:56:55.029 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T01:56:55.030 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T01:56:55.031 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T01:56:55.032 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T01:56:55.033 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T01:56:55.034 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.0.0-2445.gd2c45d97.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T01:56:55.035 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T01:56:55.036 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T01:56:55.036 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T01:56:55.036 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:56:55.036 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-25T01:56:55.634 DEBUG:teuthology.parallel:result is None 2024-04-25T01:56:55.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:55.784 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:56:55.840 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:55.840 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:55.840 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T01:56:55.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:55.986 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:56:56.008 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:56.008 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:56.008 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T01:56:56.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:56.163 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T01:56:56.189 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:56.189 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445.gd2c45d97.el9 2024-04-25T01:56:56.189 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445.gd2c45d97 is installed. 2024-04-25T01:56:56.191 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T01:56:56.191 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:56:56.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:56:56.261 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:56:56.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:56:56.287 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:56:56.287 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T01:56:56.318 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T01:56:56.318 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:56:56.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:56:56.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:56:56.516 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:56:56.516 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:56:56.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:56:56.605 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:56:56.605 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T01:56:56.630 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T01:56:56.693 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T01:56:56.693 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:56:56.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:56:56.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:56:56.873 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:56:56.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:56:56.897 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:56:56.961 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:56:56.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T01:56:56.985 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T01:56:57.048 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T01:56:57.048 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:56:57.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:56:57.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:56:57.220 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:56:57.220 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:56:57.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:56:57.309 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:56:57.309 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T01:56:57.332 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T01:56:57.395 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T01:56:57.507 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-25T01:56:57.507 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:57.507 INFO:tasks.cephadm:Cluster fsid is 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:56:57.507 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T01:56:57.508 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.137', 'mon.b': '172.21.15.163', 'mon.c': '172.21.15.174'} 2024-04-25T01:56:57.508 INFO:tasks.cephadm:First mon is mon.a on smithi137 2024-04-25T01:56:57.508 INFO:tasks.cephadm:First mgr is x 2024-04-25T01:56:57.508 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T01:56:57.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2024-04-25T01:56:57.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname $(hostname -s) 2024-04-25T01:56:57.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-04-25T01:56:57.620 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-25T01:56:57.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:57.878 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/54987/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2445-gd2c45d97', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2445.gd2c45d97'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-24 22:37:46.422067', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/54981/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2445-gd2c45d97', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2445.gd2c45d97'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-24 17:00:00.872117', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-25T01:56:58.018 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 d2c45d977142e024a59b68a8f1dce8f0b9840551 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:56:58.019 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/x86_64/flavors/default/cephadm 2024-04-25T01:56:58.021 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:58.457 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-r--r--. 1 ubuntu ubuntu 781409 Apr 25 01:56 /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:58.458 DEBUG:teuthology.orchestra.run.smithi163:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.127 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-r--r--. 1 ubuntu ubuntu 781409 Apr 25 01:56 /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.127 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.713 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 781409 Apr 25 01:56 /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.713 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.757 DEBUG:teuthology.orchestra.run.smithi163:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.776 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T01:56:59.811 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 on all hosts... 2024-04-25T01:56:59.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 pull 2024-04-25T01:56:59.815 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 pull 2024-04-25T01:56:59.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 pull 2024-04-25T01:57:01.378 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551... 2024-04-25T01:57:01.482 INFO:teuthology.orchestra.run.smithi163.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551... 2024-04-25T01:57:02.053 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551... 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout: "image_id": "f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e", 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout: "repo_digests": [ 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901" 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-04-25T01:57:34.910 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e", 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901" 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-04-25T01:57:52.958 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e", 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901" 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T01:58:00.266 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T01:58:00.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2024-04-25T01:58:00.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph 2024-04-25T01:58:00.453 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-04-25T01:58:00.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2024-04-25T01:58:00.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /etc/ceph 2024-04-25T01:58:00.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-04-25T01:58:00.629 INFO:tasks.cephadm:Writing seed config... 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-25T01:58:00.630 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T01:58:00.631 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-25T01:58:00.632 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-25T01:58:00.633 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-25T01:58:00.634 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:58:00.634 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T01:58:00.691 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 19106f5e-02a7-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T01:58:00.692 DEBUG:teuthology.orchestra.run.smithi137:mon.a> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service 2024-04-25T01:58:00.739 DEBUG:teuthology.orchestra.run.smithi137:mgr.x> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x.service 2024-04-25T01:58:00.788 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T01:58:00.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 -v bootstrap --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.137 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T01:58:01.054 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-25T01:58:01.054 INFO:teuthology.orchestra.run.smithi137.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551', '-v', 'bootstrap', '--fsid', '19106f5e-02a7-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.137', '--skip-admin-label'] 2024-04-25T01:58:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T01:58:01.055 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying podman|docker is present... 2024-04-25T01:58:01.112 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T01:58:01.112 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying lvm2 is present... 2024-04-25T01:58:01.112 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying time synchronization is in place... 2024-04-25T01:58:01.128 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T01:58:01.128 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T01:58:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T01:58:01.142 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:58:01.163 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout enabled 2024-04-25T01:58:01.184 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout active 2024-04-25T01:58:01.184 INFO:teuthology.orchestra.run.smithi137.stdout:Unit chronyd.service is enabled and running 2024-04-25T01:58:01.185 INFO:teuthology.orchestra.run.smithi137.stdout:Repeating the final host check... 2024-04-25T01:58:01.244 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T01:58:01.244 INFO:teuthology.orchestra.run.smithi137.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T01:58:01.244 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl is present 2024-04-25T01:58:01.245 INFO:teuthology.orchestra.run.smithi137.stdout:lvcreate is present 2024-04-25T01:58:01.258 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T01:58:01.258 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T01:58:01.274 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T01:58:01.275 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:58:01.293 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout enabled 2024-04-25T01:58:01.309 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout active 2024-04-25T01:58:01.309 INFO:teuthology.orchestra.run.smithi137.stdout:Unit chronyd.service is enabled and running 2024-04-25T01:58:01.310 INFO:teuthology.orchestra.run.smithi137.stdout:Host looks OK 2024-04-25T01:58:01.310 INFO:teuthology.orchestra.run.smithi137.stdout:Cluster fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:01.310 INFO:teuthology.orchestra.run.smithi137.stdout:Acquiring lock 140401818002336 on /run/cephadm/19106f5e-02a7-11ef-bc93-c7b262605968.lock 2024-04-25T01:58:01.310 INFO:teuthology.orchestra.run.smithi137.stdout:Lock 140401818002336 acquired on /run/cephadm/19106f5e-02a7-11ef-bc93-c7b262605968.lock 2024-04-25T01:58:01.310 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying IP 172.21.15.137 port 3300 ... 2024-04-25T01:58:01.311 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying IP 172.21.15.137 port 6789 ... 2024-04-25T01:58:01.311 INFO:teuthology.orchestra.run.smithi137.stdout:Base mon IP(s) is [172.21.15.137:3300, 172.21.15.137:6789], mon addrv is [v2:172.21.15.137:3300,v1:172.21.15.137:6789] 2024-04-25T01:58:01.320 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.137 metric 100 2024-04-25T01:58:01.320 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.137 metric 100 2024-04-25T01:58:01.326 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T01:58:01.327 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-25T01:58:01.327 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-04-25T01:58:01.334 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T01:58:01.334 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T01:58:01.334 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T01:58:01.334 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-25T01:58:01.334 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-25T01:58:01.335 INFO:teuthology.orchestra.run.smithi137.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T01:58:01.335 INFO:teuthology.orchestra.run.smithi137.stdout:Mon IP `172.21.15.137` is in CIDR network `172.21.0.0/20` 2024-04-25T01:58:01.335 INFO:teuthology.orchestra.run.smithi137.stdout:Mon IP `172.21.15.137` is in CIDR network `172.21.0.0/20` 2024-04-25T01:58:01.335 INFO:teuthology.orchestra.run.smithi137.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T01:58:01.336 INFO:teuthology.orchestra.run.smithi137.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T01:58:01.338 INFO:teuthology.orchestra.run.smithi137.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551... 2024-04-25T01:58:02.018 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stdout f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551... 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying blob sha256:58a99251f41e8a467bafa0ec849428709568906ca732f10972304f37056be6c5 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Copying config sha256:f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e 2024-04-25T01:58:02.019 INFO:teuthology.orchestra.run.smithi137.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T01:58:03.282 INFO:teuthology.orchestra.run.smithi137.stdout:ceph: stdout ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev) 2024-04-25T01:58:03.282 INFO:teuthology.orchestra.run.smithi137.stdout:Ceph version: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev) 2024-04-25T01:58:03.283 INFO:teuthology.orchestra.run.smithi137.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T01:58:04.379 INFO:teuthology.orchestra.run.smithi137.stdout:stat: stdout 167 167 2024-04-25T01:58:04.379 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial keys... 2024-04-25T01:58:05.478 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQCsuClmuQkbMhAAIye9gRExRgDrb49B2i6F9w== 2024-04-25T01:58:06.661 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQCtuClmLGaSOhAAb4S28IcfIvrdAJor3HbOng== 2024-04-25T01:58:08.334 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph-authtool: stdout AQCvuClmAqoBCRAAJrHYLRYgcK1EZ6gUrWjyJg== 2024-04-25T01:58:08.336 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial monmap... 2024-04-25T01:58:09.500 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T01:58:09.500 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-25T01:58:09.500 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:09.500 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool for a [v2:172.21.15.137:3300,v1:172.21.15.137:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = quincy 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: set fsid to 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:58:09.501 INFO:teuthology.orchestra.run.smithi137.stdout:Creating mon... 2024-04-25T01:58:10.780 INFO:teuthology.orchestra.run.smithi137.stdout:create mon.a on 2024-04-25T01:58:11.175 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T01:58:11.419 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T01:58:11.732 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target. 2024-04-25T01:58:11.732 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target. 2024-04-25T01:58:12.083 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a 2024-04-25T01:58:12.083 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-25T01:58:12.392 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target.wants/ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968@.service. 2024-04-25T01:58:13.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:12 smithi137 podman[27921]: 2024-04-25 01:58:12.688287108 +0000 UTC m=+0.031147876 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:58:18.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:18 smithi137 podman[27921]: 2024-04-25 01:58:18.013914792 +0000 UTC m=+5.356775597 container create ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T01:58:20.268 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:58:20.268 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-04-25T01:58:20.282 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:58:20.282 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:58:20.283 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-04-25T01:58:20.283 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T01:58:20.283 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mon to start... 2024-04-25T01:58:20.283 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mon... 2024-04-25T01:58:20.433 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 podman[27921]: 2024-04-25 01:58:20.146223168 +0000 UTC m=+7.489083980 container init ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T01:58:20.433 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 podman[27921]: 2024-04-25 01:58:20.156773379 +0000 UTC m=+7.499634165 container start ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T01:58:20.434 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 bash[27921]: ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d 2024-04-25T01:58:20.434 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 ceph-mon[27939]: mkfs 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:20.434 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 ceph-mon[27939]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T01:58:20.434 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:20 smithi137 systemd[1]: Started Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:58:21.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T01:58:21.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: monmap epoch 1 2024-04-25T01:58:21.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: last_changed 2024-04-25T01:58:08.818093+0000 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: min_mon_release 19 (squid) 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: election_strategy: 1 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T01:58:21.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: fsmap 2024-04-25T01:58:21.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T01:58:21.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: mgrmap e1: no daemons active 2024-04-25T01:58:21.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:21 smithi137 ceph-mon[27939]: from='client.? 172.21.15.137:0/3782434538' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-25T01:58:21.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T01:58:21.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout id: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:21.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T01:58:21.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout services: 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.730969s) 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout data: 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.870+0000 7fcfcd000700 1 Processor -- start 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.870+0000 7fcfcd000700 1 -- start start 2024-04-25T01:58:21.648 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.871+0000 7fcfcd000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.871+0000 7fcfcd000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc810abf0 con 0x7fcfc810a200 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.872+0000 7fcfc5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.872+0000 7fcfc5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34832/0 (socket says 172.21.15.137:34832) 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.872+0000 7fcfc5e00700 1 -- 172.21.15.137:0/2928421013 learned_addr learned my addr 172.21.15.137:0/2928421013 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.872+0000 7fcfc5e00700 1 -- 172.21.15.137:0/2928421013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc810b400 con 0x7fcfc810a200 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.873+0000 7fcfc5e00700 1 --2- 172.21.15.137:0/2928421013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80098a0 tx=0x7fcfb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9afe1a8ed5425a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.873+0000 7fcfc4a00700 1 -- 172.21.15.137:0/2928421013 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb8004160 con 0x7fcfc810a200 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.873+0000 7fcfc4a00700 1 -- 172.21.15.137:0/2928421013 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8004300 con 0x7fcfc810a200 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.873+0000 7fcfc4a00700 1 -- 172.21.15.137:0/2928421013 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb80036a0 con 0x7fcfc810a200 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 -- 172.21.15.137:0/2928421013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 msgr2=0x7fcfc810a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 --2- 172.21.15.137:0/2928421013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80098a0 tx=0x7fcfb8009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:21.649 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 -- 172.21.15.137:0/2928421013 shutdown_connections 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 --2- 172.21.15.137:0/2928421013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc810a620 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 -- 172.21.15.137:0/2928421013 >> 172.21.15.137:0/2928421013 conn(0x7fcfc8105760 msgr2=0x7fcfc8107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 -- 172.21.15.137:0/2928421013 shutdown_connections 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.874+0000 7fcfcd000700 1 -- 172.21.15.137:0/2928421013 wait complete. 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.875+0000 7fcfcd000700 1 Processor -- start 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.875+0000 7fcfcd000700 1 -- start start 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfcd000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfcd000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc810b930 con 0x7fcfc810a200 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfc5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfc5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34836/0 (socket says 172.21.15.137:34836) 2024-04-25T01:58:21.650 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfc5e00700 1 -- 172.21.15.137:0/3782434538 learned_addr learned my addr 172.21.15.137:0/3782434538 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfc5e00700 1 -- 172.21.15.137:0/3782434538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc819de60 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.876+0000 7fcfc5e00700 1 --2- 172.21.15.137:0/3782434538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000c00 tx=0x7fcfb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb8003db0 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8011630 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc819e0f0 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfb8011950 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc81a0d90 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfb8011af0 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.877+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcfb801c450 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.878+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8063890 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.881+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcfb8032020 con 0x7fcfc810a200 2024-04-25T01:58:21.651 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.961+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fcfc802dcb0 con 0x7fcfc810a200 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.961+0000 7fcfbea00700 1 -- 172.21.15.137:0/3782434538 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fcfb8004260 con 0x7fcfc810a200 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 msgr2=0x7fcfc819d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 --2- 172.21.15.137:0/3782434538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000c00 tx=0x7fcfb8004750 comp rx=0 tx=0).stop 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 shutdown_connections 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 --2- 172.21.15.137:0/3782434538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfc810a200 0x7fcfc819d920 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 >> 172.21.15.137:0/3782434538 conn(0x7fcfc8105760 msgr2=0x7fcfc8194560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 shutdown_connections 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:20.963+0000 7fcfcd000700 1 -- 172.21.15.137:0/3782434538 wait complete. 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:mon is available 2024-04-25T01:58:21.652 INFO:teuthology.orchestra.run.smithi137.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T01:58:22.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:22 smithi137 ceph-mon[27939]: from='client.? 172.21.15.137:0/3875681131' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T01:58:22.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:22 smithi137 ceph-mon[27939]: from='client.? 172.21.15.137:0/3875681131' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout fsid = 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.137:3300,v1:172.21.15.137:6789] 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T01:58:23.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:23.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T01:58:23.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T01:58:23.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T01:58:23.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T01:58:23.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.273+0000 7fb80e800700 1 Processor -- start 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.273+0000 7fb80e800700 1 -- start start 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.273+0000 7fb80e800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.273+0000 7fb80e800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8081115e0 con 0x7fb80810ecb0 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.274+0000 7fb80d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.274+0000 7fb80d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34852/0 (socket says 172.21.15.137:34852) 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.274+0000 7fb80d400700 1 -- 172.21.15.137:0/3590422030 learned_addr learned my addr 172.21.15.137:0/3590422030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.274+0000 7fb80d400700 1 -- 172.21.15.137:0/3590422030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb808111760 con 0x7fb80810ecb0 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.275+0000 7fb80d400700 1 --2- 172.21.15.137:0/3590422030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0098a0 tx=0x7fb7fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9567365100d799e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.275+0000 7fb807e00700 1 -- 172.21.15.137:0/3590422030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc004160 con 0x7fb80810ecb0 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.275+0000 7fb807e00700 1 -- 172.21.15.137:0/3590422030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc004300 con 0x7fb80810ecb0 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.275+0000 7fb807e00700 1 -- 172.21.15.137:0/3590422030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc0036a0 con 0x7fb80810ecb0 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 -- 172.21.15.137:0/3590422030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 msgr2=0x7fb8081110a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 --2- 172.21.15.137:0/3590422030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0098a0 tx=0x7fb7fc009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 -- 172.21.15.137:0/3590422030 shutdown_connections 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 --2- 172.21.15.137:0/3590422030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081110a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 -- 172.21.15.137:0/3590422030 >> 172.21.15.137:0/3590422030 conn(0x7fb80807d400 msgr2=0x7fb80807f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 -- 172.21.15.137:0/3590422030 shutdown_connections 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.276+0000 7fb80e800700 1 -- 172.21.15.137:0/3590422030 wait complete. 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.277+0000 7fb80e800700 1 Processor -- start 2024-04-25T01:58:23.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.277+0000 7fb80e800700 1 -- start start 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80e800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80e800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb808111c90 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34862/0 (socket says 172.21.15.137:34862) 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80d400700 1 -- 172.21.15.137:0/3875681131 learned_addr learned my addr 172.21.15.137:0/3875681131 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.278+0000 7fb80d400700 1 -- 172.21.15.137:0/3875681131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8081a2070 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb80d400700 1 --2- 172.21.15.137:0/3875681131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc000c00 tx=0x7fb7fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc003db0 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc011630 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8081a2300 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc011950 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.279+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8081a4ff0 con 0x7fb80810ecb0 2024-04-25T01:58:23.075 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.280+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7fc01a460 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.280+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb7fc01b780 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.280+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb808063890 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.283+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb7fc01b980 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.360+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fb80802dcf0 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.371+0000 7fb806000700 1 -- 172.21.15.137:0/3875681131 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7fb7fc01bb60 con 0x7fb80810ecb0 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 msgr2=0x7fb8081a1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 --2- 172.21.15.137:0/3875681131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc000c00 tx=0x7fb7fc004750 comp rx=0 tx=0).stop 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 shutdown_connections 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 --2- 172.21.15.137:0/3875681131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb80810ecb0 0x7fb8081a1b30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 >> 172.21.15.137:0/3875681131 conn(0x7fb80807d400 msgr2=0x7fb80807e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 shutdown_connections 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:22.372+0000 7fb80e800700 1 -- 172.21.15.137:0/3875681131 wait complete. 2024-04-25T01:58:23.076 INFO:teuthology.orchestra.run.smithi137.stdout:Generating new minimal ceph.conf... 2024-04-25T01:58:24.029 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:23 smithi137 ceph-mon[27939]: from='client.? 172.21.15.137:0/3668850888' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.614+0000 7fe7ff200700 1 Processor -- start 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7ff200700 1 -- start start 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7ff200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7ff200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe80007c890 con 0x7fe80007de60 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7fde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7fde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34878/0 (socket says 172.21.15.137:34878) 2024-04-25T01:58:24.427 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.615+0000 7fe7fde00700 1 -- 172.21.15.137:0/2090719120 learned_addr learned my addr 172.21.15.137:0/2090719120 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.616+0000 7fe7fde00700 1 -- 172.21.15.137:0/2090719120 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80007ca10 con 0x7fe80007de60 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.616+0000 7fe7fde00700 1 --2- 172.21.15.137:0/2090719120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098a0 tx=0x7fe7f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725db1c701134b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.616+0000 7fe7fca00700 1 -- 172.21.15.137:0/2090719120 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0004160 con 0x7fe80007de60 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7fca00700 1 -- 172.21.15.137:0/2090719120 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe7f0004300 con 0x7fe80007de60 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7fca00700 1 -- 172.21.15.137:0/2090719120 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0011c00 con 0x7fe80007de60 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 -- 172.21.15.137:0/2090719120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 msgr2=0x7fe80007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 --2- 172.21.15.137:0/2090719120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098a0 tx=0x7fe7f0009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 -- 172.21.15.137:0/2090719120 shutdown_connections 2024-04-25T01:58:24.428 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 --2- 172.21.15.137:0/2090719120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80007c2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 -- 172.21.15.137:0/2090719120 >> 172.21.15.137:0/2090719120 conn(0x7fe800103450 msgr2=0x7fe800105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 -- 172.21.15.137:0/2090719120 shutdown_connections 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.617+0000 7fe7ff200700 1 -- 172.21.15.137:0/2090719120 wait complete. 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.618+0000 7fe7ff200700 1 Processor -- start 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7ff200700 1 -- start start 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7ff200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:24.429 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7ff200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe80010e4e0 con 0x7fe80007de60 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7fde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7fde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34886/0 (socket says 172.21.15.137:34886) 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.619+0000 7fe7fde00700 1 -- 172.21.15.137:0/3668850888 learned_addr learned my addr 172.21.15.137:0/3668850888 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7fde00700 1 -- 172.21.15.137:0/3668850888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80019e5e0 con 0x7fe80007de60 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7fde00700 1 --2- 172.21.15.137:0/3668850888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009fb0 tx=0x7fe7f0011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f00038b0 con 0x7fe80007de60 2024-04-25T01:58:24.430 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe7f001a430 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0019630 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80019e870 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.620+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8001a1560 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.621+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7f0019c70 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.621+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe7f0024730 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.622+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe800063890 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.625+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe7f0043dd0 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.701+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fe8001a1730 con 0x7fe80007de60 2024-04-25T01:58:24.431 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.702+0000 7fe7f6a00700 1 -- 172.21.15.137:0/3668850888 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fe7f0032030 con 0x7fe80007de60 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.703+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 msgr2=0x7fe80019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.703+0000 7fe7ff200700 1 --2- 172.21.15.137:0/3668850888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009fb0 tx=0x7fe7f0011c60 comp rx=0 tx=0).stop 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.703+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 shutdown_connections 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.703+0000 7fe7ff200700 1 --2- 172.21.15.137:0/3668850888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe80007de60 0x7fe80019e0a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.703+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 >> 172.21.15.137:0/3668850888 conn(0x7fe800103450 msgr2=0x7fe800103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.704+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 shutdown_connections 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:23.704+0000 7fe7ff200700 1 -- 172.21.15.137:0/3668850888 wait complete. 2024-04-25T01:58:24.432 INFO:teuthology.orchestra.run.smithi137.stdout:Restarting the monitor... 2024-04-25T01:58:24.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:24 smithi137 systemd[1]: Stopping Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T01:58:25.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[27935]: 2024-04-25T01:58:25.138+0000 7f26e1a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T01:58:25.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[27935]: 2024-04-25T01:58:25.138+0000 7f26e1a00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T01:58:25.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 podman[28181]: 2024-04-25 01:58:25.211168224 +0000 UTC m=+0.464064776 container died ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T01:58:26.029 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 podman[28181]: 2024-04-25 01:58:25.732585355 +0000 UTC m=+0.985481911 container cleanup ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T01:58:26.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 bash[28181]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a 2024-04-25T01:58:26.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:25 smithi137 podman[28195]: 2024-04-25 01:58:25.924970177 +0000 UTC m=+0.696140124 container remove ea8c94d0af6cd317c385ed3a5664245bb6558700603c5080f09a463a9c843c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T01:58:26.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 systemd[1]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-25T01:58:26.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 systemd[1]: Stopped Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:58:26.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 systemd[1]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service: Consumed 1.930s CPU time. 2024-04-25T01:58:26.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 systemd[1]: Starting Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T01:58:27.124 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 podman[28284]: 2024-04-25 01:58:26.746664707 +0000 UTC m=+0.036070431 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T01:58:27.124 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:26 smithi137 podman[28284]: 2024-04-25 01:58:26.880297994 +0000 UTC m=+0.169703742 container create c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424) 2024-04-25T01:58:27.224 INFO:teuthology.orchestra.run.smithi137.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T01:58:27.491 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 podman[28284]: 2024-04-25 01:58:27.121223258 +0000 UTC m=+0.410629049 container init c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T01:58:27.491 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 podman[28284]: 2024-04-25 01:58:27.131764838 +0000 UTC m=+0.421170556 container start c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev), process ceph-mon, pid 2 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: pidfile_write: ignore empty --pid-file 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: load: jerasure load: lrc 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: RocksDB version: 7.9.2 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Git sha 0 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Compile date 2024-04-24 16:41:23 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: DB SUMMARY 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: DB Session ID: 7RZZO3TEHIL65KPFA8ZC 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: CURRENT file: CURRENT 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107246 ; 2024-04-25T01:58:27.492 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.error_if_exists: 0 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.create_if_missing: 0 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.paranoid_checks: 1 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.env: 0x557f07967c60 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.info_log: 0x557f143d7ae0 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T01:58:27.493 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.statistics: (nil) 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.use_fsync: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_log_file_size: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_fallocate: 1 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.use_direct_reads: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T01:58:27.494 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.db_log_dir: 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.wal_dir: 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.write_buffer_manager: 0x557f143aa1e0 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T01:58:27.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.unordered_write: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.row_cache: None 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.wal_filter: None 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.two_write_queues: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T01:58:27.496 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.wal_compression: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.atomic_flush: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.log_readahead_size: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_background_jobs: 2 2024-04-25T01:58:27.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_background_compactions: -1 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_subcompactions: 1 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_open_files: -1 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T01:58:27.498 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_background_flushes: -1 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Compression algorithms supported: 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kZSTD supported: 0 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kXpressCompression supported: 0 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kZlibCompression supported: 1 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kSnappyCompression supported: 1 2024-04-25T01:58:27.499 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kLZ4Compression supported: 1 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: kBZip2Compression supported: 0 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.merge_operator: 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_filter: None 2024-04-25T01:58:27.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557f143d7be0) 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks: 1 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: pin_top_level_index_and_filter: 1 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_type: 0 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_index_type: 0 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_shortening: 1 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: checksum: 4 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: no_block_cache: 0 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache: 0x557f143db090 2024-04-25T01:58:27.501 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_name: BinnedLRUCache 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_options: 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: capacity : 536870912 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_shard_bits : 4 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: strict_capacity_limit : 0 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: high_pri_pool_ratio: 0.000 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_cache_compressed: (nil) 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: persistent_cache: (nil) 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size: 4096 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_size_deviation: 10 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_restart_interval: 16 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: index_block_restart_interval: 1 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: metadata_block_size: 4096 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: partition_filters: 0 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: use_delta_encoding: 1 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: filter_policy: bloomfilter 2024-04-25T01:58:27.502 INFO:journalctl@ceph.mon.a.smithi137.stdout: whole_key_filtering: 1 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: verify_compression: 0 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: read_amp_bytes_per_bit: 0 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: format_version: 5 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_index_compression: 1 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: block_align: 0 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: max_auto_readahead_size: 262144 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: prepopulate_block_cache: 0 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: initial_auto_readahead_size: 8192 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression: NoCompression 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T01:58:27.503 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.num_levels: 7 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T01:58:27.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T01:58:27.505 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T01:58:27.506 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.table_properties_collectors: 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.inplace_update_support: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.bloom_locality: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.max_successive_merges: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T01:58:27.507 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.ttl: 2592000 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enable_blob_files: false 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.min_blob_size: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T01:58:27.508 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 02df3f94-793c-4abe-a23e-d7c22abf7408 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010307189097, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010307191013, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 102094, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 100008, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14784, "raw_average_key_size": 50, "raw_value_size": 92017, "raw_average_value_size": 311, "num_data_blocks": 12, "num_entries": 295, "num_filter_entries": 295, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714010307, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "02df3f94-793c-4abe-a23e-d7c22abf7408", "db_session_id": "7RZZO3TEHIL65KPFA8ZC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010307191267, "job": 1, "event": "recovery_finished"} 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557f144cc000 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: DB pointer 0x557f144b6000 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** DB Stats ** 2024-04-25T01:58:27.509 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: L0 2/0 101.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Sum 2/0 101.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 79.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T01:58:27.510 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** Compaction Stats [default] ** 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 79.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Cumulative compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Interval compaction: 0.00 GB write, 14.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T01:58:27.511 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache BinnedLRUCache@0x557f143db090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: starting mon.a rank 0 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???) e1 preinit fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).mds e1 new map 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).mds e1 print_map 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: e1 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: legacy client fscid: -1 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout: No filesystems configured 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:58:27.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 bash[28284]: c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 systemd[1]: Started Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: monmap epoch 1 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: last_changed 2024-04-25T01:58:08.818093+0000 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: min_mon_release 19 (squid) 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: election_strategy: 1 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: fsmap 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T01:58:27.513 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:27 smithi137 ceph-mon[28303]: mgrmap e1: no daemons active 2024-04-25T01:58:28.754 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.801+0000 7f6c07800700 1 Processor -- start 2024-04-25T01:58:28.761 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.801+0000 7f6c07800700 1 -- start start 2024-04-25T01:58:28.761 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.802+0000 7f6c07800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.802+0000 7f6c07800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010abf0 con 0x7f6c0010a200 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.802+0000 7f6c04e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.803+0000 7f6c04e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34900/0 (socket says 172.21.15.137:34900) 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.803+0000 7f6c04e00700 1 -- 172.21.15.137:0/2243530128 learned_addr learned my addr 172.21.15.137:0/2243530128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.803+0000 7f6c04e00700 1 -- 172.21.15.137:0/2243530128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0010b400 con 0x7f6c0010a200 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.803+0000 7f6c04e00700 1 --2- 172.21.15.137:0/2243530128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098a0 tx=0x7f6bf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5517e281d1fb6bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6bff400700 1 -- 172.21.15.137:0/2243530128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4004160 con 0x7f6c0010a200 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6bff400700 1 -- 172.21.15.137:0/2243530128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6bf4004300 con 0x7f6c0010a200 2024-04-25T01:58:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6bff400700 1 -- 172.21.15.137:0/2243530128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4011c00 con 0x7f6c0010a200 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6c07800700 1 -- 172.21.15.137:0/2243530128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 msgr2=0x7f6c0010a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6c07800700 1 --2- 172.21.15.137:0/2243530128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40098a0 tx=0x7f6bf4009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6c07800700 1 -- 172.21.15.137:0/2243530128 shutdown_connections 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6c07800700 1 --2- 172.21.15.137:0/2243530128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0010a620 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.804+0000 7f6c07800700 1 -- 172.21.15.137:0/2243530128 >> 172.21.15.137:0/2243530128 conn(0x7f6c001057c0 msgr2=0x7f6c00107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.805+0000 7f6c07800700 1 -- 172.21.15.137:0/2243530128 shutdown_connections 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.805+0000 7f6c07800700 1 -- 172.21.15.137:0/2243530128 wait complete. 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c07800700 1 Processor -- start 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c07800700 1 -- start start 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c07800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c07800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010e7b0 con 0x7f6c0010a200 2024-04-25T01:58:28.763 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c04e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c04e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34904/0 (socket says 172.21.15.137:34904) 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.806+0000 7f6c04e00700 1 -- 172.21.15.137:0/1429474465 learned_addr learned my addr 172.21.15.137:0/1429474465 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.807+0000 7f6c04e00700 1 -- 172.21.15.137:0/1429474465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0019e740 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.807+0000 7f6c04e00700 1 --2- 172.21.15.137:0/1429474465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf4011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.807+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf4003b20 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6bf4003cc0 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bf40249a0 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0019e9d0 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c001a16c0 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6bf4022020 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.808+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6bf401a430 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.809+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0010e930 con 0x7f6c0010a200 2024-04-25T01:58:28.764 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.812+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6bf40042c0 con 0x7f6c0010a200 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.889+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6c001a1900 con 0x7f6c0010a200 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.892+0000 7f6bfd600700 1 -- 172.21.15.137:0/1429474465 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f6bf402ddf0 con 0x7f6c0010a200 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.893+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 msgr2=0x7f6c0019e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.893+0000 7f6c07800700 1 --2- 172.21.15.137:0/1429474465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4000c00 tx=0x7f6bf4011c80 comp rx=0 tx=0).stop 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.893+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 shutdown_connections 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.893+0000 7f6c07800700 1 --2- 172.21.15.137:0/1429474465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c0010a200 0x7f6c0019e200 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.893+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 >> 172.21.15.137:0/1429474465 conn(0x7f6c001057c0 msgr2=0x7f6c001062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.894+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 shutdown_connections 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:27.894+0000 7f6c07800700 1 -- 172.21.15.137:0/1429474465 wait complete. 2024-04-25T01:58:28.765 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T01:58:28.777 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T01:58:28.778 INFO:teuthology.orchestra.run.smithi137.stdout:Creating mgr... 2024-04-25T01:58:28.778 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-25T01:58:28.779 INFO:teuthology.orchestra.run.smithi137.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-25T01:58:29.029 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1429474465' entity='client.admin' 2024-04-25T01:58:29.197 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x 2024-04-25T01:58:29.197 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-25T01:58:29.459 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968.target.wants/ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-19106f5e-02a7-11ef-bc93-c7b262605968@.service. 2024-04-25T01:58:30.242 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:58:30.242 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-04-25T01:58:30.258 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:58:30.258 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:58:30.259 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-04-25T01:58:30.259 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T01:58:30.279 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:58:30.280 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-04-25T01:58:30.295 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:58:30.295 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:58:30.295 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-04-25T01:58:30.295 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-25T01:58:30.295 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr to start... 2024-04-25T01:58:30.296 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr... 2024-04-25T01:58:30.448 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:30.350+0000 7f6a26a31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T01:58:30.745 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:30.604+0000 7f6a26a31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:58:31.000 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:30.743+0000 7f6a26a31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T01:58:31.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:31 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/566083586' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:58:31.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:31.188+0000 7f6a26a31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T01:58:31.632 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:31.304+0000 7f6a26a31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T01:58:31.642 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:31.643 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:31.643 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:58:31.643 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:58:31.644 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.646 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:58:31.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:31.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:58:31.647 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:58:31.653 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:58:31.653 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:58:31.653 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:58:31.653 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:31.654 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:31.655 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:58:20.233768+0000", 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.888+0000 7f2bd6e00700 1 Processor -- start 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.889+0000 7f2bd6e00700 1 -- start start 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.889+0000 7f2bd6e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.889+0000 7f2bd6e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd007b780 con 0x7f2bd007cd50 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.889+0000 7f2bcfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.890+0000 7f2bcfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48858/0 (socket says 172.21.15.137:48858) 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.890+0000 7f2bcfe00700 1 -- 172.21.15.137:0/477716664 learned_addr learned my addr 172.21.15.137:0/477716664 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.890+0000 7f2bcfe00700 1 -- 172.21.15.137:0/477716664 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd007b900 con 0x7f2bd007cd50 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.890+0000 7f2bcfe00700 1 --2- 172.21.15.137:0/477716664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00098a0 tx=0x7f2bc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca8cbd7c91df7ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:31.656 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bcea00700 1 -- 172.21.15.137:0/477716664 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc0004160 con 0x7f2bd007cd50 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bcea00700 1 -- 172.21.15.137:0/477716664 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2bc0004300 con 0x7f2bd007cd50 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bcea00700 1 -- 172.21.15.137:0/477716664 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc0011c00 con 0x7f2bd007cd50 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bd6e00700 1 -- 172.21.15.137:0/477716664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 msgr2=0x7f2bd007b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bd6e00700 1 --2- 172.21.15.137:0/477716664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00098a0 tx=0x7f2bc0009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bd6e00700 1 -- 172.21.15.137:0/477716664 shutdown_connections 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bd6e00700 1 --2- 172.21.15.137:0/477716664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd007b1b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.891+0000 7f2bd6e00700 1 -- 172.21.15.137:0/477716664 >> 172.21.15.137:0/477716664 conn(0x7f2bd01035c0 msgr2=0x7f2bd0105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.892+0000 7f2bd6e00700 1 -- 172.21.15.137:0/477716664 shutdown_connections 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.892+0000 7f2bd6e00700 1 -- 172.21.15.137:0/477716664 wait complete. 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.893+0000 7f2bd6e00700 1 Processor -- start 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.893+0000 7f2bd6e00700 1 -- start start 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.893+0000 7f2bd6e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:31.657 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.893+0000 7f2bd6e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd010e6b0 con 0x7f2bd007cd50 2024-04-25T01:58:31.658 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bcfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:31.658 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bcfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48860/0 (socket says 172.21.15.137:48860) 2024-04-25T01:58:31.658 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bcfe00700 1 -- 172.21.15.137:0/566083586 learned_addr learned my addr 172.21.15.137:0/566083586 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:31.658 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bcfe00700 1 -- 172.21.15.137:0/566083586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd019e700 con 0x7f2bd007cd50 2024-04-25T01:58:31.658 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bcfe00700 1 --2- 172.21.15.137:0/566083586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011bd0 tx=0x7f2bc0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:31.662 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.894+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc0003b20 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2bc0003cc0 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bd6e00700 1 -- 172.21.15.137:0/566083586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd019e990 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bc0024930 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bd6e00700 1 -- 172.21.15.137:0/566083586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd01a1680 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bc0022020 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.895+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2bc0019670 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.896+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba8005330 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.899+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2bc0019910 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.978+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2ba80058f0 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.979+0000 7f2bccc00700 1 -- 172.21.15.137:0/566083586 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f2bc0019af0 con 0x7f2bd007cd50 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 msgr2=0x7f2bd019e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 --2- 172.21.15.137:0/566083586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011bd0 tx=0x7f2bc0011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 shutdown_connections 2024-04-25T01:58:31.663 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 --2- 172.21.15.137:0/566083586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bd007cd50 0x7f2bd019e1c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:31.664 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 >> 172.21.15.137:0/566083586 conn(0x7f2bd01035c0 msgr2=0x7f2bd01040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:31.664 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 shutdown_connections 2024-04-25T01:58:31.664 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:30.980+0000 7f2bc6000700 1 -- 172.21.15.137:0/566083586 wait complete. 2024-04-25T01:58:31.664 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (1/15)... 2024-04-25T01:58:33.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:32.865+0000 7f6a26a31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T01:58:33.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:33.087+0000 7f6a26a31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T01:58:33.670 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:33.298+0000 7f6a26a31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T01:58:33.942 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:33.666+0000 7f6a26a31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T01:58:33.942 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:33.795+0000 7f6a26a31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T01:58:34.200 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:34.055+0000 7f6a26a31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T01:58:34.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3316288642' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:58:34.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:34.314+0000 7f6a26a31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:58:34.964 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:34.968 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:34.968 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:58:34.969 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:34.970 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:58:34.971 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:58:34.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:58:34.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:58:34.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:58:34.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:58:20.233768+0000", 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.266+0000 7f4e83200700 1 Processor -- start 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.266+0000 7f4e83200700 1 -- start start 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.267+0000 7f4e83200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.267+0000 7f4e83200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0634f0 con 0x7f4e7c108b00 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.267+0000 7f4e7be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.267+0000 7f4e7be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48876/0 (socket says 172.21.15.137:48876) 2024-04-25T01:58:34.983 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.267+0000 7f4e7be00700 1 -- 172.21.15.137:0/57422002 learned_addr learned my addr 172.21.15.137:0/57422002 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.268+0000 7f4e7be00700 1 -- 172.21.15.137:0/57422002 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c10b430 con 0x7f4e7c108b00 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.268+0000 7f4e7be00700 1 --2- 172.21.15.137:0/57422002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0098a0 tx=0x7f4e6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d155e39b7670561 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.268+0000 7f4e7aa00700 1 -- 172.21.15.137:0/57422002 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6c004160 con 0x7f4e7c108b00 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.268+0000 7f4e7aa00700 1 -- 172.21.15.137:0/57422002 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4e6c004300 con 0x7f4e7c108b00 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.268+0000 7f4e7aa00700 1 -- 172.21.15.137:0/57422002 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6c011c00 con 0x7f4e7c108b00 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.269+0000 7f4e83200700 1 -- 172.21.15.137:0/57422002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 msgr2=0x7f4e7c10aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.269+0000 7f4e83200700 1 --2- 172.21.15.137:0/57422002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0098a0 tx=0x7f4e6c009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.270+0000 7f4e83200700 1 -- 172.21.15.137:0/57422002 shutdown_connections 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.270+0000 7f4e83200700 1 --2- 172.21.15.137:0/57422002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c10aef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.270+0000 7f4e83200700 1 -- 172.21.15.137:0/57422002 >> 172.21.15.137:0/57422002 conn(0x7f4e7c102510 msgr2=0x7f4e7c104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.270+0000 7f4e83200700 1 -- 172.21.15.137:0/57422002 shutdown_connections 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.270+0000 7f4e83200700 1 -- 172.21.15.137:0/57422002 wait complete. 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.271+0000 7f4e83200700 1 Processor -- start 2024-04-25T01:58:34.984 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.271+0000 7f4e83200700 1 -- start start 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.271+0000 7f4e83200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.271+0000 7f4e83200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c10c460 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.272+0000 7f4e7be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.272+0000 7f4e7be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48878/0 (socket says 172.21.15.137:48878) 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.272+0000 7f4e7be00700 1 -- 172.21.15.137:0/3316288642 learned_addr learned my addr 172.21.15.137:0/3316288642 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.272+0000 7f4e7be00700 1 -- 172.21.15.137:0/3316288642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c19e7a0 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.272+0000 7f4e7be00700 1 --2- 172.21.15.137:0/3316288642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c011bd0 tx=0x7f4e6c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6c003b20 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4e6c003cc0 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e6c024930 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c19ea30 con 0x7f4e7c108b00 2024-04-25T01:58:34.985 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c1a1720 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e6c022020 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.273+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e6c0193c0 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.274+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c063890 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.276+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4e6c02ddf0 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.352+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4e7c1a1c70 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.353+0000 7f4e78c00700 1 -- 172.21.15.137:0/3316288642 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f4e6c01aca0 con 0x7f4e7c108b00 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 msgr2=0x7f4e7c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 --2- 172.21.15.137:0/3316288642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c011bd0 tx=0x7f4e6c011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 shutdown_connections 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 --2- 172.21.15.137:0/3316288642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e7c108b00 0x7f4e7c19e260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 >> 172.21.15.137:0/3316288642 conn(0x7f4e7c102510 msgr2=0x7f4e7c103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:34.987 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 shutdown_connections 2024-04-25T01:58:34.987 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:34.355+0000 7f4e83200700 1 -- 172.21.15.137:0/3316288642 wait complete. 2024-04-25T01:58:34.987 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (2/15)... 2024-04-25T01:58:35.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:35.127+0000 7f6a26a31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T01:58:36.030 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:35.668+0000 7f6a26a31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T01:58:36.030 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:35.793+0000 7f6a26a31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T01:58:36.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:36.049+0000 7f6a26a31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T01:58:37.029 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:36.713+0000 7f6a26a31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T01:58:37.029 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:36.833+0000 7f6a26a31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T01:58:37.449 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:37.152+0000 7f6a26a31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T01:58:37.449 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:37.334+0000 7f6a26a31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T01:58:37.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:37.460+0000 7f6a26a31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T01:58:37.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:37.617+0000 7f6a26a31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T01:58:38.029 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/195444318' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:58:38.029 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:37.748+0000 7f6a26a31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:58:38.371 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T01:58:38.372 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:58:38.373 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:58:38.380 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:58:38.381 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.382 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:58:20.233768+0000", 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.596+0000 7feac6a00700 1 Processor -- start 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.596+0000 7feac6a00700 1 -- start start 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.596+0000 7feac6a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.597+0000 7feac6a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feac0108a10 con 0x7feac0108020 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.597+0000 7feabfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.597+0000 7feabfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48880/0 (socket says 172.21.15.137:48880) 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.597+0000 7feabfe00700 1 -- 172.21.15.137:0/272286422 learned_addr learned my addr 172.21.15.137:0/272286422 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.597+0000 7feabfe00700 1 -- 172.21.15.137:0/272286422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac0109220 con 0x7feac0108020 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.598+0000 7feabfe00700 1 --2- 172.21.15.137:0/272286422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feab00098a0 tx=0x7feab0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64ab453abe28895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:38.383 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.598+0000 7feabea00700 1 -- 172.21.15.137:0/272286422 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0004160 con 0x7feac0108020 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.598+0000 7feabea00700 1 -- 172.21.15.137:0/272286422 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7feab0004300 con 0x7feac0108020 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.598+0000 7feabea00700 1 -- 172.21.15.137:0/272286422 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0011c00 con 0x7feac0108020 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 -- 172.21.15.137:0/272286422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 msgr2=0x7feac0108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 --2- 172.21.15.137:0/272286422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feab00098a0 tx=0x7feab0009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 -- 172.21.15.137:0/272286422 shutdown_connections 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 --2- 172.21.15.137:0/272286422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac0108440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 -- 172.21.15.137:0/272286422 >> 172.21.15.137:0/272286422 conn(0x7feac01035c0 msgr2=0x7feac0105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 -- 172.21.15.137:0/272286422 shutdown_connections 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.599+0000 7feac6a00700 1 -- 172.21.15.137:0/272286422 wait complete. 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.600+0000 7feac6a00700 1 Processor -- start 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.600+0000 7feac6a00700 1 -- start start 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feac6a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feac6a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feac010c5d0 con 0x7feac0108020 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feabfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feabfe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48892/0 (socket says 172.21.15.137:48892) 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feabfe00700 1 -- 172.21.15.137:0/195444318 learned_addr learned my addr 172.21.15.137:0/195444318 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:38.384 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.601+0000 7feabfe00700 1 -- 172.21.15.137:0/195444318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac019e790 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feabfe00700 1 --2- 172.21.15.137:0/195444318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab0003b20 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7feab0003cc0 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac019ea20 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feab00249a0 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac01a1710 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.602+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feab0022020 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.603+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7feab00193c0 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.603+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac010c750 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.606+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7feab0042dd0 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.684+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7feac01a1c40 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.685+0000 7feabcc00700 1 -- 172.21.15.137:0/195444318 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7feab0031030 con 0x7feac0108020 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.686+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 msgr2=0x7feac019e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.686+0000 7feac6a00700 1 --2- 172.21.15.137:0/195444318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feab0000c00 tx=0x7feab0011c80 comp rx=0 tx=0).stop 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.686+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 shutdown_connections 2024-04-25T01:58:38.385 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.686+0000 7feac6a00700 1 --2- 172.21.15.137:0/195444318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac0108020 0x7feac019e250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:38.386 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.686+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 >> 172.21.15.137:0/195444318 conn(0x7feac01035c0 msgr2=0x7feac0104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:38.386 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.687+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 shutdown_connections 2024-04-25T01:58:38.386 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:37.687+0000 7feac6a00700 1 -- 172.21.15.137:0/195444318 wait complete. 2024-04-25T01:58:38.386 INFO:teuthology.orchestra.run.smithi137.stdout:mgr not available, waiting (3/15)... 2024-04-25T01:58:39.029 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:38.771+0000 7f6a26a31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T01:58:39.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:39.046+0000 7f6a26a31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: Activating manager daemon x 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: mgrmap e2: x(active, starting, since 0.0108802s) 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: Manager daemon x is now available 2024-04-25T01:58:39.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T01:58:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T01:58:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' 2024-04-25T01:58:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:39 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' 2024-04-25T01:58:40.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:40 smithi137 ceph-mon[28303]: from='mgr.14100 172.21.15.137:0/2573608022' entity='mgr.x' 2024-04-25T01:58:40.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:40 smithi137 ceph-mon[28303]: mgrmap e3: x(active, since 1.02186s) 2024-04-25T01:58:41.965 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:41.965 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 0 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "a" 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:41.966 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T01:58:41.967 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T01:58:41.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T01:58:41.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ], 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T01:58:20.233768+0000", 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout }, 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.975+0000 7f7470400700 1 Processor -- start 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.975+0000 7f7470400700 1 -- start start 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.976+0000 7f7470400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:41.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.976+0000 7f7470400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f746810abf0 con 0x7f746810a200 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.976+0000 7f746da00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.976+0000 7f746da00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48768/0 (socket says 172.21.15.137:48768) 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.976+0000 7f746da00700 1 -- 172.21.15.137:0/29730554 learned_addr learned my addr 172.21.15.137:0/29730554 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.977+0000 7f746da00700 1 -- 172.21.15.137:0/29730554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746810b400 con 0x7f746810a200 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.977+0000 7f746da00700 1 --2- 172.21.15.137:0/29730554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f745c0098a0 tx=0x7f745c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c808896834a27e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.977+0000 7f7467e00700 1 -- 172.21.15.137:0/29730554 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c004160 con 0x7f746810a200 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.977+0000 7f7467e00700 1 -- 172.21.15.137:0/29730554 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f745c004300 con 0x7f746810a200 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.977+0000 7f7467e00700 1 -- 172.21.15.137:0/29730554 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c011c00 con 0x7f746810a200 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 -- 172.21.15.137:0/29730554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 msgr2=0x7f746810a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 --2- 172.21.15.137:0/29730554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f745c0098a0 tx=0x7f745c009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 -- 172.21.15.137:0/29730554 shutdown_connections 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 --2- 172.21.15.137:0/29730554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746810a620 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 -- 172.21.15.137:0/29730554 >> 172.21.15.137:0/29730554 conn(0x7f7468105900 msgr2=0x7f7468107cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:41.979 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 -- 172.21.15.137:0/29730554 shutdown_connections 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.978+0000 7f7470400700 1 -- 172.21.15.137:0/29730554 wait complete. 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.979+0000 7f7470400700 1 Processor -- start 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.979+0000 7f7470400700 1 -- start start 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f7470400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f7470400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f746810e7b0 con 0x7f746810a200 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f746da00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f746da00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48770/0 (socket says 172.21.15.137:48770) 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f746da00700 1 -- 172.21.15.137:0/2744813982 learned_addr learned my addr 172.21.15.137:0/2744813982 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.980+0000 7f746da00700 1 -- 172.21.15.137:0/2744813982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746819e760 con 0x7f746810a200 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f746da00700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c003b20 con 0x7f746810a200 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f745c003cc0 con 0x7f746810a200 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746819e9f0 con 0x7f746810a200 2024-04-25T01:58:41.980 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c0249a0 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.981+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74681a16e0 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.982+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f745c022020 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.982+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746810e930 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.983+0000 7f7466000700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 0x7f745003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.983+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f745c04ca70 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.983+0000 7f746d000700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 0x7f745003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.984+0000 7f746d000700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 0x7f745003b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7454006fd0 tx=0x7f7454006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:40.989+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f745c017ca0 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.113+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f745c01a430 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.296+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f74681a1c90 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.297+0000 7f7466000700 1 -- 172.21.15.137:0/2744813982 <== mon.0 v2:172.21.15.137:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f745c0448b0 con 0x7f746810a200 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.300+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 msgr2=0x7f745003b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.300+0000 7f7470400700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 0x7f745003b3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7454006fd0 tx=0x7f7454006e40 comp rx=0 tx=0).stop 2024-04-25T01:58:41.981 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.300+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 msgr2=0x7f746819e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.300+0000 7f7470400700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c011c80 comp rx=0 tx=0).stop 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 shutdown_connections 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f7450038f30 0x7f745003b3f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 --2- 172.21.15.137:0/2744813982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f746810a200 0x7f746819e220 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 >> 172.21.15.137:0/2744813982 conn(0x7f7468105900 msgr2=0x7f7468107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 shutdown_connections 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:41.301+0000 7f7470400700 1 -- 172.21.15.137:0/2744813982 wait complete. 2024-04-25T01:58:41.982 INFO:teuthology.orchestra.run.smithi137.stdout:mgr is available 2024-04-25T01:58:42.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:42 smithi137 ceph-mon[28303]: mgrmap e4: x(active, since 2s) 2024-04-25T01:58:42.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:42 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2744813982' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T01:58:43.472 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:43 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3018148590' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout fsid = 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T01:58:43.483 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T01:58:43.484 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T01:58:43.484 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:43.484 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T01:58:43.484 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.594+0000 7f3ea9a00700 1 Processor -- start 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea9a00700 1 -- start start 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea9a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:43.490 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea9a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea410ac20 con 0x7f3ea410a230 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea2a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea2a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48774/0 (socket says 172.21.15.137:48774) 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.595+0000 7f3ea2a00700 1 -- 172.21.15.137:0/517135034 learned_addr learned my addr 172.21.15.137:0/517135034 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.596+0000 7f3ea2a00700 1 -- 172.21.15.137:0/517135034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea410b3e0 con 0x7f3ea410a230 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.596+0000 7f3ea2a00700 1 --2- 172.21.15.137:0/517135034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e940098a0 tx=0x7f3e94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f972d793dfd309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.597+0000 7f3ea2000700 1 -- 172.21.15.137:0/517135034 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94004160 con 0x7f3ea410a230 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.597+0000 7f3ea2000700 1 -- 172.21.15.137:0/517135034 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3e94004300 con 0x7f3ea410a230 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.597+0000 7f3ea2000700 1 -- 172.21.15.137:0/517135034 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94011c00 con 0x7f3ea410a230 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 -- 172.21.15.137:0/517135034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 msgr2=0x7f3ea410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/517135034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e940098a0 tx=0x7f3e94009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 -- 172.21.15.137:0/517135034 shutdown_connections 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/517135034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea410a650 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:43.491 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 -- 172.21.15.137:0/517135034 >> 172.21.15.137:0/517135034 conn(0x7f3ea4105900 msgr2=0x7f3ea4107cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 -- 172.21.15.137:0/517135034 shutdown_connections 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.598+0000 7f3ea9a00700 1 -- 172.21.15.137:0/517135034 wait complete. 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.599+0000 7f3ea9a00700 1 Processor -- start 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.599+0000 7f3ea9a00700 1 -- start start 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.599+0000 7f3ea9a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.599+0000 7f3ea9a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea410e790 con 0x7f3ea410a230 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.600+0000 7f3ea2a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.600+0000 7f3ea2a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48776/0 (socket says 172.21.15.137:48776) 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.600+0000 7f3ea2a00700 1 -- 172.21.15.137:0/3018148590 learned_addr learned my addr 172.21.15.137:0/3018148590 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.600+0000 7f3ea2a00700 1 -- 172.21.15.137:0/3018148590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea419e780 con 0x7f3ea410a230 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.600+0000 7f3ea2a00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000c00 tx=0x7f3e94011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.601+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e94003b20 con 0x7f3ea410a230 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.601+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3e94003cc0 con 0x7f3ea410a230 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.601+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e940249a0 con 0x7f3ea410a230 2024-04-25T01:58:43.492 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.601+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea419ea10 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.601+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a1700 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.602+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f3e94022020 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.602+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea410e910 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.603+0000 7f3e9be00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 0x7f3e8803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.603+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e9404cc80 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.603+0000 7f3e9a000700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 0x7f3e8803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.604+0000 7f3e9a000700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 0x7f3e8803b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c006fd0 tx=0x7f3e8c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.609+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f3e94017ca0 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.831+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3ea4063890 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.833+0000 7f3e9be00700 1 -- 172.21.15.137:0/3018148590 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f3e9402c560 con 0x7f3ea410a230 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 msgr2=0x7f3e8803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 0x7f3e8803b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c006fd0 tx=0x7f3e8c006e40 comp rx=0 tx=0).stop 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 msgr2=0x7f3ea419e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:43.493 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000c00 tx=0x7f3e94011c80 comp rx=0 tx=0).stop 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 shutdown_connections 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f3e88039050 0x7f3e8803b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 --2- 172.21.15.137:0/3018148590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ea410a230 0x7f3ea419e240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 >> 172.21.15.137:0/3018148590 conn(0x7f3ea4105900 msgr2=0x7f3ea41074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 shutdown_connections 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:42.836+0000 7f3ea9a00700 1 -- 172.21.15.137:0/3018148590 wait complete. 2024-04-25T01:58:43.494 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling cephadm module... 2024-04-25T01:58:44.724 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:44 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1625560399' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T01:58:44.725 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setuser ceph since I am not root 2024-04-25T01:58:44.725 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setgroup ceph since I am not root 2024-04-25T01:58:44.725 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:44.720+0000 7fb50ef49200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T01:58:45.029 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:44.959+0000 7fb50ef49200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.079+0000 7fed49c00700 1 Processor -- start 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.079+0000 7fed49c00700 1 -- start start 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.080+0000 7fed49c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.080+0000 7fed49c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed440634f0 con 0x7fed441068d0 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.080+0000 7fed42a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.080+0000 7fed42a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48782/0 (socket says 172.21.15.137:48782) 2024-04-25T01:58:45.140 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.080+0000 7fed42a00700 1 -- 172.21.15.137:0/2843061196 learned_addr learned my addr 172.21.15.137:0/2843061196 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.081+0000 7fed42a00700 1 -- 172.21.15.137:0/2843061196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed44107230 con 0x7fed441068d0 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.081+0000 7fed42a00700 1 --2- 172.21.15.137:0/2843061196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed340098a0 tx=0x7fed34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67864d3b2659367d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed41600700 1 -- 172.21.15.137:0/2843061196 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed34004160 con 0x7fed441068d0 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed41600700 1 -- 172.21.15.137:0/2843061196 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fed34004300 con 0x7fed441068d0 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed41600700 1 -- 172.21.15.137:0/2843061196 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed34011c00 con 0x7fed441068d0 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 -- 172.21.15.137:0/2843061196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 msgr2=0x7fed44106cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 --2- 172.21.15.137:0/2843061196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed340098a0 tx=0x7fed34009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 -- 172.21.15.137:0/2843061196 shutdown_connections 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 --2- 172.21.15.137:0/2843061196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed44106cf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 -- 172.21.15.137:0/2843061196 >> 172.21.15.137:0/2843061196 conn(0x7fed441024f0 msgr2=0x7fed44104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 -- 172.21.15.137:0/2843061196 shutdown_connections 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.082+0000 7fed49c00700 1 -- 172.21.15.137:0/2843061196 wait complete. 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed49c00700 1 Processor -- start 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed49c00700 1 -- start start 2024-04-25T01:58:45.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed49c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed49c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed44108320 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed42a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed42a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48790/0 (socket says 172.21.15.137:48790) 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.084+0000 7fed42a00700 1 -- 172.21.15.137:0/1625560399 learned_addr learned my addr 172.21.15.137:0/1625560399 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed42a00700 1 -- 172.21.15.137:0/1625560399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4419e710 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed42a00700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed34011bd0 tx=0x7fed34011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed34003b20 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fed34003cc0 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed34024930 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4419e9a0 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.085+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed441a1690 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.086+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fed34022020 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.087+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed44063890 con 0x7fed441068d0 2024-04-25T01:58:45.142 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.087+0000 7fed3b400700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 0x7fed2803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.087+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fed3404cd30 con 0x7fed441068d0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.087+0000 7fed42000700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 0x7fed2803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.088+0000 7fed42000700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 0x7fed2803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed30006fd0 tx=0x7fed30006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.093+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fed3401ad50 con 0x7fed441068d0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.378+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fed440008d0 con 0x7fed441068d0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.432+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fed3404ca90 con 0x7fed441068d0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.437+0000 7fed3b400700 1 -- 172.21.15.137:0/1625560399 <== mon.0 v2:172.21.15.137:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fed3402d3f0 con 0x7fed441068d0 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 msgr2=0x7fed2803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 0x7fed2803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed30006fd0 tx=0x7fed30006e40 comp rx=0 tx=0).stop 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 msgr2=0x7fed4419e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed34011bd0 tx=0x7fed34011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 shutdown_connections 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7fed28039050 0x7fed2803b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 --2- 172.21.15.137:0/1625560399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed441068d0 0x7fed4419e1d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:45.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.438+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 >> 172.21.15.137:0/1625560399 conn(0x7fed441024f0 msgr2=0x7fed44194e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:45.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.439+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 shutdown_connections 2024-04-25T01:58:45.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:44.439+0000 7fed49c00700 1 -- 172.21.15.137:0/1625560399 wait complete. 2024-04-25T01:58:45.443 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:45.090+0000 7fb50ef49200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T01:58:45.726 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:45 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1625560399' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T01:58:45.726 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:45 smithi137 ceph-mon[28303]: mgrmap e5: x(active, since 5s) 2024-04-25T01:58:45.726 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:45.511+0000 7fb50ef49200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T01:58:45.727 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:45.623+0000 7fb50ef49200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T01:58:46.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:46 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3128019950' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T01:58:46.723 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.722+0000 7f04c7e00700 1 Processor -- start 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.722+0000 7f04c7e00700 1 -- start start 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.722+0000 7f04c7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.722+0000 7f04c7e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04c007b760 con 0x7f04c007cd30 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.723+0000 7f04c5400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.723+0000 7f04c5400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48812/0 (socket says 172.21.15.137:48812) 2024-04-25T01:58:46.724 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.723+0000 7f04c5400700 1 -- 172.21.15.137:0/4288365180 learned_addr learned my addr 172.21.15.137:0/4288365180 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:46.725 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.723+0000 7f04c5400700 1 -- 172.21.15.137:0/4288365180 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c007b8e0 con 0x7f04c007cd30 2024-04-25T01:58:46.725 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.724+0000 7f04c5400700 1 --2- 172.21.15.137:0/4288365180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098a0 tx=0x7f04b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9e7ef894ca9073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:46.725 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.724+0000 7f04bfe00700 1 -- 172.21.15.137:0/4288365180 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b4004160 con 0x7f04c007cd30 2024-04-25T01:58:46.725 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.724+0000 7f04bfe00700 1 -- 172.21.15.137:0/4288365180 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f04b4004300 con 0x7f04c007cd30 2024-04-25T01:58:46.725 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.724+0000 7f04bfe00700 1 -- 172.21.15.137:0/4288365180 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b4011c00 con 0x7f04c007cd30 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 -- 172.21.15.137:0/4288365180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 msgr2=0x7f04c007b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 --2- 172.21.15.137:0/4288365180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098a0 tx=0x7f04b4009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 -- 172.21.15.137:0/4288365180 shutdown_connections 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 --2- 172.21.15.137:0/4288365180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c007b190 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 -- 172.21.15.137:0/4288365180 >> 172.21.15.137:0/4288365180 conn(0x7f04c01035c0 msgr2=0x7f04c0105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 -- 172.21.15.137:0/4288365180 shutdown_connections 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.725+0000 7f04c7e00700 1 -- 172.21.15.137:0/4288365180 wait complete. 2024-04-25T01:58:46.726 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c7e00700 1 Processor -- start 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c7e00700 1 -- start start 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c7e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04c010e670 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c5400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c5400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48822/0 (socket says 172.21.15.137:48822) 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.727+0000 7f04c5400700 1 -- 172.21.15.137:0/3128019950 learned_addr learned my addr 172.21.15.137:0/3128019950 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04c5400700 1 -- 172.21.15.137:0/3128019950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c019e720 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04c5400700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f04b4011bd0 tx=0x7f04b4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b4003b20 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f04b4003cc0 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c019e9b0 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.728+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b4024930 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.729+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c01a16a0 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.730+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c0063890 con 0x7f04c007cd30 2024-04-25T01:58:46.727 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.730+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f04b4022020 con 0x7f04c007cd30 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.730+0000 7f04be000700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 0x7f04a803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.730+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04b404cd60 con 0x7f04c007cd30 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.730+0000 7f04c4a00700 1 -- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 msgr2=0x7f04a803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.731+0000 7f04c4a00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 0x7f04a803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.736+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f04b404cac0 con 0x7f04c007cd30 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.932+0000 7f04c4a00700 1 -- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 msgr2=0x7f04a803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:45.932+0000 7f04c4a00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 0x7f04a803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.016+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f04c01a1870 con 0x7f04c007cd30 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.017+0000 7f04be000700 1 -- 172.21.15.137:0/3128019950 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f04c01a1870 con 0x7f04c007cd30 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 msgr2=0x7f04a803b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 0x7f04a803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 msgr2=0x7f04c019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f04b4011bd0 tx=0x7f04b4011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.728 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 shutdown_connections 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f04a80390a0 0x7f04a803b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 --2- 172.21.15.137:0/3128019950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04c007cd30 0x7f04c019e1e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 >> 172.21.15.137:0/3128019950 conn(0x7f04c01035c0 msgr2=0x7f04c01040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 shutdown_connections 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:46.022+0000 7f04c7e00700 1 -- 172.21.15.137:0/3128019950 wait complete. 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for the mgr to restart... 2024-04-25T01:58:46.729 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr epoch 5... 2024-04-25T01:58:47.255 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:47.197+0000 7fb50ef49200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T01:58:47.518 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:47.429+0000 7fb50ef49200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T01:58:47.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:47.641+0000 7fb50ef49200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T01:58:48.280 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:48.016+0000 7fb50ef49200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T01:58:48.280 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:48.138+0000 7fb50ef49200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T01:58:48.721 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:48.405+0000 7fb50ef49200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T01:58:48.721 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:48.655+0000 7fb50ef49200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:58:49.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:49 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:49.457+0000 7fb50ef49200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T01:58:50.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:50.006+0000 7fb50ef49200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T01:58:50.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:50.131+0000 7fb50ef49200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T01:58:50.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:50.392+0000 7fb50ef49200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T01:58:51.490 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.054+0000 7fb50ef49200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T01:58:51.491 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.175+0000 7fb50ef49200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T01:58:51.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.487+0000 7fb50ef49200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T01:58:51.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.663+0000 7fb50ef49200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T01:58:52.062 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.786+0000 7fb50ef49200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T01:58:52.062 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:51.938+0000 7fb50ef49200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T01:58:52.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:52.058+0000 7fb50ef49200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T01:58:53.336 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:53.053+0000 7fb50ef49200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T01:58:53.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:58:53.332+0000 7fb50ef49200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: Active manager daemon x restarted 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: Activating manager daemon x 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: mgrmap e6: x(active, starting, since 0.00912044s) 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T01:58:53.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T01:58:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:53 smithi137 ceph-mon[28303]: Manager daemon x is now available 2024-04-25T01:58:54.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: Found migration_current of "None". Setting to last migration. 2024-04-25T01:58:54.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:58:54.744 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:54 smithi137 ceph-mon[28303]: mgrmap e7: x(active, since 1.01703s) 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.306+0000 7f6c65600700 1 Processor -- start 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.306+0000 7f6c65600700 1 -- start start 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c65600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c65600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c600634f0 con 0x7f6c60108ae0 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c5ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c5ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48832/0 (socket says 172.21.15.137:48832) 2024-04-25T01:58:55.065 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c5ea00700 1 -- 172.21.15.137:0/3512349501 learned_addr learned my addr 172.21.15.137:0/3512349501 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.307+0000 7f6c5ea00700 1 -- 172.21.15.137:0/3512349501 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6010b410 con 0x7f6c60108ae0 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c5ea00700 1 --2- 172.21.15.137:0/3512349501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c500098a0 tx=0x7f6c50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1f77e79176dc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c5d600700 1 -- 172.21.15.137:0/3512349501 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c50004160 con 0x7f6c60108ae0 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c5d600700 1 -- 172.21.15.137:0/3512349501 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6c50004300 con 0x7f6c60108ae0 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c5d600700 1 -- 172.21.15.137:0/3512349501 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c50011c00 con 0x7f6c60108ae0 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c65600700 1 -- 172.21.15.137:0/3512349501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 msgr2=0x7f6c6010aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.308+0000 7f6c65600700 1 --2- 172.21.15.137:0/3512349501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c500098a0 tx=0x7f6c50009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.066 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.309+0000 7f6c65600700 1 -- 172.21.15.137:0/3512349501 shutdown_connections 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.309+0000 7f6c65600700 1 --2- 172.21.15.137:0/3512349501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6010aed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.309+0000 7f6c65600700 1 -- 172.21.15.137:0/3512349501 >> 172.21.15.137:0/3512349501 conn(0x7f6c601024f0 msgr2=0x7f6c60104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.309+0000 7f6c65600700 1 -- 172.21.15.137:0/3512349501 shutdown_connections 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.309+0000 7f6c65600700 1 -- 172.21.15.137:0/3512349501 wait complete. 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.310+0000 7f6c65600700 1 Processor -- start 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.310+0000 7f6c65600700 1 -- start start 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.310+0000 7f6c65600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.310+0000 7f6c65600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6010c440 con 0x7f6c60108ae0 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.311+0000 7f6c5ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.311+0000 7f6c5ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48846/0 (socket says 172.21.15.137:48846) 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.311+0000 7f6c5ea00700 1 -- 172.21.15.137:0/3024186587 learned_addr learned my addr 172.21.15.137:0/3024186587 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.311+0000 7f6c5ea00700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6019c4d0 con 0x7f6c60108ae0 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.311+0000 7f6c5ea00700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c50011bd0 tx=0x7f6c50011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:55.067 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.312+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c50003b20 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.312+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6019c760 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.312+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6c50003cc0 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.312+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c50024930 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.312+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6019f450 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f6c50022020 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c57400700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6c4403bc70 con 0x7f6c440390a0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c5004cda0 con 0x7f6c60108ae0 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c5e000700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.313+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.515+0000 7f6c5e000700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.515+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:58:55.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.916+0000 7f6c5e000700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:47.916+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:48.717+0000 7f6c5e000700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:48.717+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:50.319+0000 7f6c5e000700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/3009931509 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:50.319+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:53.342+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f6c5001a950 con 0x7f6c60108ae0 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:53.342+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 msgr2=0x7f6c4403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:53.342+0000 7f6c57400700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.346+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f6c5004e3c0 con 0x7f6c60108ae0 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.347+0000 7f6c57400700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 0x7f6c4403edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.347+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6c5000af30 con 0x7f6c4403c9d0 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.349+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 0x7f6c4403edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:55.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.353+0000 7f6c5e000700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 0x7f6c4403edc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003a10 tx=0x7f6c4c0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.355+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f6c5000af30 con 0x7f6c4403c9d0 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.363+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6c60063890 con 0x7f6c4403c9d0 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.364+0000 7f6c57400700 1 -- 172.21.15.137:0/3024186587 <== mgr.14120 v2:172.21.15.137:6800/1454150812 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f6c60063890 con 0x7f6c4403c9d0 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 msgr2=0x7f6c4403edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 0x7f6c4403edc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c003a10 tx=0x7f6c4c0092b0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 msgr2=0x7f6c6019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c50011bd0 tx=0x7f6c50011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 shutdown_connections 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f6c4403c9d0 0x7f6c4403edc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c60108ae0 0x7f6c6019bf90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 --2- 172.21.15.137:0/3024186587 >> [v2:172.21.15.137:6800/3009931509,v1:172.21.15.137:6801/3009931509] conn(0x7f6c440390a0 0x7f6c4403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 >> 172.21.15.137:0/3024186587 conn(0x7f6c601024f0 msgr2=0x7f6c60102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:55.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 shutdown_connections 2024-04-25T01:58:55.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:54.365+0000 7f6c65600700 1 -- 172.21.15.137:0/3024186587 wait complete. 2024-04-25T01:58:55.071 INFO:teuthology.orchestra.run.smithi137.stdout:mgr epoch 5 is available 2024-04-25T01:58:55.071 INFO:teuthology.orchestra.run.smithi137.stdout:Setting orchestrator backend to cephadm... 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: [25/Apr/2024:01:58:54] ENGINE Bus STARTING 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: [25/Apr/2024:01:58:54] ENGINE Serving on http://172.21.15.137:8765 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: [25/Apr/2024:01:58:54] ENGINE Serving on https://172.21.15.137:7150 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: [25/Apr/2024:01:58:54] ENGINE Bus STARTED 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T01:58:55.627 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:55 smithi137 ceph-mon[28303]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T01:58:56.688 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:56 smithi137 ceph-mon[28303]: mgrmap e8: x(active, since 2s) 2024-04-25T01:58:56.689 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:56 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:58:56.689 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:56 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:58:56.698 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.659+0000 7f9401c00700 1 Processor -- start 2024-04-25T01:58:56.699 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.659+0000 7f9401c00700 1 -- start start 2024-04-25T01:58:56.699 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.659+0000 7f9401c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:56.699 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.659+0000 7f9401c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc10efe0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.699 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.660+0000 7f93faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.660+0000 7f93faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33256/0 (socket says 172.21.15.137:33256) 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.660+0000 7f93faa00700 1 -- 172.21.15.137:0/3843162685 learned_addr learned my addr 172.21.15.137:0/3843162685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.660+0000 7f93faa00700 1 -- 172.21.15.137:0/3843162685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc10f7f0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.660+0000 7f93faa00700 1 --2- 172.21.15.137:0/3843162685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea919b7e50af84a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.661+0000 7f93f9600700 1 -- 172.21.15.137:0/3843162685 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec004160 con 0x7f93fc10e5f0 2024-04-25T01:58:56.700 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.661+0000 7f93f9600700 1 -- 172.21.15.137:0/3843162685 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f93ec004300 con 0x7f93fc10e5f0 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.661+0000 7f93f9600700 1 -- 172.21.15.137:0/3843162685 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec011c00 con 0x7f93fc10e5f0 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.661+0000 7f9401c00700 1 -- 172.21.15.137:0/3843162685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 msgr2=0x7f93fc10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.661+0000 7f9401c00700 1 --2- 172.21.15.137:0/3843162685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.662+0000 7f9401c00700 1 -- 172.21.15.137:0/3843162685 shutdown_connections 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.662+0000 7f9401c00700 1 --2- 172.21.15.137:0/3843162685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc10ea10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.662+0000 7f9401c00700 1 -- 172.21.15.137:0/3843162685 >> 172.21.15.137:0/3843162685 conn(0x7f93fc07d580 msgr2=0x7f93fc07fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.662+0000 7f9401c00700 1 -- 172.21.15.137:0/3843162685 shutdown_connections 2024-04-25T01:58:56.702 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.662+0000 7f9401c00700 1 -- 172.21.15.137:0/3843162685 wait complete. 2024-04-25T01:58:56.703 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.663+0000 7f9401c00700 1 Processor -- start 2024-04-25T01:58:56.703 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.663+0000 7f9401c00700 1 -- start start 2024-04-25T01:58:56.703 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.663+0000 7f9401c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:56.703 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.663+0000 7f9401c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc112ba0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.703 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.663+0000 7f93faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.664+0000 7f93faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33266/0 (socket says 172.21.15.137:33266) 2024-04-25T01:58:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.664+0000 7f93faa00700 1 -- 172.21.15.137:0/2724897945 learned_addr learned my addr 172.21.15.137:0/2724897945 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.664+0000 7f93faa00700 1 -- 172.21.15.137:0/2724897945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc1a2b10 con 0x7f93fc10e5f0 2024-04-25T01:58:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.664+0000 7f93faa00700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c00 tx=0x7f93ec011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.664+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec003b20 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.665+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f93ec003cc0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.665+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc1a2da0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.665+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0249a0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.665+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1a5a90 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.666+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f93ec022020 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.666+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc112d20 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.666+0000 7f93f3400700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 0x7f93e003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.666+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f93ec04d150 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.667+0000 7f93fa000700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 0x7f93e003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.667+0000 7f93fa000700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 0x7f93e003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.672+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f93ec04caa0 con 0x7f93fc10e5f0 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.915+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f93fc07e770 con 0x7f93e0039050 2024-04-25T01:58:56.707 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.923+0000 7f93f3400700 1 -- 172.21.15.137:0/2724897945 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f93fc07e770 con 0x7f93e0039050 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.926+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 msgr2=0x7f93e003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.926+0000 7f9401c00700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 0x7f93e003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8006e40 comp rx=0 tx=0).stop 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.926+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 msgr2=0x7f93fc1a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.926+0000 7f9401c00700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c00 tx=0x7f93ec011c80 comp rx=0 tx=0).stop 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 shutdown_connections 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f93e0039050 0x7f93e003b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 --2- 172.21.15.137:0/2724897945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f93fc10e5f0 0x7f93fc1a25d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 >> 172.21.15.137:0/2724897945 conn(0x7f93fc07d580 msgr2=0x7f93fc07e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 shutdown_connections 2024-04-25T01:58:56.708 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:55.927+0000 7f9401c00700 1 -- 172.21.15.137:0/2724897945 wait complete. 2024-04-25T01:58:57.550 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:57 smithi137 ceph-mon[28303]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:58:58.260 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.284+0000 7fa0a9400700 1 Processor -- start 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.284+0000 7fa0a9400700 1 -- start start 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.284+0000 7fa0a9400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.285+0000 7fa0a9400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a407c860 con 0x7fa0a407de20 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.285+0000 7fa0a2800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.285+0000 7fa0a2800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33268/0 (socket says 172.21.15.137:33268) 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.285+0000 7fa0a2800700 1 -- 172.21.15.137:0/1994197653 learned_addr learned my addr 172.21.15.137:0/1994197653 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.286+0000 7fa0a2800700 1 -- 172.21.15.137:0/1994197653 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a407c9e0 con 0x7fa0a407de20 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.286+0000 7fa0a2800700 1 --2- 172.21.15.137:0/1994197653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0940098a0 tx=0x7fa094009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61761a159b7e36ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.286+0000 7fa0a1400700 1 -- 172.21.15.137:0/1994197653 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa094004160 con 0x7fa0a407de20 2024-04-25T01:58:58.261 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.286+0000 7fa0a1400700 1 -- 172.21.15.137:0/1994197653 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa094004300 con 0x7fa0a407de20 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.286+0000 7fa0a1400700 1 -- 172.21.15.137:0/1994197653 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa094011c00 con 0x7fa0a407de20 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 -- 172.21.15.137:0/1994197653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 msgr2=0x7fa0a407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 --2- 172.21.15.137:0/1994197653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0940098a0 tx=0x7fa094009bb0 comp rx=0 tx=0).stop 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 -- 172.21.15.137:0/1994197653 shutdown_connections 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 --2- 172.21.15.137:0/1994197653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a407c320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 -- 172.21.15.137:0/1994197653 >> 172.21.15.137:0/1994197653 conn(0x7fa0a4103670 msgr2=0x7fa0a4105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 -- 172.21.15.137:0/1994197653 shutdown_connections 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.287+0000 7fa0a9400700 1 -- 172.21.15.137:0/1994197653 wait complete. 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.288+0000 7fa0a9400700 1 Processor -- start 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a9400700 1 -- start start 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a9400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a9400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a410e640 con 0x7fa0a407de20 2024-04-25T01:58:58.262 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a2800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a2800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33274/0 (socket says 172.21.15.137:33274) 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a2800700 1 -- 172.21.15.137:0/3397753017 learned_addr learned my addr 172.21.15.137:0/3397753017 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.289+0000 7fa0a2800700 1 -- 172.21.15.137:0/3397753017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a419e750 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa0a2800700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa094011bd0 tx=0x7fa094011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa094003970 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa094003b10 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a419e9e0 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0940245a0 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.290+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a41a16d0 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.291+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa09401a430 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.291+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a4063890 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.292+0000 7fa09b400700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 0x7fa08803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.292+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa09404d2d0 con 0x7fa0a407de20 2024-04-25T01:58:58.263 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.292+0000 7fa0a1e00700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 0x7fa08803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.293+0000 7fa0a1e00700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 0x7fa08803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa090006fd0 tx=0x7fa090006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.298+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa09404cc20 con 0x7fa0a407de20 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.525+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa0a4104950 con 0x7fa0880390a0 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.526+0000 7fa09b400700 1 -- 172.21.15.137:0/3397753017 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa0a4104950 con 0x7fa0880390a0 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 msgr2=0x7fa08803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 0x7fa08803b560 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa090006fd0 tx=0x7fa090006e40 comp rx=0 tx=0).stop 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 msgr2=0x7fa0a419e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa094011bd0 tx=0x7fa094011cb0 comp rx=0 tx=0).stop 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 shutdown_connections 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fa0880390a0 0x7fa08803b560 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 --2- 172.21.15.137:0/3397753017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0a407de20 0x7fa0a419e210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:58:58.265 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.529+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 >> 172.21.15.137:0/3397753017 conn(0x7fa0a4103670 msgr2=0x7fa0a4104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:58:58.265 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.530+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 shutdown_connections 2024-04-25T01:58:58.265 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:57.530+0000 7fa0a9400700 1 -- 172.21.15.137:0/3397753017 wait complete. 2024-04-25T01:58:58.265 INFO:teuthology.orchestra.run.smithi137.stdout:Generating ssh key... 2024-04-25T01:58:58.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:58:58 smithi137 ceph-mon[28303]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:58:59.705 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: Generating public/private rsa key pair. 2024-04-25T01:58:59.705 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: Your identification has been saved in /tmp/tmpv88i_1uj/key. 2024-04-25T01:58:59.705 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: Your public key has been saved in /tmp/tmpv88i_1uj/key.pub. 2024-04-25T01:58:59.705 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: The key fingerprint is: 2024-04-25T01:58:59.705 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: SHA256:+fWjdNyTLOqrcSs2flfy5i0rddSssB5GGJQgqYXzjyc ceph-19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: The key's randomart image is: 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: +---[RSA 3072]----+ 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | ....o.. | 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | o o. o | 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | = o ..| 2024-04-25T01:58:59.706 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | . . .. o +| 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | oS ..o o | 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | E o. .+++oo| 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | o ..+.+O=.| 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | +oo=+o+o| 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: | oo*=+.++.| 2024-04-25T01:58:59.707 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:58:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: +----[SHA256]-----+ 2024-04-25T01:59:00.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.868+0000 7fea24c00700 1 Processor -- start 2024-04-25T01:59:00.068 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.869+0000 7fea24c00700 1 -- start start 2024-04-25T01:59:00.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.869+0000 7fea24c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:00.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.869+0000 7fea24c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea2007b7c0 con 0x7fea2007cd90 2024-04-25T01:59:00.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.870+0000 7fea1de00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:00.069 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.870+0000 7fea1de00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33284/0 (socket says 172.21.15.137:33284) 2024-04-25T01:59:00.070 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.870+0000 7fea1de00700 1 -- 172.21.15.137:0/2627939438 learned_addr learned my addr 172.21.15.137:0/2627939438 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.870+0000 7fea1de00700 1 -- 172.21.15.137:0/2627939438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2007b940 con 0x7fea2007cd90 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.871+0000 7fea1de00700 1 --2- 172.21.15.137:0/2627939438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea100098a0 tx=0x7fea10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bde0e934fdf911 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.871+0000 7fea1ca00700 1 -- 172.21.15.137:0/2627939438 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea10004160 con 0x7fea2007cd90 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.871+0000 7fea1ca00700 1 -- 172.21.15.137:0/2627939438 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fea10004300 con 0x7fea2007cd90 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.871+0000 7fea1ca00700 1 -- 172.21.15.137:0/2627939438 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea10011c00 con 0x7fea2007cd90 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 -- 172.21.15.137:0/2627939438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 msgr2=0x7fea2007b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:00.071 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 --2- 172.21.15.137:0/2627939438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea100098a0 tx=0x7fea10009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:00.072 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 -- 172.21.15.137:0/2627939438 shutdown_connections 2024-04-25T01:59:00.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 --2- 172.21.15.137:0/2627939438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2007b1f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:00.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 -- 172.21.15.137:0/2627939438 >> 172.21.15.137:0/2627939438 conn(0x7fea201035c0 msgr2=0x7fea20105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:00.073 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 -- 172.21.15.137:0/2627939438 shutdown_connections 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.872+0000 7fea24c00700 1 -- 172.21.15.137:0/2627939438 wait complete. 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.873+0000 7fea24c00700 1 Processor -- start 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.873+0000 7fea24c00700 1 -- start start 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.873+0000 7fea24c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.873+0000 7fea24c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea2010e670 con 0x7fea2007cd90 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.874+0000 7fea1de00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.874+0000 7fea1de00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33300/0 (socket says 172.21.15.137:33300) 2024-04-25T01:59:00.074 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.874+0000 7fea1de00700 1 -- 172.21.15.137:0/960711174 learned_addr learned my addr 172.21.15.137:0/960711174 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.874+0000 7fea1de00700 1 -- 172.21.15.137:0/960711174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2019e760 con 0x7fea2007cd90 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.874+0000 7fea1de00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea10000c00 tx=0x7fea10011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.875+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea10003b20 con 0x7fea2007cd90 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.875+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fea10003cc0 con 0x7fea2007cd90 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.875+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea100249a0 con 0x7fea2007cd90 2024-04-25T01:59:00.077 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.875+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2019e9f0 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.875+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a16e0 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.876+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea20063890 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.876+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fea10022020 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.876+0000 7fea16a00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 0x7fea0403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.877+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea1004d040 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.877+0000 7fea1d400700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 0x7fea0403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.877+0000 7fea1d400700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 0x7fea0403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006fd0 tx=0x7fea0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:58.882+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fea1002c560 con 0x7fea2007cd90 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.103+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fea20104820 con 0x7fea040390a0 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.331+0000 7fea16a00700 1 -- 172.21.15.137:0/960711174 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fea20104820 con 0x7fea040390a0 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 msgr2=0x7fea0403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 0x7fea0403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006fd0 tx=0x7fea0c006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:00.078 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 msgr2=0x7fea2019e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea10000c00 tx=0x7fea10011c80 comp rx=0 tx=0).stop 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 shutdown_connections 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fea040390a0 0x7fea0403b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 --2- 172.21.15.137:0/960711174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea2007cd90 0x7fea2019e220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 >> 172.21.15.137:0/960711174 conn(0x7fea201035c0 msgr2=0x7fea20104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 shutdown_connections 2024-04-25T01:59:00.079 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:58:59.334+0000 7fea24c00700 1 -- 172.21.15.137:0/960711174 wait complete. 2024-04-25T01:59:00.643 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:00 smithi137 ceph-mon[28303]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:00.643 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:00 smithi137 ceph-mon[28303]: Generating ssh key... 2024-04-25T01:59:00.643 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:00 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:00.644 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:00 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:01.539 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.640+0000 7f5039a00700 1 Processor -- start 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.640+0000 7f5039a00700 1 -- start start 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.640+0000 7f5039a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.640+0000 7f5039a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5034108a10 con 0x7f5034108020 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.641+0000 7f5032a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.641+0000 7f5032a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33310/0 (socket says 172.21.15.137:33310) 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.641+0000 7f5032a00700 1 -- 172.21.15.137:0/975780180 learned_addr learned my addr 172.21.15.137:0/975780180 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.641+0000 7f5032a00700 1 -- 172.21.15.137:0/975780180 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5034109220 con 0x7f5034108020 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.642+0000 7f5032a00700 1 --2- 172.21.15.137:0/975780180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50240098a0 tx=0x7f5024009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c23173c1726477 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.642+0000 7f5032000700 1 -- 172.21.15.137:0/975780180 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5024004160 con 0x7f5034108020 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.642+0000 7f5032000700 1 -- 172.21.15.137:0/975780180 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5024004300 con 0x7f5034108020 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.642+0000 7f5032000700 1 -- 172.21.15.137:0/975780180 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5024011c00 con 0x7f5034108020 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 -- 172.21.15.137:0/975780180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 msgr2=0x7f5034108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:01.540 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 --2- 172.21.15.137:0/975780180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50240098a0 tx=0x7f5024009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 -- 172.21.15.137:0/975780180 shutdown_connections 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 --2- 172.21.15.137:0/975780180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f5034108440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 -- 172.21.15.137:0/975780180 >> 172.21.15.137:0/975780180 conn(0x7f50341035c0 msgr2=0x7f5034105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 -- 172.21.15.137:0/975780180 shutdown_connections 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.643+0000 7f5039a00700 1 -- 172.21.15.137:0/975780180 wait complete. 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.644+0000 7f5039a00700 1 Processor -- start 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.644+0000 7f5039a00700 1 -- start start 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5039a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5039a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f503410c5d0 con 0x7f5034108020 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5032a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5032a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33312/0 (socket says 172.21.15.137:33312) 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5032a00700 1 -- 172.21.15.137:0/3842313980 learned_addr learned my addr 172.21.15.137:0/3842313980 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.645+0000 7f5032a00700 1 -- 172.21.15.137:0/3842313980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503407cf80 con 0x7f5034108020 2024-04-25T01:59:01.541 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f5032a00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5024000c00 tx=0x7f5024011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5024003b20 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503407b170 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5024003cc0 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50240249a0 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.646+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f503407b6b0 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.647+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5034063890 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.647+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5024022020 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.648+0000 7f502b400700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 0x7f501803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.648+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f502404d130 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.648+0000 7f502be00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 0x7f501803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.649+0000 7f502be00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 0x7f501803b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f501c006fd0 tx=0x7f501c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.657+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f50240042a0 con 0x7f5034108020 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.882+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f50341047c0 con 0x7f5018039050 2024-04-25T01:59:01.542 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.883+0000 7f502b400700 1 -- 172.21.15.137:0/3842313980 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f50341047c0 con 0x7f5018039050 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 msgr2=0x7f501803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 0x7f501803b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f501c006fd0 tx=0x7f501c006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 msgr2=0x7f503407ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5024000c00 tx=0x7f5024011c80 comp rx=0 tx=0).stop 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 shutdown_connections 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5018039050 0x7f501803b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 --2- 172.21.15.137:0/3842313980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5034108020 0x7f503407ca40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 >> 172.21.15.137:0/3842313980 conn(0x7f50341035c0 msgr2=0x7f50341040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 shutdown_connections 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:00.886+0000 7f5039a00700 1 -- 172.21.15.137:0/3842313980 wait complete. 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T01:59:01.543 INFO:teuthology.orchestra.run.smithi137.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T01:59:01.544 INFO:teuthology.orchestra.run.smithi137.stdout:Adding host smithi137... 2024-04-25T01:59:01.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:01 smithi137 ceph-mon[28303]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:02.728 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:02 smithi137 ceph-mon[28303]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "addr": "172.21.15.137", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:04.779 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:04 smithi137 ceph-mon[28303]: Deploying cephadm binary to smithi137 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Added host 'smithi137' with addr '172.21.15.137' 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.158+0000 7f19fcc00700 1 Processor -- start 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.159+0000 7f19fcc00700 1 -- start start 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.159+0000 7f19fcc00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.159+0000 7f19fcc00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810abf0 con 0x7f19f810a200 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.160+0000 7f19f5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.160+0000 7f19f5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45092/0 (socket says 172.21.15.137:45092) 2024-04-25T01:59:08.954 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.160+0000 7f19f5e00700 1 -- 172.21.15.137:0/2700652396 learned_addr learned my addr 172.21.15.137:0/2700652396 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.160+0000 7f19f5e00700 1 -- 172.21.15.137:0/2700652396 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f810b400 con 0x7f19f810a200 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19f5e00700 1 --2- 172.21.15.137:0/2700652396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098a0 tx=0x7f19e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8782d12d9cdd1632 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19f4a00700 1 -- 172.21.15.137:0/2700652396 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e8004160 con 0x7f19f810a200 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19f4a00700 1 -- 172.21.15.137:0/2700652396 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f19e8004300 con 0x7f19f810a200 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19f4a00700 1 -- 172.21.15.137:0/2700652396 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e8011c00 con 0x7f19f810a200 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19fcc00700 1 -- 172.21.15.137:0/2700652396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 msgr2=0x7f19f810a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.161+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2700652396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098a0 tx=0x7f19e8009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.162+0000 7f19fcc00700 1 -- 172.21.15.137:0/2700652396 shutdown_connections 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.162+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2700652396 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f810a620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.162+0000 7f19fcc00700 1 -- 172.21.15.137:0/2700652396 >> 172.21.15.137:0/2700652396 conn(0x7f19f8105760 msgr2=0x7f19f8107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.162+0000 7f19fcc00700 1 -- 172.21.15.137:0/2700652396 shutdown_connections 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.162+0000 7f19fcc00700 1 -- 172.21.15.137:0/2700652396 wait complete. 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.163+0000 7f19fcc00700 1 Processor -- start 2024-04-25T01:59:08.955 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.163+0000 7f19fcc00700 1 -- start start 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.163+0000 7f19fcc00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.163+0000 7f19fcc00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19f810e7b0 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19f5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19f5e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45096/0 (socket says 172.21.15.137:45096) 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19f5e00700 1 -- 172.21.15.137:0/2915034165 learned_addr learned my addr 172.21.15.137:0/2915034165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19f5e00700 1 -- 172.21.15.137:0/2915034165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f819e720 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19f5e00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e8003b20 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.164+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f19e8003cc0 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.165+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f819e9b0 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.165+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e80249a0 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.165+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f81a16a0 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.166+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f810e930 con 0x7f19f810a200 2024-04-25T01:59:08.956 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.166+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f19e8022020 con 0x7f19f810a200 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.166+0000 7f19eea00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 0x7f19dc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.166+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f19e804d160 con 0x7f19f810a200 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.167+0000 7f19f5400700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 0x7f19dc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.167+0000 7f19f5400700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 0x7f19dc03b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.171+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f19e8019e10 con 0x7f19f810a200 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:02.397+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi137", "addr": "172.21.15.137", "target": ["mon-mgr", ""]}) -- 0x7f19f8106980 con 0x7f19dc039050 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.243+0000 7f19eea00700 1 -- 172.21.15.137:0/2915034165 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f19f8106980 con 0x7f19dc039050 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 msgr2=0x7f19dc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:08.957 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 0x7f19dc03b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 msgr2=0x7f19f819e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8000c00 tx=0x7f19e8011c80 comp rx=0 tx=0).stop 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 shutdown_connections 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f19dc039050 0x7f19dc03b510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 --2- 172.21.15.137:0/2915034165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19f810a200 0x7f19f819e1e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.247+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 >> 172.21.15.137:0/2915034165 conn(0x7f19f8105760 msgr2=0x7f19f8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.248+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 shutdown_connections 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:08.248+0000 7f19fcc00700 1 -- 172.21.15.137:0/2915034165 wait complete. 2024-04-25T01:59:08.958 INFO:teuthology.orchestra.run.smithi137.stdout:Deploying unmanaged mon service... 2024-04-25T01:59:09.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:09 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:09.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:09 smithi137 ceph-mon[28303]: Added host smithi137 2024-04-25T01:59:09.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:09 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:10.442 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T01:59:10.442 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.535+0000 7f4ae3200700 1 Processor -- start 2024-04-25T01:59:10.443 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.535+0000 7f4ae3200700 1 -- start start 2024-04-25T01:59:10.443 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.535+0000 7f4ae3200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:10.443 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.535+0000 7f4ae3200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc07b780 con 0x7f4adc07cd50 2024-04-25T01:59:10.443 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.536+0000 7f4adbe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:10.444 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.536+0000 7f4adbe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45112/0 (socket says 172.21.15.137:45112) 2024-04-25T01:59:10.444 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.536+0000 7f4adbe00700 1 -- 172.21.15.137:0/1402048522 learned_addr learned my addr 172.21.15.137:0/1402048522 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.536+0000 7f4adbe00700 1 -- 172.21.15.137:0/1402048522 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc07b900 con 0x7f4adc07cd50 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.536+0000 7f4adbe00700 1 --2- 172.21.15.137:0/1402048522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0098a0 tx=0x7f4acc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e49fbac7d2d5c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4adaa00700 1 -- 172.21.15.137:0/1402048522 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc004160 con 0x7f4adc07cd50 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4adaa00700 1 -- 172.21.15.137:0/1402048522 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4acc004300 con 0x7f4adc07cd50 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4adaa00700 1 -- 172.21.15.137:0/1402048522 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc011c00 con 0x7f4adc07cd50 2024-04-25T01:59:10.445 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4ae3200700 1 -- 172.21.15.137:0/1402048522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 msgr2=0x7f4adc07b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:10.446 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4ae3200700 1 --2- 172.21.15.137:0/1402048522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0098a0 tx=0x7f4acc009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:10.446 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4ae3200700 1 -- 172.21.15.137:0/1402048522 shutdown_connections 2024-04-25T01:59:10.446 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4ae3200700 1 --2- 172.21.15.137:0/1402048522 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc07b1b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:10.446 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.537+0000 7f4ae3200700 1 -- 172.21.15.137:0/1402048522 >> 172.21.15.137:0/1402048522 conn(0x7f4adc1035c0 msgr2=0x7f4adc105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:10.447 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.538+0000 7f4ae3200700 1 -- 172.21.15.137:0/1402048522 shutdown_connections 2024-04-25T01:59:10.447 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.538+0000 7f4ae3200700 1 -- 172.21.15.137:0/1402048522 wait complete. 2024-04-25T01:59:10.447 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4ae3200700 1 Processor -- start 2024-04-25T01:59:10.447 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4ae3200700 1 -- start start 2024-04-25T01:59:10.448 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4ae3200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:10.448 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4ae3200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc10e6b0 con 0x7f4adc07cd50 2024-04-25T01:59:10.448 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4adbe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:10.448 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4adbe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45118/0 (socket says 172.21.15.137:45118) 2024-04-25T01:59:10.449 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.539+0000 7f4adbe00700 1 -- 172.21.15.137:0/3624242636 learned_addr learned my addr 172.21.15.137:0/3624242636 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:10.449 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4adbe00700 1 -- 172.21.15.137:0/3624242636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc19e700 con 0x7f4adc07cd50 2024-04-25T01:59:10.449 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4adbe00700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4acc011bd0 tx=0x7f4acc011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc003b20 con 0x7f4adc07cd50 2024-04-25T01:59:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f4acc003cc0 con 0x7f4adc07cd50 2024-04-25T01:59:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc19e990 con 0x7f4adc07cd50 2024-04-25T01:59:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4acc024930 con 0x7f4adc07cd50 2024-04-25T01:59:10.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.540+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc1a1680 con 0x7f4adc07cd50 2024-04-25T01:59:10.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.541+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4acc022020 con 0x7f4adc07cd50 2024-04-25T01:59:10.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.542+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc063890 con 0x7f4adc07cd50 2024-04-25T01:59:10.451 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.542+0000 7f4ad8c00700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 0x7f4ac003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.542+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4acc04d260 con 0x7f4adc07cd50 2024-04-25T01:59:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.542+0000 7f4adb400700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 0x7f4ac003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.543+0000 7f4adb400700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 0x7f4ac003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8006fd0 tx=0x7f4ac8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.548+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4acc04cbf0 con 0x7f4adc07cd50 2024-04-25T01:59:10.452 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.772+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4adc1047b0 con 0x7f4ac00390a0 2024-04-25T01:59:10.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.783+0000 7f4ad8c00700 1 -- 172.21.15.137:0/3624242636 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4adc1047b0 con 0x7f4ac00390a0 2024-04-25T01:59:10.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.785+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 msgr2=0x7f4ac003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:10.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.785+0000 7f4ae3200700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 0x7f4ac003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8006fd0 tx=0x7f4ac8006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:10.453 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.785+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 msgr2=0x7f4adc19e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.785+0000 7f4ae3200700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4acc011bd0 tx=0x7f4acc011cb0 comp rx=0 tx=0).stop 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 shutdown_connections 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f4ac00390a0 0x7f4ac003b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 --2- 172.21.15.137:0/3624242636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4adc07cd50 0x7f4adc19e1c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 >> 172.21.15.137:0/3624242636 conn(0x7f4adc1035c0 msgr2=0x7f4adc1040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:10.454 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 shutdown_connections 2024-04-25T01:59:10.455 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:09.786+0000 7f4ae3200700 1 -- 172.21.15.137:0/3624242636 wait complete. 2024-04-25T01:59:10.455 INFO:teuthology.orchestra.run.smithi137.stdout:Deploying unmanaged mgr service... 2024-04-25T01:59:10.961 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:10 smithi137 ceph-mon[28303]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:10.961 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:10 smithi137 ceph-mon[28303]: Saving service mon spec with placement count:5 2024-04-25T01:59:10.962 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:10 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:12.671 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T01:59:12.672 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.268+0000 7f13c5800700 1 Processor -- start 2024-04-25T01:59:12.672 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.268+0000 7f13c5800700 1 -- start start 2024-04-25T01:59:12.672 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13c5800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13c5800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010abf0 con 0x7f13c010a200 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13bea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13bea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46568/0 (socket says 172.21.15.137:46568) 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13bea00700 1 -- 172.21.15.137:0/732347803 learned_addr learned my addr 172.21.15.137:0/732347803 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.269+0000 7f13bea00700 1 -- 172.21.15.137:0/732347803 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c010b400 con 0x7f13c010a200 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.270+0000 7f13bea00700 1 --2- 172.21.15.137:0/732347803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098a0 tx=0x7f13b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df77a372d14cf78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.270+0000 7f13bd600700 1 -- 172.21.15.137:0/732347803 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0004160 con 0x7f13c010a200 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.270+0000 7f13bd600700 1 -- 172.21.15.137:0/732347803 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f13b0004300 con 0x7f13c010a200 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.270+0000 7f13bd600700 1 -- 172.21.15.137:0/732347803 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0011c00 con 0x7f13c010a200 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 -- 172.21.15.137:0/732347803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 msgr2=0x7f13c010a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:12.677 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 --2- 172.21.15.137:0/732347803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098a0 tx=0x7f13b0009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 -- 172.21.15.137:0/732347803 shutdown_connections 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 --2- 172.21.15.137:0/732347803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c010a620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 -- 172.21.15.137:0/732347803 >> 172.21.15.137:0/732347803 conn(0x7f13c0105760 msgr2=0x7f13c0107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 -- 172.21.15.137:0/732347803 shutdown_connections 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.271+0000 7f13c5800700 1 -- 172.21.15.137:0/732347803 wait complete. 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.272+0000 7f13c5800700 1 Processor -- start 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.272+0000 7f13c5800700 1 -- start start 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.272+0000 7f13c5800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.272+0000 7f13c5800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c010e7b0 con 0x7f13c010a200 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13bea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13bea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46580/0 (socket says 172.21.15.137:46580) 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13bea00700 1 -- 172.21.15.137:0/4227841100 learned_addr learned my addr 172.21.15.137:0/4227841100 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13bea00700 1 -- 172.21.15.137:0/4227841100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c019e720 con 0x7f13c010a200 2024-04-25T01:59:12.678 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13bea00700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b0003b20 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f13b0003cc0 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.273+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c019e9b0 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.274+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13b00249a0 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.274+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c01a16a0 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.275+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f13b0022020 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.275+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c010e930 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.275+0000 7f13b7400700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 0x7f13a403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.275+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f13b004d070 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.275+0000 7f13be000700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 0x7f13a403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.276+0000 7f13be000700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 0x7f13a403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13ac006fd0 tx=0x7f13ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.280+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f13b00042a0 con 0x7f13c010a200 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.519+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f13c0106980 con 0x7f13a4039050 2024-04-25T01:59:12.679 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.528+0000 7f13b7400700 1 -- 172.21.15.137:0/4227841100 <== mgr.14120 v2:172.21.15.137:6800/1454150812 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f13c0106980 con 0x7f13a4039050 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 msgr2=0x7f13a403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 0x7f13a403b510 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13ac006fd0 tx=0x7f13ac006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 msgr2=0x7f13c019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b0011c80 comp rx=0 tx=0).stop 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 shutdown_connections 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f13a4039050 0x7f13a403b510 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 --2- 172.21.15.137:0/4227841100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c010a200 0x7f13c019e1e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 >> 172.21.15.137:0/4227841100 conn(0x7f13c0105760 msgr2=0x7f13c0106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 shutdown_connections 2024-04-25T01:59:12.680 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:11.531+0000 7f13c5800700 1 -- 172.21.15.137:0/4227841100 wait complete. 2024-04-25T01:59:12.821 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:12 smithi137 ceph-mon[28303]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:12.821 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:12 smithi137 ceph-mon[28303]: Saving service mgr spec with placement count:2 2024-04-25T01:59:12.821 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:12 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:12.821 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:12 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:14.143 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:14 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:14.143 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:14 smithi137 ceph-mon[28303]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:14.143 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:14 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2757480770' entity='client.admin' 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.253+0000 7f5d62800700 1 Processor -- start 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.253+0000 7f5d62800700 1 -- start start 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.254+0000 7f5d62800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.254+0000 7f5d62800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c07b760 con 0x7f5d5c07cd30 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.254+0000 7f5d5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.254+0000 7f5d5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46596/0 (socket says 172.21.15.137:46596) 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.254+0000 7f5d5b400700 1 -- 172.21.15.137:0/1475582322 learned_addr learned my addr 172.21.15.137:0/1475582322 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.255+0000 7f5d5b400700 1 -- 172.21.15.137:0/1475582322 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c07b8e0 con 0x7f5d5c07cd30 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.255+0000 7f5d5b400700 1 --2- 172.21.15.137:0/1475582322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098a0 tx=0x7f5d4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9455ca82c770bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:14.157 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.255+0000 7f5d5aa00700 1 -- 172.21.15.137:0/1475582322 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4c004160 con 0x7f5d5c07cd30 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.255+0000 7f5d5aa00700 1 -- 172.21.15.137:0/1475582322 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d4c004300 con 0x7f5d5c07cd30 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.255+0000 7f5d5aa00700 1 -- 172.21.15.137:0/1475582322 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4c011bb0 con 0x7f5d5c07cd30 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 -- 172.21.15.137:0/1475582322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 msgr2=0x7f5d5c07b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 --2- 172.21.15.137:0/1475582322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098a0 tx=0x7f5d4c009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 -- 172.21.15.137:0/1475582322 shutdown_connections 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 --2- 172.21.15.137:0/1475582322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c07b190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 -- 172.21.15.137:0/1475582322 >> 172.21.15.137:0/1475582322 conn(0x7f5d5c1035b0 msgr2=0x7f5d5c1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 -- 172.21.15.137:0/1475582322 shutdown_connections 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.256+0000 7f5d62800700 1 -- 172.21.15.137:0/1475582322 wait complete. 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.257+0000 7f5d62800700 1 Processor -- start 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.257+0000 7f5d62800700 1 -- start start 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.258+0000 7f5d62800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:14.158 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.258+0000 7f5d62800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c10e690 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.258+0000 7f5d5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.258+0000 7f5d5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46608/0 (socket says 172.21.15.137:46608) 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.258+0000 7f5d5b400700 1 -- 172.21.15.137:0/2757480770 learned_addr learned my addr 172.21.15.137:0/2757480770 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d5b400700 1 -- 172.21.15.137:0/2757480770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c19e6a0 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d5b400700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c000c00 tx=0x7f5d4c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4c011e60 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d4c003b20 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d4c0247a0 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5c19e930 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.259+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5c19ed90 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.260+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5c063890 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.261+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5d4c022020 con 0x7f5d5c07cd30 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.261+0000 7f5d58c00700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 0x7f5d4003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:14.159 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.261+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5d4c04d060 con 0x7f5d5c07cd30 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.261+0000 7f5d53e00700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 0x7f5d4003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.262+0000 7f5d53e00700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 0x7f5d4003b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5d44006fd0 tx=0x7f5d44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.267+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5d4c04c9f0 con 0x7f5d5c07cd30 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.495+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5d5c1a1b70 con 0x7f5d5c07cd30 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.502+0000 7f5d58c00700 1 -- 172.21.15.137:0/2757480770 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f5d4c024940 con 0x7f5d5c07cd30 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 msgr2=0x7f5d4003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 0x7f5d4003b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5d44006fd0 tx=0x7f5d44006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 msgr2=0x7f5d5c19e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c000c00 tx=0x7f5d4c011ca0 comp rx=0 tx=0).stop 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 shutdown_connections 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f5d400390a0 0x7f5d4003b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 --2- 172.21.15.137:0/2757480770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c07cd30 0x7f5d5c19e160 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.505+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 >> 172.21.15.137:0/2757480770 conn(0x7f5d5c1035b0 msgr2=0x7f5d5c104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:14.160 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.506+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 shutdown_connections 2024-04-25T01:59:14.161 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:13.506+0000 7f5d62800700 1 -- 172.21.15.137:0/2757480770 wait complete. 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.724+0000 7f50c1800700 1 Processor -- start 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.724+0000 7f50c1800700 1 -- start start 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50c1800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50c1800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1089e0 con 0x7f50bc107ff0 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50baa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50baa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46620/0 (socket says 172.21.15.137:46620) 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50baa00700 1 -- 172.21.15.137:0/2031392885 learned_addr learned my addr 172.21.15.137:0/2031392885 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.725+0000 7f50baa00700 1 -- 172.21.15.137:0/2031392885 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc1091f0 con 0x7f50bc107ff0 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.726+0000 7f50baa00700 1 --2- 172.21.15.137:0/2031392885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0098a0 tx=0x7f50ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ef802f03d5e579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.726+0000 7f50b9600700 1 -- 172.21.15.137:0/2031392885 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ac004160 con 0x7f50bc107ff0 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.726+0000 7f50b9600700 1 -- 172.21.15.137:0/2031392885 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f50ac004300 con 0x7f50bc107ff0 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.726+0000 7f50b9600700 1 -- 172.21.15.137:0/2031392885 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ac011bb0 con 0x7f50bc107ff0 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 -- 172.21.15.137:0/2031392885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 msgr2=0x7f50bc108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 --2- 172.21.15.137:0/2031392885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0098a0 tx=0x7f50ac009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 -- 172.21.15.137:0/2031392885 shutdown_connections 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 --2- 172.21.15.137:0/2031392885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc108410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 -- 172.21.15.137:0/2031392885 >> 172.21.15.137:0/2031392885 conn(0x7f50bc1035b0 msgr2=0x7f50bc1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 -- 172.21.15.137:0/2031392885 shutdown_connections 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.727+0000 7f50c1800700 1 -- 172.21.15.137:0/2031392885 wait complete. 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.728+0000 7f50c1800700 1 Processor -- start 2024-04-25T01:59:15.666 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.728+0000 7f50c1800700 1 -- start start 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50c1800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50c1800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc10c5a0 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50baa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50baa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46634/0 (socket says 172.21.15.137:46634) 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50baa00700 1 -- 172.21.15.137:0/184438410 learned_addr learned my addr 172.21.15.137:0/184438410 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.729+0000 7f50baa00700 1 -- 172.21.15.137:0/184438410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc19c4f0 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50baa00700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50ac000c00 tx=0x7f50ac004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ac011e60 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc19c780 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f50ac003af0 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50ac0246a0 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.730+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc19cbe0 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.731+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f50ac022020 con 0x7f50bc107ff0 2024-04-25T01:59:15.667 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.731+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc063890 con 0x7f50bc107ff0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.732+0000 7f50b3400700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 0x7f50a003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.732+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f50ac04d0f0 con 0x7f50bc107ff0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.732+0000 7f50ba000700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 0x7f50a003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.733+0000 7f50ba000700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 0x7f50a003b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006fd0 tx=0x7f50a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.737+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f50ac0212c0 con 0x7f50bc107ff0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.963+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f50bc19f470 con 0x7f50bc107ff0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.966+0000 7f50b3400700 1 -- 172.21.15.137:0/184438410 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f50ac01a570 con 0x7f50bc107ff0 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 msgr2=0x7f50a003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 0x7f50a003b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006fd0 tx=0x7f50a8006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 msgr2=0x7f50bc19bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f50ac000c00 tx=0x7f50ac004620 comp rx=0 tx=0).stop 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 shutdown_connections 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7f50a0039050 0x7f50a003b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:15.668 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 --2- 172.21.15.137:0/184438410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50bc107ff0 0x7f50bc19bfb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:15.669 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 >> 172.21.15.137:0/184438410 conn(0x7f50bc1035b0 msgr2=0x7f50bc104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:15.669 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 shutdown_connections 2024-04-25T01:59:15.669 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:14.970+0000 7f50c1800700 1 -- 172.21.15.137:0/184438410 wait complete. 2024-04-25T01:59:15.669 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling the dashboard module... 2024-04-25T01:59:16.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:15 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/184438410' entity='client.admin' 2024-04-25T01:59:16.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:15 smithi137 ceph-mon[28303]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:17.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-mon[28303]: from='mgr.14120 172.21.15.137:0/3588279518' entity='mgr.x' 2024-04-25T01:59:17.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3219875955' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T01:59:17.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setuser ceph since I am not root 2024-04-25T01:59:17.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setgroup ceph since I am not root 2024-04-25T01:59:17.958 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:17.576+0000 7f5a249d7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T01:59:17.958 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:17.818+0000 7f5a249d7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:59:17.958 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:17 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:17.952+0000 7f5a249d7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T01:59:17.974 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.476+0000 7fb7af400700 1 Processor -- start 2024-04-25T01:59:17.974 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.476+0000 7fb7af400700 1 -- start start 2024-04-25T01:59:17.974 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.477+0000 7fb7af400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:17.974 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.477+0000 7fb7af400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a810abf0 con 0x7fb7a810a200 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.477+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.477+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46644/0 (socket says 172.21.15.137:46644) 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.477+0000 7fb7aca00700 1 -- 172.21.15.137:0/2226882877 learned_addr learned my addr 172.21.15.137:0/2226882877 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.478+0000 7fb7aca00700 1 -- 172.21.15.137:0/2226882877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a810b400 con 0x7fb7a810a200 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.478+0000 7fb7aca00700 1 --2- 172.21.15.137:0/2226882877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb7980098a0 tx=0x7fb798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52085154f8075c50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.478+0000 7fb7a7e00700 1 -- 172.21.15.137:0/2226882877 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb798004160 con 0x7fb7a810a200 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.478+0000 7fb7a7e00700 1 -- 172.21.15.137:0/2226882877 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb798004300 con 0x7fb7a810a200 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7a7e00700 1 -- 172.21.15.137:0/2226882877 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb798011bb0 con 0x7fb7a810a200 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7af400700 1 -- 172.21.15.137:0/2226882877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 msgr2=0x7fb7a810a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7af400700 1 --2- 172.21.15.137:0/2226882877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb7980098a0 tx=0x7fb798009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7af400700 1 -- 172.21.15.137:0/2226882877 shutdown_connections 2024-04-25T01:59:17.975 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7af400700 1 --2- 172.21.15.137:0/2226882877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a810a620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.479+0000 7fb7af400700 1 -- 172.21.15.137:0/2226882877 >> 172.21.15.137:0/2226882877 conn(0x7fb7a8105760 msgr2=0x7fb7a8107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.480+0000 7fb7af400700 1 -- 172.21.15.137:0/2226882877 shutdown_connections 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.480+0000 7fb7af400700 1 -- 172.21.15.137:0/2226882877 wait complete. 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7af400700 1 Processor -- start 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7af400700 1 -- start start 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7af400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7af400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a810e7b0 con 0x7fb7a810a200 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46646/0 (socket says 172.21.15.137:46646) 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.481+0000 7fb7aca00700 1 -- 172.21.15.137:0/3219875955 learned_addr learned my addr 172.21.15.137:0/3219875955 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7aca00700 1 -- 172.21.15.137:0/3219875955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a819e6d0 con 0x7fb7a810a200 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7aca00700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb798000c00 tx=0x7fb798004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:17.976 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb798011e60 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb798003af0 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7980246a0 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.482+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a819e960 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.483+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a819edc0 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.484+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a8063890 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.484+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb798022020 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.485+0000 7fb7a6000700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 0x7fb78c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.485+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb79804d120 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.485+0000 7fb79fe00700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 0x7fb78c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.486+0000 7fb79fe00700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 0x7fb78c03b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb790006fd0 tx=0x7fb790006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.490+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fb79802a2a0 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:16.777+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb7a81a1790 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.266+0000 7fb7a6000700 1 -- 172.21.15.137:0/3219875955 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb79804ca70 con 0x7fb7a810a200 2024-04-25T01:59:17.977 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.270+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 msgr2=0x7fb78c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.270+0000 7fb7af400700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 0x7fb78c03b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb790006fd0 tx=0x7fb790006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.270+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 msgr2=0x7fb7a819e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.270+0000 7fb7af400700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb798000c00 tx=0x7fb798004620 comp rx=0 tx=0).stop 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.271+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 shutdown_connections 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.271+0000 7fb7af400700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7fb78c0390a0 0x7fb78c03b560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.271+0000 7fb7af400700 1 --2- 172.21.15.137:0/3219875955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7a810a200 0x7fb7a819e190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.271+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 >> 172.21.15.137:0/3219875955 conn(0x7fb7a8105760 msgr2=0x7fb7a8106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.271+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 shutdown_connections 2024-04-25T01:59:17.978 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:17.272+0000 7fb7af400700 1 -- 172.21.15.137:0/3219875955 wait complete. 2024-04-25T01:59:18.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:18 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3219875955' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T01:59:18.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:18 smithi137 ceph-mon[28303]: mgrmap e9: x(active, since 23s) 2024-04-25T01:59:18.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:18 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:18.391+0000 7f5a249d7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T01:59:18.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:18 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:18.506+0000 7f5a249d7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T01:59:19.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:19 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2696821820' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T01:59:19.571 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:19.577 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T01:59:19.577 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T01:59:19.577 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-25T01:59:19.577 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.615+0000 7ff70b200700 1 Processor -- start 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.615+0000 7ff70b200700 1 -- start start 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.615+0000 7ff70b200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.615+0000 7ff70b200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c063530 con 0x7ff70c108890 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.616+0000 7ff709e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.616+0000 7ff709e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46694/0 (socket says 172.21.15.137:46694) 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.616+0000 7ff709e00700 1 -- 172.21.15.137:0/66990228 learned_addr learned my addr 172.21.15.137:0/66990228 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.616+0000 7ff709e00700 1 -- 172.21.15.137:0/66990228 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c10b1c0 con 0x7ff70c108890 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff709e00700 1 --2- 172.21.15.137:0/66990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0098a0 tx=0x7ff6fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4929409b41fd4f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff708a00700 1 -- 172.21.15.137:0/66990228 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc004160 con 0x7ff70c108890 2024-04-25T01:59:19.578 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff708a00700 1 -- 172.21.15.137:0/66990228 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6fc004300 con 0x7ff70c108890 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff708a00700 1 -- 172.21.15.137:0/66990228 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc011bb0 con 0x7ff70c108890 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff70b200700 1 -- 172.21.15.137:0/66990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 msgr2=0x7ff70c10ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.617+0000 7ff70b200700 1 --2- 172.21.15.137:0/66990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0098a0 tx=0x7ff6fc009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.618+0000 7ff70b200700 1 -- 172.21.15.137:0/66990228 shutdown_connections 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.618+0000 7ff70b200700 1 --2- 172.21.15.137:0/66990228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c10ac80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.618+0000 7ff70b200700 1 -- 172.21.15.137:0/66990228 >> 172.21.15.137:0/66990228 conn(0x7ff70c102360 msgr2=0x7ff70c104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.618+0000 7ff70b200700 1 -- 172.21.15.137:0/66990228 shutdown_connections 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.618+0000 7ff70b200700 1 -- 172.21.15.137:0/66990228 wait complete. 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.619+0000 7ff70b200700 1 Processor -- start 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.619+0000 7ff70b200700 1 -- start start 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.619+0000 7ff70b200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.619+0000 7ff70b200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c10c220 con 0x7ff70c108890 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.620+0000 7ff709e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:19.579 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.620+0000 7ff709e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46696/0 (socket says 172.21.15.137:46696) 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.620+0000 7ff709e00700 1 -- 172.21.15.137:0/2696821820 learned_addr learned my addr 172.21.15.137:0/2696821820 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.620+0000 7ff709e00700 1 -- 172.21.15.137:0/2696821820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c19c290 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.620+0000 7ff709e00700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc011870 tx=0x7ff6fc011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.621+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc003af0 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.621+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6fc003c90 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.621+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6fc019960 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.621+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c19c580 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.621+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c19f210 con 0x7ff70c108890 2024-04-25T01:59:19.580 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.622+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff6fc019c10 con 0x7ff70c108890 2024-04-25T01:59:19.581 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.622+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c063890 con 0x7ff70c108890 2024-04-25T01:59:19.581 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.622+0000 7ff702a00700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 0x7ff6f003b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:19.581 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.623+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff6fc04d610 con 0x7ff70c108890 2024-04-25T01:59:19.581 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.623+0000 7ff709400700 1 -- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 msgr2=0x7ff6f003b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:19.581 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.623+0000 7ff709400700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 0x7ff6f003b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.628+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff6fc00b3e0 con 0x7ff70c108890 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.824+0000 7ff709400700 1 -- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 msgr2=0x7ff6f003b570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.824+0000 7ff709400700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 0x7ff6f003b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.909+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff70c19f3e0 con 0x7ff70c108890 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.910+0000 7ff702a00700 1 -- 172.21.15.137:0/2696821820 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff6fc04cf60 con 0x7ff70c108890 2024-04-25T01:59:19.582 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 msgr2=0x7ff6f003b570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 0x7ff6f003b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 msgr2=0x7ff70c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc011870 tx=0x7ff6fc011d70 comp rx=0 tx=0).stop 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 shutdown_connections 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6f00390b0 0x7ff6f003b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 --2- 172.21.15.137:0/2696821820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff70c108890 0x7ff70c19bd50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:19.583 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 >> 172.21.15.137:0/2696821820 conn(0x7ff70c102360 msgr2=0x7ff70c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:19.584 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 shutdown_connections 2024-04-25T01:59:19.584 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:18.913+0000 7ff70b200700 1 -- 172.21.15.137:0/2696821820 wait complete. 2024-04-25T01:59:19.584 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for the mgr to restart... 2024-04-25T01:59:19.584 INFO:teuthology.orchestra.run.smithi137.stdout:Waiting for mgr epoch 9... 2024-04-25T01:59:20.140 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:20.090+0000 7f5a249d7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T01:59:20.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:20.322+0000 7f5a249d7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T01:59:20.935 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:20.549+0000 7f5a249d7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T01:59:20.936 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:20.930+0000 7f5a249d7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T01:59:21.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:21 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:21.051+0000 7f5a249d7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T01:59:21.562 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:21 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:21.304+0000 7f5a249d7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T01:59:21.562 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:21 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:21.557+0000 7f5a249d7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T01:59:22.779 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:22 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:22.344+0000 7f5a249d7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T01:59:23.154 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:22 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:22.897+0000 7f5a249d7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T01:59:23.154 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:23 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:23.023+0000 7f5a249d7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T01:59:23.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:23 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:23.287+0000 7f5a249d7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T01:59:24.281 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:23 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:23.928+0000 7f5a249d7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T01:59:24.282 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.050+0000 7f5a249d7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T01:59:24.681 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.370+0000 7f5a249d7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T01:59:24.681 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.549+0000 7f5a249d7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T01:59:24.681 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.676+0000 7f5a249d7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T01:59:24.955 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.828+0000 7f5a249d7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T01:59:25.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:24.950+0000 7f5a249d7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T01:59:26.232 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:25 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:25.943+0000 7f5a249d7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T01:59:26.529 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T01:59:26.227+0000 7f5a249d7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: Active manager daemon x restarted 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: Activating manager daemon x 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: mgrmap e10: x(active, starting, since 0.00471022s) 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T01:59:26.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:26 smithi137 ceph-mon[28303]: Manager daemon x is now available 2024-04-25T01:59:27.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:27.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T01:59:27.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T01:59:27.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:27 smithi137 ceph-mon[28303]: mgrmap e11: x(active, since 1.01219s) 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout { 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout } 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.136+0000 7ff6d7a00700 1 Processor -- start 2024-04-25T01:59:28.231 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.136+0000 7ff6d7a00700 1 -- start start 2024-04-25T01:59:28.232 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d7a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.232 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d7a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d007b780 con 0x7ff6d007cd50 2024-04-25T01:59:28.232 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46700/0 (socket says 172.21.15.137:46700) 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d5000700 1 -- 172.21.15.137:0/869906594 learned_addr learned my addr 172.21.15.137:0/869906594 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.137+0000 7ff6d5000700 1 -- 172.21.15.137:0/869906594 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d007b900 con 0x7ff6d007cd50 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.138+0000 7ff6d5000700 1 --2- 172.21.15.137:0/869906594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40098a0 tx=0x7ff6c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63445e7cae46317 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.138+0000 7ff6cf400700 1 -- 172.21.15.137:0/869906594 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4004160 con 0x7ff6d007cd50 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.138+0000 7ff6cf400700 1 -- 172.21.15.137:0/869906594 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6c4004300 con 0x7ff6d007cd50 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.138+0000 7ff6cf400700 1 -- 172.21.15.137:0/869906594 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4011bb0 con 0x7ff6d007cd50 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 -- 172.21.15.137:0/869906594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 msgr2=0x7ff6d007b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/869906594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40098a0 tx=0x7ff6c4009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.239 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 -- 172.21.15.137:0/869906594 shutdown_connections 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/869906594 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d007b1b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 -- 172.21.15.137:0/869906594 >> 172.21.15.137:0/869906594 conn(0x7ff6d01035b0 msgr2=0x7ff6d01059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 -- 172.21.15.137:0/869906594 shutdown_connections 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.139+0000 7ff6d7a00700 1 -- 172.21.15.137:0/869906594 wait complete. 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.140+0000 7ff6d7a00700 1 Processor -- start 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.140+0000 7ff6d7a00700 1 -- start start 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d7a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d7a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d010e6f0 con 0x7ff6d007cd50 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46706/0 (socket says 172.21.15.137:46706) 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d5000700 1 -- 172.21.15.137:0/1562816880 learned_addr learned my addr 172.21.15.137:0/1562816880 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.141+0000 7ff6d5000700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d019e680 con 0x7ff6d007cd50 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6d5000700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c4011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:28.240 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c4011e60 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6c4003b20 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6c40247a0 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d019e910 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.142+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d019ed70 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff6c4022020 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cd600700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff6b803bcd0 con 0x7ff6b8039100 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff6c404d080 con 0x7ff6d007cd50 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cfe00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.144+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.345+0000 7ff6cfe00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.345+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.746+0000 7ff6cfe00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:20.746+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T01:59:28.241 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:21.547+0000 7ff6cfe00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:21.547+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.149+0000 7ff6cfe00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/1454150812 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:23.149+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:26.235+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ff6c40249a0 con 0x7ff6d007cd50 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:26.235+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 msgr2=0x7ff6b803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:26.235+0000 7ff6cd600700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.239+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ff6c404e9e0 con 0x7ff6d007cd50 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.239+0000 7ff6cd600700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 0x7ff6b803efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.240+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff6b803bcd0 con 0x7ff6b803cbc0 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.240+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 0x7ff6b803efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.241+0000 7ff6cfe00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 0x7ff6b803efb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc003a10 tx=0x7ff6bc009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.243+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff6b803bcd0 con 0x7ff6b803cbc0 2024-04-25T01:59:28.242 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff6d0063890 con 0x7ff6b803cbc0 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6cd600700 1 -- 172.21.15.137:0/1562816880 <== mgr.14152 v2:172.21.15.137:6800/205966009 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff6d0063890 con 0x7ff6b803cbc0 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 msgr2=0x7ff6b803efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 0x7ff6b803efb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc003a10 tx=0x7ff6bc009270 comp rx=0 tx=0).stop 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 msgr2=0x7ff6d019e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4000c00 tx=0x7ff6c4011ca0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 shutdown_connections 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6b803cbc0 0x7ff6b803efb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d007cd50 0x7ff6d019e140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.250+0000 7ff6d7a00700 1 --2- 172.21.15.137:0/1562816880 >> [v2:172.21.15.137:6800/1454150812,v1:172.21.15.137:6801/1454150812] conn(0x7ff6b8039100 0x7ff6b803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.251+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 >> 172.21.15.137:0/1562816880 conn(0x7ff6d01035b0 msgr2=0x7ff6d0104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.251+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 shutdown_connections 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:27.251+0000 7ff6d7a00700 1 -- 172.21.15.137:0/1562816880 wait complete. 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:mgr epoch 9 is available 2024-04-25T01:59:28.243 INFO:teuthology.orchestra.run.smithi137.stdout:Generating a dashboard self-signed certificate... 2024-04-25T01:59:28.649 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: [25/Apr/2024:01:59:26] ENGINE Bus STARTING 2024-04-25T01:59:28.650 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: [25/Apr/2024:01:59:26] ENGINE Serving on https://172.21.15.137:7150 2024-04-25T01:59:28.650 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: [25/Apr/2024:01:59:26] ENGINE Serving on http://172.21.15.137:8765 2024-04-25T01:59:28.650 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: [25/Apr/2024:01:59:26] ENGINE Bus STARTED 2024-04-25T01:59:28.650 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T01:59:28.650 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:28 smithi137 ceph-mon[28303]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T01:59:29.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:29 smithi137 ceph-mon[28303]: mgrmap e12: x(active, since 2s) 2024-04-25T01:59:29.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:30.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T01:59:30.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.111+0000 7fa957800700 1 Processor -- start 2024-04-25T01:59:30.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.111+0000 7fa957800700 1 -- start start 2024-04-25T01:59:30.141 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.112+0000 7fa957800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:30.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.112+0000 7fa957800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa95007b780 con 0x7fa95007cd50 2024-04-25T01:59:30.143 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.112+0000 7fa954e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.112+0000 7fa954e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60894/0 (socket says 172.21.15.137:60894) 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.112+0000 7fa954e00700 1 -- 172.21.15.137:0/2738635619 learned_addr learned my addr 172.21.15.137:0/2738635619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.113+0000 7fa954e00700 1 -- 172.21.15.137:0/2738635619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95007b900 con 0x7fa95007cd50 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.113+0000 7fa954e00700 1 --2- 172.21.15.137:0/2738635619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098a0 tx=0x7fa944009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4975bbecfb33eb75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.113+0000 7fa94f400700 1 -- 172.21.15.137:0/2738635619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa944004160 con 0x7fa95007cd50 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.113+0000 7fa94f400700 1 -- 172.21.15.137:0/2738635619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa944004300 con 0x7fa95007cd50 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.113+0000 7fa94f400700 1 -- 172.21.15.137:0/2738635619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa944011bb0 con 0x7fa95007cd50 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.114+0000 7fa957800700 1 -- 172.21.15.137:0/2738635619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 msgr2=0x7fa95007b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.114+0000 7fa957800700 1 --2- 172.21.15.137:0/2738635619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9440098a0 tx=0x7fa944009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.114+0000 7fa957800700 1 -- 172.21.15.137:0/2738635619 shutdown_connections 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.114+0000 7fa957800700 1 --2- 172.21.15.137:0/2738635619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95007b1b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.114+0000 7fa957800700 1 -- 172.21.15.137:0/2738635619 >> 172.21.15.137:0/2738635619 conn(0x7fa9501035c0 msgr2=0x7fa950105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:30.144 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.115+0000 7fa957800700 1 -- 172.21.15.137:0/2738635619 shutdown_connections 2024-04-25T01:59:30.145 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.115+0000 7fa957800700 1 -- 172.21.15.137:0/2738635619 wait complete. 2024-04-25T01:59:30.145 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.116+0000 7fa957800700 1 Processor -- start 2024-04-25T01:59:30.145 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.116+0000 7fa957800700 1 -- start start 2024-04-25T01:59:30.145 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.117+0000 7fa957800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:30.145 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.117+0000 7fa957800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa95010e700 con 0x7fa95007cd50 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.117+0000 7fa954e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.117+0000 7fa954e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60906/0 (socket says 172.21.15.137:60906) 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.117+0000 7fa954e00700 1 -- 172.21.15.137:0/3630997029 learned_addr learned my addr 172.21.15.137:0/3630997029 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa954e00700 1 -- 172.21.15.137:0/3630997029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95019e6b0 con 0x7fa95007cd50 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa954e00700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c00 tx=0x7fa944011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa944011e60 con 0x7fa95007cd50 2024-04-25T01:59:30.148 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa944003b20 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95019e940 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.118+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9440247a0 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.119+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95019eda0 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.120+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950063890 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.121+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa944022020 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.121+0000 7fa94d600700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 0x7fa93803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.121+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa94404d160 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.122+0000 7fa94fe00700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 0x7fa93803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.123+0000 7fa94fe00700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 0x7fa93803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa93c006fd0 tx=0x7fa93c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.131+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa94400b3e0 con 0x7fa95007cd50 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.365+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa950104760 con 0x7fa9380390a0 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.495+0000 7fa94d600700 1 -- 172.21.15.137:0/3630997029 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa950104760 con 0x7fa9380390a0 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 msgr2=0x7fa93803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:30.149 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 0x7fa93803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa93c006fd0 tx=0x7fa93c006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 msgr2=0x7fa95019e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c00 tx=0x7fa944011ca0 comp rx=0 tx=0).stop 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 shutdown_connections 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa9380390a0 0x7fa93803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 --2- 172.21.15.137:0/3630997029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa95007cd50 0x7fa95019e170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 >> 172.21.15.137:0/3630997029 conn(0x7fa9501035c0 msgr2=0x7fa950104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.500+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 shutdown_connections 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:29.501+0000 7fa957800700 1 -- 172.21.15.137:0/3630997029 wait complete. 2024-04-25T01:59:30.150 INFO:teuthology.orchestra.run.smithi137.stdout:Creating initial admin user... 2024-04-25T01:59:30.437 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:30 smithi137 ceph-mon[28303]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:30.438 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:30 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:30.438 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:30 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:32.020 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:32.021 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:31 smithi137 ceph-mon[28303]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:32.021 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:32.029 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$BDmbFDBOYIWLQ2LUC1SgEeZMYaJGpPW.GBJQPzG0dMOUpoLyqLzsi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714010371, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T01:59:32.035 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.712+0000 7f8990e00700 1 Processor -- start 2024-04-25T01:59:32.035 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.712+0000 7f8990e00700 1 -- start start 2024-04-25T01:59:32.035 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.712+0000 7f8990e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:32.035 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.712+0000 7f8990e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f898c07b760 con 0x7f898c07cd30 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.713+0000 7f8989e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.713+0000 7f8989e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60916/0 (socket says 172.21.15.137:60916) 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.713+0000 7f8989e00700 1 -- 172.21.15.137:0/3120166597 learned_addr learned my addr 172.21.15.137:0/3120166597 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.713+0000 7f8989e00700 1 -- 172.21.15.137:0/3120166597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c07b8e0 con 0x7f898c07cd30 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.713+0000 7f8989e00700 1 --2- 172.21.15.137:0/3120166597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98f618e0260a893 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.714+0000 7f8988a00700 1 -- 172.21.15.137:0/3120166597 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c004160 con 0x7f898c07cd30 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.714+0000 7f8988a00700 1 -- 172.21.15.137:0/3120166597 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f897c004300 con 0x7f898c07cd30 2024-04-25T01:59:32.036 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.714+0000 7f8988a00700 1 -- 172.21.15.137:0/3120166597 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c011bb0 con 0x7f898c07cd30 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.714+0000 7f8990e00700 1 -- 172.21.15.137:0/3120166597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 msgr2=0x7f898c07b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.714+0000 7f8990e00700 1 --2- 172.21.15.137:0/3120166597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f897c0098a0 tx=0x7f897c009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.715+0000 7f8990e00700 1 -- 172.21.15.137:0/3120166597 shutdown_connections 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.715+0000 7f8990e00700 1 --2- 172.21.15.137:0/3120166597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c07b190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.715+0000 7f8990e00700 1 -- 172.21.15.137:0/3120166597 >> 172.21.15.137:0/3120166597 conn(0x7f898c1035c0 msgr2=0x7f898c105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.715+0000 7f8990e00700 1 -- 172.21.15.137:0/3120166597 shutdown_connections 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.715+0000 7f8990e00700 1 -- 172.21.15.137:0/3120166597 wait complete. 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8990e00700 1 Processor -- start 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8990e00700 1 -- start start 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8990e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8990e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f898c10e6c0 con 0x7f898c07cd30 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8989e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:32.037 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8989e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60930/0 (socket says 172.21.15.137:60930) 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.716+0000 7f8989e00700 1 -- 172.21.15.137:0/1157768872 learned_addr learned my addr 172.21.15.137:0/1157768872 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8989e00700 1 -- 172.21.15.137:0/1157768872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c19e690 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8989e00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f897c000c00 tx=0x7f897c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c011e60 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f897c003b20 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0247a0 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c19e920 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.717+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c19ed80 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.718+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f897c022020 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.718+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c063890 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.719+0000 7f8982a00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 0x7f897003b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.719+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f897c04d110 con 0x7f898c07cd30 2024-04-25T01:59:32.038 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.719+0000 7f8989400700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 0x7f897003b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.720+0000 7f8989400700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 0x7f897003b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8978006fd0 tx=0x7f8978006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.724+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f897c00b3e0 con 0x7f898c07cd30 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:30.970+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f898c1a1790 con 0x7f8970039100 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.208+0000 7f8982a00700 1 -- 172.21.15.137:0/1157768872 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f898c1a1790 con 0x7f8970039100 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 msgr2=0x7f897003b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 0x7f897003b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8978006fd0 tx=0x7f8978006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 msgr2=0x7f898c19e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f897c000c00 tx=0x7f897c011ca0 comp rx=0 tx=0).stop 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 shutdown_connections 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f8970039100 0x7f897003b5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 --2- 172.21.15.137:0/1157768872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f898c07cd30 0x7f898c19e150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 >> 172.21.15.137:0/1157768872 conn(0x7f898c1035c0 msgr2=0x7f898c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.211+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 shutdown_connections 2024-04-25T01:59:32.039 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:31.212+0000 7f8990e00700 1 -- 172.21.15.137:0/1157768872 wait complete. 2024-04-25T01:59:32.040 INFO:teuthology.orchestra.run.smithi137.stdout:Fetching dashboard port number... 2024-04-25T01:59:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T01:59:33.802 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.828+0000 7efd69c00700 1 Processor -- start 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.828+0000 7efd69c00700 1 -- start start 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.829+0000 7efd69c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.829+0000 7efd69c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd64108a10 con 0x7efd64108020 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.829+0000 7efd62a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.829+0000 7efd62a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41932/0 (socket says 172.21.15.137:41932) 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.829+0000 7efd62a00700 1 -- 172.21.15.137:0/1784291623 learned_addr learned my addr 172.21.15.137:0/1784291623 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.830+0000 7efd62a00700 1 -- 172.21.15.137:0/1784291623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd64109220 con 0x7efd64108020 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.830+0000 7efd62a00700 1 --2- 172.21.15.137:0/1784291623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd540098a0 tx=0x7efd54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a1e95dc93aff7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.830+0000 7efd61600700 1 -- 172.21.15.137:0/1784291623 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54004160 con 0x7efd64108020 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.830+0000 7efd61600700 1 -- 172.21.15.137:0/1784291623 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd54004300 con 0x7efd64108020 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.830+0000 7efd61600700 1 -- 172.21.15.137:0/1784291623 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54011bb0 con 0x7efd64108020 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 -- 172.21.15.137:0/1784291623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 msgr2=0x7efd64108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:33.803 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 --2- 172.21.15.137:0/1784291623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd540098a0 tx=0x7efd54009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 -- 172.21.15.137:0/1784291623 shutdown_connections 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 --2- 172.21.15.137:0/1784291623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd64108440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 -- 172.21.15.137:0/1784291623 >> 172.21.15.137:0/1784291623 conn(0x7efd641035c0 msgr2=0x7efd64105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 -- 172.21.15.137:0/1784291623 shutdown_connections 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.831+0000 7efd69c00700 1 -- 172.21.15.137:0/1784291623 wait complete. 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.832+0000 7efd69c00700 1 Processor -- start 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.832+0000 7efd69c00700 1 -- start start 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.832+0000 7efd69c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.832+0000 7efd69c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efd6410c5d0 con 0x7efd64108020 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd62a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd62a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41942/0 (socket says 172.21.15.137:41942) 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd62a00700 1 -- 172.21.15.137:0/1951605551 learned_addr learned my addr 172.21.15.137:0/1951605551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd62a00700 1 -- 172.21.15.137:0/1951605551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6419e720 con 0x7efd64108020 2024-04-25T01:59:33.804 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd62a00700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd54000c00 tx=0x7efd54004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54011e60 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.833+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd54003af0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.834+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd540246a0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.834+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6419e9b0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.834+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6419ee10 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.835+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7efd54022020 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.835+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd64063890 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.835+0000 7efd5b400700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 0x7efd4803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.835+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efd5404d1c0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.836+0000 7efd62000700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 0x7efd4803b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.836+0000 7efd62000700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 0x7efd4803b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.841+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7efd540212c0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:32.878+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7efd5401a4d0 con 0x7efd64108020 2024-04-25T01:59:33.805 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.067+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7efd641a17e0 con 0x7efd64108020 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.068+0000 7efd5b400700 1 -- 172.21.15.137:0/1951605551 <== mon.0 v2:172.21.15.137:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7efd54043260 con 0x7efd64108020 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.070+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 msgr2=0x7efd4803b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.070+0000 7efd69c00700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 0x7efd4803b5c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.070+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 msgr2=0x7efd6419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.070+0000 7efd69c00700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd54000c00 tx=0x7efd54004620 comp rx=0 tx=0).stop 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 shutdown_connections 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efd48039100 0x7efd4803b5c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 --2- 172.21.15.137:0/1951605551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efd64108020 0x7efd6419e1e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 >> 172.21.15.137:0/1951605551 conn(0x7efd641035c0 msgr2=0x7efd64104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 shutdown_connections 2024-04-25T01:59:33.806 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:33.071+0000 7efd69c00700 1 -- 172.21.15.137:0/1951605551 wait complete. 2024-04-25T01:59:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T01:59:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout disabled 2024-04-25T01:59:33.853 INFO:teuthology.orchestra.run.smithi137.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T01:59:33.853 INFO:teuthology.orchestra.run.smithi137.stdout:systemctl: stdout inactive 2024-04-25T01:59:33.853 INFO:teuthology.orchestra.run.smithi137.stdout:firewalld.service is not enabled 2024-04-25T01:59:33.853 INFO:teuthology.orchestra.run.smithi137.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout:Ceph Dashboard is now available at: 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout: URL: https://smithi137.front.sepia.ceph.com:8443/ 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout: User: admin 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout: Password: zuzvzrppxd 2024-04-25T01:59:33.857 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:33.858 INFO:teuthology.orchestra.run.smithi137.stdout:Saving cluster configuration to /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config directory 2024-04-25T01:59:33.858 INFO:teuthology.orchestra.run.smithi137.stdout:Enabling autotune for osd_memory_target 2024-04-25T01:59:34.098 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:33 smithi137 ceph-mon[28303]: mgrmap e13: x(active, since 6s) 2024-04-25T01:59:34.098 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:33 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1951605551' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T01:59:35.847 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.924+0000 7ff641c00700 1 Processor -- start 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.924+0000 7ff641c00700 1 -- start start 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.925+0000 7ff641c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.925+0000 7ff641c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c10efe0 con 0x7ff63c10e5f0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.925+0000 7ff63aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.926+0000 7ff63aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41948/0 (socket says 172.21.15.137:41948) 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.926+0000 7ff63aa00700 1 -- 172.21.15.137:0/3265083926 learned_addr learned my addr 172.21.15.137:0/3265083926 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.926+0000 7ff63aa00700 1 -- 172.21.15.137:0/3265083926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c10f7f0 con 0x7ff63c10e5f0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.927+0000 7ff63aa00700 1 --2- 172.21.15.137:0/3265083926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098a0 tx=0x7ff62c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d76684f1bc7d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.927+0000 7ff639600700 1 -- 172.21.15.137:0/3265083926 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff62c004160 con 0x7ff63c10e5f0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.927+0000 7ff639600700 1 -- 172.21.15.137:0/3265083926 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff62c004300 con 0x7ff63c10e5f0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.927+0000 7ff639600700 1 -- 172.21.15.137:0/3265083926 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff62c011bb0 con 0x7ff63c10e5f0 2024-04-25T01:59:35.848 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 -- 172.21.15.137:0/3265083926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 msgr2=0x7ff63c10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 --2- 172.21.15.137:0/3265083926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0098a0 tx=0x7ff62c009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 -- 172.21.15.137:0/3265083926 shutdown_connections 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 --2- 172.21.15.137:0/3265083926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c10e5f0 0x7ff63c10ea10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 -- 172.21.15.137:0/3265083926 >> 172.21.15.137:0/3265083926 conn(0x7ff63c07d580 msgr2=0x7ff63c07fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 -- 172.21.15.137:0/3265083926 shutdown_connections 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.928+0000 7ff641c00700 1 -- 172.21.15.137:0/3265083926 wait complete. 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.929+0000 7ff641c00700 1 Processor -- start 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.929+0000 7ff641c00700 1 -- start start 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff641c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:35.849 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff641c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c112ba0 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff63aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff63aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41950/0 (socket says 172.21.15.137:41950) 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff63aa00700 1 -- 172.21.15.137:0/1309571555 learned_addr learned my addr 172.21.15.137:0/1309571555 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.930+0000 7ff63aa00700 1 -- 172.21.15.137:0/1309571555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c1a3120 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff63aa00700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff62c000c00 tx=0x7ff62c011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff62c0039e0 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff62c01f070 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c1a33b0 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff62c01b5d0 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.931+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c1a5e90 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.932+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c112d20 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.932+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff62c01a440 con 0x7ff63c1a27c0 2024-04-25T01:59:35.850 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.933+0000 7ff633400700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 0x7ff62003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.933+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff62c04d7c0 con 0x7ff63c1a27c0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.933+0000 7ff63a000700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 0x7ff62003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.934+0000 7ff63a000700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 0x7ff62003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff628006fd0 tx=0x7ff628006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:34.938+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff62c022290 con 0x7ff63c1a27c0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.159+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff63c1a6350 con 0x7ff63c1a27c0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.160+0000 7ff633400700 1 -- 172.21.15.137:0/1309571555 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff62c01a730 con 0x7ff63c1a27c0 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 msgr2=0x7ff62003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 0x7ff62003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff628006fd0 tx=0x7ff628006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 msgr2=0x7ff63c1a2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff62c000c00 tx=0x7ff62c011c30 comp rx=0 tx=0).stop 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 shutdown_connections 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff6200391a0 0x7ff62003b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:35.851 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 --2- 172.21.15.137:0/1309571555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff63c1a27c0 0x7ff63c1a2be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:35.852 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.163+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 >> 172.21.15.137:0/1309571555 conn(0x7ff63c07d580 msgr2=0x7ff63c07e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:35.852 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.164+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 shutdown_connections 2024-04-25T01:59:35.852 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:35.164+0000 7ff641c00700 1 -- 172.21.15.137:0/1309571555 wait complete. 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.403+0000 7f01f8c00700 1 Processor -- start 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.404+0000 7f01f8c00700 1 -- start start 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.404+0000 7f01f8c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.404+0000 7f01f8c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4108a10 con 0x7f01f4108020 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.404+0000 7f01f1e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.405+0000 7f01f1e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41962/0 (socket says 172.21.15.137:41962) 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.405+0000 7f01f1e00700 1 -- 172.21.15.137:0/848192042 learned_addr learned my addr 172.21.15.137:0/848192042 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.405+0000 7f01f1e00700 1 -- 172.21.15.137:0/848192042 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f4109220 con 0x7f01f4108020 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.405+0000 7f01f1e00700 1 --2- 172.21.15.137:0/848192042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01e40098a0 tx=0x7f01e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad98c9505d312207 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f1400700 1 -- 172.21.15.137:0/848192042 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4004160 con 0x7f01f4108020 2024-04-25T01:59:37.467 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f1400700 1 -- 172.21.15.137:0/848192042 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e4004300 con 0x7f01f4108020 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f1400700 1 -- 172.21.15.137:0/848192042 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4011bb0 con 0x7f01f4108020 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f8c00700 1 -- 172.21.15.137:0/848192042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 msgr2=0x7f01f4108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f8c00700 1 --2- 172.21.15.137:0/848192042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f01e40098a0 tx=0x7f01e4009bb0 comp rx=0 tx=0).stop 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f8c00700 1 -- 172.21.15.137:0/848192042 shutdown_connections 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f8c00700 1 --2- 172.21.15.137:0/848192042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f4108440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.406+0000 7f01f8c00700 1 -- 172.21.15.137:0/848192042 >> 172.21.15.137:0/848192042 conn(0x7f01f4103600 msgr2=0x7f01f4105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.407+0000 7f01f8c00700 1 -- 172.21.15.137:0/848192042 shutdown_connections 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.407+0000 7f01f8c00700 1 -- 172.21.15.137:0/848192042 wait complete. 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.408+0000 7f01f8c00700 1 Processor -- start 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.408+0000 7f01f8c00700 1 -- start start 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.408+0000 7f01f8c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.408+0000 7f01f8c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01f410c5d0 con 0x7f01f4108020 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.409+0000 7f01f1e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:37.468 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.409+0000 7f01f1e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41968/0 (socket says 172.21.15.137:41968) 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.409+0000 7f01f1e00700 1 -- 172.21.15.137:0/4189606271 learned_addr learned my addr 172.21.15.137:0/4189606271 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.409+0000 7f01f1e00700 1 -- 172.21.15.137:0/4189606271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f419e750 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.409+0000 7f01f1e00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01e4011bf0 tx=0x7f01e4011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.410+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4003930 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.410+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01e4003ad0 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.410+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f419e9e0 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.410+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4019760 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.410+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f419ee40 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.411+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f01e401a430 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.411+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f4063890 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.411+0000 7f01eaa00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 0x7f01d803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.411+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f01e404d6f0 con 0x7f01f4108020 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.412+0000 7f01ebe00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 0x7f01d803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.412+0000 7f01ebe00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 0x7f01d803b610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01dc006fd0 tx=0x7f01dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:37.469 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.417+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f01e400b3e0 con 0x7f01f4108020 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.759+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f01f41a1810 con 0x7f01f4108020 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.764+0000 7f01eaa00700 1 -- 172.21.15.137:0/4189606271 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f01e401a720 con 0x7f01f4108020 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.767+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 msgr2=0x7f01d803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.767+0000 7f01f8c00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 0x7f01d803b610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01dc006fd0 tx=0x7f01dc006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.767+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 msgr2=0x7f01f419e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.767+0000 7f01f8c00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01e4011bf0 tx=0x7f01e4011cd0 comp rx=0 tx=0).stop 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 shutdown_connections 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f01d8039150 0x7f01d803b610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 --2- 172.21.15.137:0/4189606271 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01f4108020 0x7f01f419e210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 >> 172.21.15.137:0/4189606271 conn(0x7f01f4103600 msgr2=0x7f01f41040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 shutdown_connections 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr 2024-04-25T01:59:36.768+0000 7f01f8c00700 1 -- 172.21.15.137:0/4189606271 wait complete. 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T01:59:37.470 INFO:teuthology.orchestra.run.smithi137.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: ceph telemetry on 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout:For more information see: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-25T01:59:37.471 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:37.472 INFO:teuthology.orchestra.run.smithi137.stdout:Bootstrap complete. 2024-04-25T01:59:37.535 INFO:tasks.cephadm:Fetching config... 2024-04-25T01:59:37.536 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:59:37.536 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T01:59:37.586 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T01:59:37.586 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:59:37.586 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T01:59:37.666 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T01:59:37.666 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:59:37.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-25T01:59:37.778 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T01:59:37.778 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T01:59:37.778 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T01:59:37.872 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T01:59:37.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T01:59:37.966 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:37.987 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:37 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4189606271' entity='client.admin' 2024-04-25T01:59:38.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T01:59:38.039 INFO:teuthology.orchestra.run.smithi163.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:38.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T01:59:38.090 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPigNIib7UV8e/rtLHRXugJEAN5ge1UJ9kalK9THgZ5nT6okUy4NUu0Ic8q4WqazAne80GrM5l9J6EfCLjqqHtRyW5DRpq5oH+BSUjlO1UCVRx7EiQgBJ5jv2yPG/drpzztGmcI9FqVquGLIMLOCy1eOxYuy/n6beWdlSZiXf1AOxsGoneCunFRQkU0GR1lK6F2EVtgR5QP/vlnGYGXb0z6aUzV1na4UyQIEr8e64AZL/IbZ6NtOs6kMDaEOBqTTz5qevzljSSUVnMBGeKOXLcJFgYaUsg0YdcDn4T6QMI0zv7EKEr2/HkqZlobIROa4xyhcWjEPGZwKepzMj4L8McR3Mf8F9skCzZqMaYHk1WEGhSNYQRDrJ3iycbWrGFUa6goSlOczW5RoZCmvuH3FbX8RABKL8RszCdQfl+Ya3ZXBdY0O7T2iT/L7r/T4LFCg+oQszlqdSBvIamGzhg+xUL4qZ75Ws31o2+nLLVuS4Fph5/VCets/49tYEPTXEup1c= ceph-19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T01:59:38.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T01:59:38.505 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 -- 172.21.15.137:0/2312097098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 msgr2=0x7f123c0746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 --2- 172.21.15.137:0/2312097098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c0746c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1230009910 tx=0x7f1230009c20 comp rx=0 tx=0).stop 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 -- 172.21.15.137:0/2312097098 shutdown_connections 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 --2- 172.21.15.137:0/2312097098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c0746c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 -- 172.21.15.137:0/2312097098 >> 172.21.15.137:0/2312097098 conn(0x7f123c0fd220 msgr2=0x7f123c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 -- 172.21.15.137:0/2312097098 shutdown_connections 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.610+0000 7f1243a00700 1 -- 172.21.15.137:0/2312097098 wait complete. 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.611+0000 7f1243a00700 1 Processor -- start 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1243a00700 1 -- start start 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1243a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:40.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1243a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e470 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1241000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1241000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41988/0 (socket says 172.21.15.137:41988) 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1241000700 1 -- 172.21.15.137:0/3464379575 learned_addr learned my addr 172.21.15.137:0/3464379575 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.612+0000 7f1241000700 1 -- 172.21.15.137:0/3464379575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c19df10 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1241000700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ed0 tx=0x7f1230004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1230027070 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1230022470 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c19e1a0 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f123000f5d0 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.613+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c1a0e90 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.615+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f123002a070 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.615+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c10ebd0 con 0x7f123c076260 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.615+0000 7f1239600700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 0x7f122403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.615+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f123001e030 con 0x7f123c076260 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.616+0000 7f123be00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 0x7f122403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.616+0000 7f123be00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 0x7f122403b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1228006fd0 tx=0x7f1228006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.621+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f1230013070 con 0x7f123c076260 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.857+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f123c02dc40 con 0x7f123c076260 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.862+0000 7f1239600700 1 -- 172.21.15.137:0/3464379575 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f12300292c0 con 0x7f123c076260 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.865+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 msgr2=0x7f122403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 0x7f122403b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1228006fd0 tx=0x7f1228006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 msgr2=0x7f123c19d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ed0 tx=0x7f1230004690 comp rx=0 tx=0).stop 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 shutdown_connections 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1224039150 0x7f122403b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 --2- 172.21.15.137:0/3464379575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f123c076260 0x7f123c19d9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 >> 172.21.15.137:0/3464379575 conn(0x7f123c0fd220 msgr2=0x7f123c0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 shutdown_connections 2024-04-25T01:59:40.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:40.866+0000 7f1243a00700 1 -- 172.21.15.137:0/3464379575 wait complete. 2024-04-25T01:59:41.564 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T01:59:41.564 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T01:59:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T01:59:42.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:42.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:42.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2024-04-25T01:59:42.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:42.147 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3464379575' entity='client.admin' 2024-04-25T01:59:42.148 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:42.148 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:43.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 -- 172.21.15.137:0/3236359882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 msgr2=0x7fa4e4104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:43.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3236359882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e4104930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009910 tx=0x7fa4d8009c20 comp rx=0 tx=0).stop 2024-04-25T01:59:43.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 -- 172.21.15.137:0/3236359882 shutdown_connections 2024-04-25T01:59:43.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3236359882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e4104930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:43.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 -- 172.21.15.137:0/3236359882 >> 172.21.15.137:0/3236359882 conn(0x7fa4e40fbf50 msgr2=0x7fa4e40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:43.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 -- 172.21.15.137:0/3236359882 shutdown_connections 2024-04-25T01:59:43.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.855+0000 7fa4ea400700 1 -- 172.21.15.137:0/3236359882 wait complete. 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.857+0000 7fa4ea400700 1 Processor -- start 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.857+0000 7fa4ea400700 1 -- start start 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.857+0000 7fa4ea400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.857+0000 7fa4ea400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4107c20 con 0x7fa4e4102540 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.858+0000 7fa4e9000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.858+0000 7fa4e9000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35790/0 (socket says 172.21.15.137:35790) 2024-04-25T01:59:43.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.858+0000 7fa4e9000700 1 -- 172.21.15.137:0/3164628573 learned_addr learned my addr 172.21.15.137:0/3164628573 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.858+0000 7fa4e9000700 1 -- 172.21.15.137:0/3164628573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e41976e0 con 0x7fa4e4102540 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.858+0000 7fa4e9000700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8005950 tx=0x7fa4d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.859+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d8027070 con 0x7fa4e4102540 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.859+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e41979d0 con 0x7fa4e4102540 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.859+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4d8022470 con 0x7fa4e4102540 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.859+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d800f590 con 0x7fa4e4102540 2024-04-25T01:59:43.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.859+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e419a660 con 0x7fa4e4102540 2024-04-25T01:59:43.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.860+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e41083a0 con 0x7fa4e4102540 2024-04-25T01:59:43.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.860+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fa4d802a070 con 0x7fa4e4102540 2024-04-25T01:59:43.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.861+0000 7fa4e1600700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 0x7fa4cc03b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:43.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.861+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa4d801e030 con 0x7fa4e4102540 2024-04-25T01:59:43.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.861+0000 7fa4e3e00700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 0x7fa4cc03b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:43.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.862+0000 7fa4e3e00700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 0x7fa4cc03b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:43.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:43.866+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa4d8013070 con 0x7fa4e4102540 2024-04-25T01:59:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.096+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa4e402dcb0 con 0x7fa4cc039150 2024-04-25T01:59:44.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.103+0000 7fa4e1600700 1 -- 172.21.15.137:0/3164628573 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4e402dcb0 con 0x7fa4cc039150 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 msgr2=0x7fa4cc03b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 0x7fa4cc03b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 msgr2=0x7fa4e41971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8005950 tx=0x7fa4d8004740 comp rx=0 tx=0).stop 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 shutdown_connections 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4cc039150 0x7fa4cc03b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 --2- 172.21.15.137:0/3164628573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4e4102540 0x7fa4e41971a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 >> 172.21.15.137:0/3164628573 conn(0x7fa4e40fbf50 msgr2=0x7fa4e40fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:44.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 shutdown_connections 2024-04-25T01:59:44.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:44.106+0000 7fa4ea400700 1 -- 172.21.15.137:0/3164628573 wait complete. 2024-04-25T01:59:44.771 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi163 2024-04-25T01:59:44.771 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:59:44.771 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/etc/ceph/ceph.conf 2024-04-25T01:59:44.789 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T01:59:44.790 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:44.847 INFO:tasks.cephadm:Adding host smithi163 to orchestrator... 2024-04-25T01:59:44.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch host add smithi163 2024-04-25T01:59:45.238 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T01:59:45.384 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:45.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:45.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:45.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T01:59:45.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T01:59:45.385 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:45 smithi137 ceph-mon[28303]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-25T01:59:46.410 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:46 smithi137 ceph-mon[28303]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T01:59:46.411 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:46 smithi137 ceph-mon[28303]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:47.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 -- 172.21.15.137:0/3243259424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 msgr2=0x7fd1fc102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 --2- 172.21.15.137:0/3243259424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc102250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009910 tx=0x7fd1ec009c20 comp rx=0 tx=0).stop 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 -- 172.21.15.137:0/3243259424 shutdown_connections 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 --2- 172.21.15.137:0/3243259424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc102250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 -- 172.21.15.137:0/3243259424 >> 172.21.15.137:0/3243259424 conn(0x7fd1fc0fd720 msgr2=0x7fd1fc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 -- 172.21.15.137:0/3243259424 shutdown_connections 2024-04-25T01:59:47.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.257+0000 7fd202200700 1 -- 172.21.15.137:0/3243259424 wait complete. 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.258+0000 7fd202200700 1 Processor -- start 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd202200700 1 -- start start 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd202200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd202200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1fc10c380 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd1fb400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd1fb400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35812/0 (socket says 172.21.15.137:35812) 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.259+0000 7fd1fb400700 1 -- 172.21.15.137:0/3173002993 learned_addr learned my addr 172.21.15.137:0/3173002993 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd1fb400700 1 -- 172.21.15.137:0/3173002993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc19fb60 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd1fb400700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0052a0 tx=0x7fd1ec004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec026070 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1ec00bbf0 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1fc19fe50 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.260+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec003a30 con 0x7fd1fc101e70 2024-04-25T01:59:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.261+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1fc1997a0 con 0x7fd1fc101e70 2024-04-25T01:59:47.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.262+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd1ec029070 con 0x7fd1fc101e70 2024-04-25T01:59:47.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.262+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1fc103350 con 0x7fd1fc101e70 2024-04-25T01:59:47.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.262+0000 7fd1f3e00700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 0x7fd1e003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:47.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.262+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd1ec01e070 con 0x7fd1fc101e70 2024-04-25T01:59:47.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.262+0000 7fd1faa00700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 0x7fd1e003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:47.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.263+0000 7fd1faa00700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 0x7fd1e003b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8006fd0 tx=0x7fd1e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:47.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.268+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd1ec013070 con 0x7fd1fc101e70 2024-04-25T01:59:47.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:47.493+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi163", "target": ["mon-mgr", ""]}) -- 0x7fd1fc19acd0 con 0x7fd1e00390f0 2024-04-25T01:59:47.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:47 smithi137 ceph-mon[28303]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T01:59:47.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:47 smithi137 ceph-mon[28303]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:47.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:47.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:47.497 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:49.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:49 smithi137 ceph-mon[28303]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi163", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T01:59:49.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:49 smithi137 ceph-mon[28303]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:49.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:49 smithi137 ceph-mon[28303]: Deploying cephadm binary to smithi163 2024-04-25T01:59:51.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:51 smithi137 ceph-mon[28303]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:52.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.255+0000 7fd1f3e00700 1 -- 172.21.15.137:0/3173002993 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd1fc19acd0 con 0x7fd1e00390f0 2024-04-25T01:59:52.259 INFO:teuthology.orchestra.run.smithi137.stdout:Added host 'smithi163' with addr '172.21.15.163' 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 msgr2=0x7fd1e003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 0x7fd1e003b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8006fd0 tx=0x7fd1e8006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 msgr2=0x7fd1fc19f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec0052a0 tx=0x7fd1ec004cc0 comp rx=0 tx=0).stop 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 shutdown_connections 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd1e00390f0 0x7fd1e003b5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 --2- 172.21.15.137:0/3173002993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1fc101e70 0x7fd1fc19f620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 >> 172.21.15.137:0/3173002993 conn(0x7fd1fc0fd720 msgr2=0x7fd1fc075f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 shutdown_connections 2024-04-25T01:59:52.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:52.259+0000 7fd202200700 1 -- 172.21.15.137:0/3173002993 wait complete. 2024-04-25T01:59:53.058 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T01:59:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T01:59:53.529 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:53 smithi137 ceph-mon[28303]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:53.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:53.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:53 smithi137 ceph-mon[28303]: Added host smithi163 2024-04-25T01:59:53.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T01:59:53.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:54.583 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 -- 172.21.15.137:0/391705819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 msgr2=0x7f2e5c104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 --2- 172.21.15.137:0/391705819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c104460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009910 tx=0x7f2e4c009c20 comp rx=0 tx=0).stop 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 -- 172.21.15.137:0/391705819 shutdown_connections 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 --2- 172.21.15.137:0/391705819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c104460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 -- 172.21.15.137:0/391705819 >> 172.21.15.137:0/391705819 conn(0x7f2e5c0ff950 msgr2=0x7f2e5c101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 -- 172.21.15.137:0/391705819 shutdown_connections 2024-04-25T01:59:55.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.317+0000 7f2e62400700 1 -- 172.21.15.137:0/391705819 wait complete. 2024-04-25T01:59:55.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.319+0000 7f2e62400700 1 Processor -- start 2024-04-25T01:59:55.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.319+0000 7f2e62400700 1 -- start start 2024-04-25T01:59:55.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.319+0000 7f2e62400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:55.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.319+0000 7f2e62400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c10e590 con 0x7f2e5c104080 2024-04-25T01:59:55.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.319+0000 7f2e5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:55.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e5b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57098/0 (socket says 172.21.15.137:57098) 2024-04-25T01:59:55.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e5b400700 1 -- 172.21.15.137:0/3453497007 learned_addr learned my addr 172.21.15.137:0/3453497007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e5b400700 1 -- 172.21.15.137:0/3453497007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c19fb50 con 0x7f2e5c104080 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e5b400700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006010 tx=0x7f2e4c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e4c026070 con 0x7f2e5c104080 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e4c0044a0 con 0x7f2e5c104080 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c19fe40 con 0x7f2e5c104080 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.320+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e4c003a70 con 0x7f2e5c104080 2024-04-25T01:59:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.321+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c199790 con 0x7f2e5c104080 2024-04-25T01:59:55.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.322+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2e4c029070 con 0x7f2e5c104080 2024-04-25T01:59:55.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.322+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c105560 con 0x7f2e5c104080 2024-04-25T01:59:55.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.322+0000 7f2e58c00700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 0x7f2e4003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:55.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.322+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2e4c01e070 con 0x7f2e5c104080 2024-04-25T01:59:55.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.323+0000 7f2e52a00700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 0x7f2e4003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:55.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.323+0000 7f2e52a00700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 0x7f2e4003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006fd0 tx=0x7f2e44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.328+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f2e4c013070 con 0x7f2e5c104080 2024-04-25T01:59:55.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:55 smithi137 ceph-mon[28303]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:55.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:55 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.560+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e5c19acc0 con 0x7f2e400390f0 2024-04-25T01:59:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.564+0000 7f2e58c00700 1 -- 172.21.15.137:0/3453497007 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f2e5c19acc0 con 0x7f2e400390f0 2024-04-25T01:59:55.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T01:59:55.568 INFO:teuthology.orchestra.run.smithi137.stdout:[{"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}] 2024-04-25T01:59:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 msgr2=0x7f2e4003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 0x7f2e4003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006fd0 tx=0x7f2e44006e40 comp rx=0 tx=0).stop 2024-04-25T01:59:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 msgr2=0x7f2e5c19f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006010 tx=0x7f2e4c004cc0 comp rx=0 tx=0).stop 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 shutdown_connections 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2e400390f0 0x7f2e4003b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 --2- 172.21.15.137:0/3453497007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e5c104080 0x7f2e5c19f610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 >> 172.21.15.137:0/3453497007 conn(0x7f2e5c0ff950 msgr2=0x7f2e5c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.567+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 shutdown_connections 2024-04-25T01:59:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:55.568+0000 7f2e62400700 1 -- 172.21.15.137:0/3453497007 wait complete. 2024-04-25T01:59:56.231 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-04-25T01:59:56.231 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:59:56.231 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-04-25T01:59:56.250 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T01:59:56.250 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T01:59:56.307 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-04-25T01:59:56.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch host add smithi174 2024-04-25T01:59:56.730 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T01:59:57.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:57 smithi137 ceph-mon[28303]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T01:59:57.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:57 smithi137 ceph-mon[28303]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T01:59:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 -- 172.21.15.137:0/2347332222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 msgr2=0x7f4204074a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T01:59:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 --2- 172.21.15.137:0/2347332222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f4204074a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009910 tx=0x7f41f4009c20 comp rx=0 tx=0).stop 2024-04-25T01:59:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 -- 172.21.15.137:0/2347332222 shutdown_connections 2024-04-25T01:59:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 --2- 172.21.15.137:0/2347332222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f4204074a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T01:59:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 -- 172.21.15.137:0/2347332222 >> 172.21.15.137:0/2347332222 conn(0x7f42040fd720 msgr2=0x7f42040ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T01:59:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 -- 172.21.15.137:0/2347332222 shutdown_connections 2024-04-25T01:59:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.649+0000 7f4209600700 1 -- 172.21.15.137:0/2347332222 wait complete. 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.651+0000 7f4209600700 1 Processor -- start 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.651+0000 7f4209600700 1 -- start start 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.651+0000 7f4209600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.651+0000 7f4209600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f420410e5f0 con 0x7f4204074660 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.651+0000 7f4202a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.652+0000 7f4202a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57120/0 (socket says 172.21.15.137:57120) 2024-04-25T01:59:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.652+0000 7f4202a00700 1 -- 172.21.15.137:0/3465729398 learned_addr learned my addr 172.21.15.137:0/3465729398 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.652+0000 7f4202a00700 1 -- 172.21.15.137:0/3465729398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420419fbc0 con 0x7f4204074660 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.652+0000 7f4202a00700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006010 tx=0x7f41f4004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.652+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4026070 con 0x7f4204074660 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.653+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41f40044a0 con 0x7f4204074660 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.653+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41f4003ba0 con 0x7f4204074660 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.653+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420419fe50 con 0x7f4204074660 2024-04-25T01:59:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.653+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4204199800 con 0x7f4204074660 2024-04-25T01:59:58.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.654+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4204075d10 con 0x7f4204074660 2024-04-25T01:59:58.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.654+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f41f4029070 con 0x7f4204074660 2024-04-25T01:59:58.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.654+0000 7f41fbe00700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 0x7f41e803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T01:59:58.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.654+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f41f401e070 con 0x7f4204074660 2024-04-25T01:59:58.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.655+0000 7f41fa000700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 0x7f41e803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T01:59:58.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.655+0000 7f41fa000700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 0x7f41e803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T01:59:58.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.660+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f41f4013070 con 0x7f4204074660 2024-04-25T01:59:58.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T01:59:58.892+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}) -- 0x7f4204063890 con 0x7f41e8039150 2024-04-25T01:59:59.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:59.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T01:59:59.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 01:59:59 smithi137 ceph-mon[28303]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:00.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:01.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:01 smithi137 ceph-mon[28303]: Deploying cephadm binary to smithi174 2024-04-25T02:00:01.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:01 smithi137 ceph-mon[28303]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:03.486 INFO:teuthology.orchestra.run.smithi137.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-04-25T02:00:03.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.480+0000 7f41fbe00700 1 -- 172.21.15.137:0/3465729398 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4204063890 con 0x7f41e8039150 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 msgr2=0x7f41e803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 0x7f41e803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 msgr2=0x7f420419f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006010 tx=0x7f41f4004cc0 comp rx=0 tx=0).stop 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 shutdown_connections 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41e8039150 0x7f41e803b610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 --2- 172.21.15.137:0/3465729398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4204074660 0x7f420419f680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 >> 172.21.15.137:0/3465729398 conn(0x7f42040fd720 msgr2=0x7f4204105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 shutdown_connections 2024-04-25T02:00:03.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:03.485+0000 7f4209600700 1 -- 172.21.15.137:0/3465729398 wait complete. 2024-04-25T02:00:03.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:03 smithi137 ceph-mon[28303]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:04.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T02:00:04.644 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:00:04.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:04 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:04.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:04 smithi137 ceph-mon[28303]: Added host smithi174 2024-04-25T02:00:04.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:04 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:04.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:04 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:04.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:04 smithi137 ceph-mon[28303]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:05.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:06.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.595+0000 7ff4e4600700 1 -- 172.21.15.137:0/222198991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 msgr2=0x7ff4dc1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.595+0000 7ff4e4600700 1 --2- 172.21.15.137:0/222198991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc1031e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009910 tx=0x7ff4d0009c20 comp rx=0 tx=0).stop 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.596+0000 7ff4e4600700 1 -- 172.21.15.137:0/222198991 shutdown_connections 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.596+0000 7ff4e4600700 1 --2- 172.21.15.137:0/222198991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc1031e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.596+0000 7ff4e4600700 1 -- 172.21.15.137:0/222198991 >> 172.21.15.137:0/222198991 conn(0x7ff4dc0fc670 msgr2=0x7ff4dc0fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.596+0000 7ff4e4600700 1 -- 172.21.15.137:0/222198991 shutdown_connections 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.596+0000 7ff4e4600700 1 -- 172.21.15.137:0/222198991 wait complete. 2024-04-25T02:00:06.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.597+0000 7ff4e4600700 1 Processor -- start 2024-04-25T02:00:06.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.597+0000 7ff4e4600700 1 -- start start 2024-04-25T02:00:06.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.598+0000 7ff4e4600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:06.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.598+0000 7ff4e4600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc10c430 con 0x7ff4dc102e00 2024-04-25T02:00:06.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.598+0000 7ff4e1c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:06.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.598+0000 7ff4e1c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57748/0 (socket says 172.21.15.137:57748) 2024-04-25T02:00:06.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.598+0000 7ff4e1c00700 1 -- 172.21.15.137:0/2431166514 learned_addr learned my addr 172.21.15.137:0/2431166514 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:00:06.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4e1c00700 1 -- 172.21.15.137:0/2431166514 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc19daf0 con 0x7ff4dc102e00 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4e1c00700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0004c10 tx=0x7ff4d0004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d0026070 con 0x7ff4dc102e00 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4d0004370 con 0x7ff4dc102e00 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc19dd80 con 0x7ff4dc102e00 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d0003bf0 con 0x7ff4dc102e00 2024-04-25T02:00:06.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.599+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc197680 con 0x7ff4dc102e00 2024-04-25T02:00:06.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.600+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff4d0029070 con 0x7ff4dc102e00 2024-04-25T02:00:06.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.600+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc06a7d0 con 0x7ff4dc102e00 2024-04-25T02:00:06.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.601+0000 7ff4da000700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 0x7ff4c403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:06.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.601+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff4d001e070 con 0x7ff4dc102e00 2024-04-25T02:00:06.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.601+0000 7ff4e1200700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 0x7ff4c403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:06.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.602+0000 7ff4e1200700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 0x7ff4c403b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8006fd0 tx=0x7ff4c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:06.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.607+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff4d0013070 con 0x7ff4dc102e00 2024-04-25T02:00:06.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.838+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4dc198bb0 con 0x7ff4c4039150 2024-04-25T02:00:06.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.839+0000 7ff4da000700 1 -- 172.21.15.137:0/2431166514 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7ff4dc198bb0 con 0x7ff4c4039150 2024-04-25T02:00:06.843 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:00:06.843 INFO:teuthology.orchestra.run.smithi137.stdout:[{"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 msgr2=0x7ff4c403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 0x7ff4c403b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8006fd0 tx=0x7ff4c8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 msgr2=0x7ff4dc19d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0004c10 tx=0x7ff4d0004cf0 comp rx=0 tx=0).stop 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 shutdown_connections 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff4c4039150 0x7ff4c403b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 --2- 172.21.15.137:0/2431166514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff4dc102e00 0x7ff4dc19d5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:06.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 >> 172.21.15.137:0/2431166514 conn(0x7ff4dc0fc670 msgr2=0x7ff4dc103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:06.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.842+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 shutdown_connections 2024-04-25T02:00:06.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:06.843+0000 7ff4e4600700 1 -- 172.21.15.137:0/2431166514 wait complete. 2024-04-25T02:00:07.456 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:07 smithi137 ceph-mon[28303]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:07.457 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:07.504 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T02:00:07.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T02:00:07.925 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:00:08.368 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:08 smithi137 ceph-mon[28303]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:09.335 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:09 smithi137 ceph-mon[28303]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.862+0000 7fad12800700 1 -- 172.21.15.137:0/2413961175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 msgr2=0x7fad0c104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.862+0000 7fad12800700 1 --2- 172.21.15.137:0/2413961175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c104460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facfc009910 tx=0x7facfc009c20 comp rx=0 tx=0).stop 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.863+0000 7fad12800700 1 -- 172.21.15.137:0/2413961175 shutdown_connections 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.863+0000 7fad12800700 1 --2- 172.21.15.137:0/2413961175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c104460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.863+0000 7fad12800700 1 -- 172.21.15.137:0/2413961175 >> 172.21.15.137:0/2413961175 conn(0x7fad0c0ff950 msgr2=0x7fad0c101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.863+0000 7fad12800700 1 -- 172.21.15.137:0/2413961175 shutdown_connections 2024-04-25T02:00:09.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.863+0000 7fad12800700 1 -- 172.21.15.137:0/2413961175 wait complete. 2024-04-25T02:00:09.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.864+0000 7fad12800700 1 Processor -- start 2024-04-25T02:00:09.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.864+0000 7fad12800700 1 -- start start 2024-04-25T02:00:09.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.864+0000 7fad12800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:09.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.864+0000 7fad12800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10e590 con 0x7fad0c104080 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.865+0000 7fad0b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.865+0000 7fad0b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57772/0 (socket says 172.21.15.137:57772) 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.865+0000 7fad0b400700 1 -- 172.21.15.137:0/1493818208 learned_addr learned my addr 172.21.15.137:0/1493818208 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.865+0000 7fad0b400700 1 -- 172.21.15.137:0/1493818208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c19fba0 con 0x7fad0c104080 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.865+0000 7fad0b400700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:09.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.866+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facfc026070 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.866+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facfc0044a0 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.866+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c19fe90 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.866+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facfc003a70 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.866+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1997e0 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.867+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c105560 con 0x7fad0c104080 2024-04-25T02:00:09.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.867+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7facfc029070 con 0x7fad0c104080 2024-04-25T02:00:09.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.867+0000 7fad03e00700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 0x7facf003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:09.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.867+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7facfc01e070 con 0x7fad0c104080 2024-04-25T02:00:09.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.868+0000 7fad0aa00700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 0x7facf003b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:09.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.868+0000 7fad0aa00700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 0x7facf003b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facf8006fd0 tx=0x7facf8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:09.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:09.873+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7facfc013070 con 0x7fad0c104080 2024-04-25T02:00:10.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.156+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fad0c19adb0 con 0x7fad0c104080 2024-04-25T02:00:10.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.408+0000 7fad03e00700 1 -- 172.21.15.137:0/1493818208 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7facfc00ba70 con 0x7fad0c104080 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:00:10.414 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:10 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T02:00:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 msgr2=0x7facf003b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:10.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 0x7facf003b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facf8006fd0 tx=0x7facf8006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 msgr2=0x7fad0c19f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc004cc0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 shutdown_connections 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7facf0039150 0x7facf003b610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 --2- 172.21.15.137:0/1493818208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad0c104080 0x7fad0c19f660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:10.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 >> 172.21.15.137:0/1493818208 conn(0x7fad0c0ff950 msgr2=0x7fad0c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 shutdown_connections 2024-04-25T02:00:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:10.412+0000 7fad12800700 1 -- 172.21.15.137:0/1493818208 wait complete. 2024-04-25T02:00:10.418 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-04-25T02:00:11.065 INFO:tasks.cephadm:Adding mon.a on smithi137 2024-04-25T02:00:11.065 INFO:tasks.cephadm:Adding mon.b on smithi163 2024-04-25T02:00:11.065 INFO:tasks.cephadm:Adding mon.c on smithi174 2024-04-25T02:00:11.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c' 2024-04-25T02:00:11.290 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:11.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:11.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:11.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:11.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T02:00:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 -- 172.21.15.174:0/3570264520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 msgr2=0x7fae20100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 --2- 172.21.15.174:0/3570264520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20100240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae10009910 tx=0x7fae10009c20 comp rx=0 tx=0).stop 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 -- 172.21.15.174:0/3570264520 shutdown_connections 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 --2- 172.21.15.174:0/3570264520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20100240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 -- 172.21.15.174:0/3570264520 >> 172.21.15.174:0/3570264520 conn(0x7fae200fb960 msgr2=0x7fae200fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 -- 172.21.15.174:0/3570264520 shutdown_connections 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.750+0000 7fae25b08700 1 -- 172.21.15.174:0/3570264520 wait complete. 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.751+0000 7fae25b08700 1 Processor -- start 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.751+0000 7fae25b08700 1 -- start start 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.751+0000 7fae25b08700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:12.755 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.751+0000 7fae25b08700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae2010c370 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.751+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.752+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.174:39040/0 (socket says 172.21.15.174:39040) 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.752+0000 7fae1f7fe700 1 -- 172.21.15.174:0/3634279059 learned_addr learned my addr 172.21.15.174:0/3634279059 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.752+0000 7fae1f7fe700 1 -- 172.21.15.174:0/3634279059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae20103560 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.752+0000 7fae1f7fe700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae100052a0 tx=0x7fae10004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.753+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae10026070 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.753+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae20101c10 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.753+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae201020d0 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.753+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae1000bbf0 con 0x7fae200ffe60 2024-04-25T02:00:12.757 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.753+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae10004830 con 0x7fae200ffe60 2024-04-25T02:00:12.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.754+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c005330 con 0x7fae200ffe60 2024-04-25T02:00:12.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.754+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fae10029070 con 0x7fae200ffe60 2024-04-25T02:00:12.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.754+0000 7fae1cff9700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 0x7fae0803b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:12.758 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.754+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fae1001e070 con 0x7fae200ffe60 2024-04-25T02:00:12.759 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.755+0000 7fae1effd700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 0x7fae0803b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:12.759 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.756+0000 7fae1effd700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 0x7fae0803b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae14006fd0 tx=0x7fae14006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:12.775 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.771+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fae10013070 con 0x7fae200ffe60 2024-04-25T02:00:12.982 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.979+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}) -- 0x7fae0c000c80 con 0x7fae08039290 2024-04-25T02:00:12.998 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.994+0000 7fae1cff9700 1 -- 172.21.15.174:0/3634279059 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fae0c000c80 con 0x7fae08039290 2024-04-25T02:00:12.998 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-04-25T02:00:13.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 msgr2=0x7fae0803b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:13.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 0x7fae0803b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae14006fd0 tx=0x7fae14006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:13.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 msgr2=0x7fae20101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:13.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae100052a0 tx=0x7fae10004cc0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 shutdown_connections 2024-04-25T02:00:13.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae08039290 0x7fae0803b750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 --2- 172.21.15.174:0/3634279059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae200ffe60 0x7fae20101670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:13.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 >> 172.21.15.174:0/3634279059 conn(0x7fae200fb960 msgr2=0x7fae200fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:13.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 shutdown_connections 2024-04-25T02:00:13.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:12.996+0000 7fae25b08700 1 -- 172.21.15.174:0/3634279059 wait complete. 2024-04-25T02:00:13.609 DEBUG:teuthology.orchestra.run.smithi163:mon.b> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.b.service 2024-04-25T02:00:13.612 DEBUG:teuthology.orchestra.run.smithi174:mon.c> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.c.service 2024-04-25T02:00:13.614 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T02:00:13.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:00:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:14.288 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:14.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:14 smithi137 ceph-mon[28303]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:14.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:14 smithi137 ceph-mon[28303]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c;count:3 2024-04-25T02:00:14.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:14 smithi137 ceph-mon[28303]: Deploying daemon mon.c on smithi174 2024-04-25T02:00:15.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:15 smithi137 ceph-mon[28303]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 -- 172.21.15.174:0/3622082546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 msgr2=0x7f204c106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 --2- 172.21.15.174:0/3622082546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c106fc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f203c009910 tx=0x7f203c009c20 comp rx=0 tx=0).stop 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 -- 172.21.15.174:0/3622082546 shutdown_connections 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 --2- 172.21.15.174:0/3622082546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c106fc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 -- 172.21.15.174:0/3622082546 >> 172.21.15.174:0/3622082546 conn(0x7f204c077800 msgr2=0x7f204c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 -- 172.21.15.174:0/3622082546 shutdown_connections 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.337+0000 7f2053caf700 1 -- 172.21.15.174:0/3622082546 wait complete. 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.338+0000 7f2053caf700 1 Processor -- start 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.338+0000 7f2053caf700 1 -- start start 2024-04-25T02:00:16.342 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.338+0000 7f2053caf700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:16.343 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.338+0000 7f2053caf700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f204c10b2e0 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.339+0000 7f2051a4b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.339+0000 7f2051a4b700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.174:39058/0 (socket says 172.21.15.174:39058) 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.339+0000 7f2051a4b700 1 -- 172.21.15.174:0/1976802287 learned_addr learned my addr 172.21.15.174:0/1976802287 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.339+0000 7f2051a4b700 1 -- 172.21.15.174:0/1976802287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c19d920 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2051a4b700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f203c0052a0 tx=0x7f203c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c026070 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c19dbb0 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c1975a0 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f203c00bc50 con 0x7f204c106be0 2024-04-25T02:00:16.344 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.340+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203c0039e0 con 0x7f204c106be0 2024-04-25T02:00:16.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.341+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c1021e0 con 0x7f204c106be0 2024-04-25T02:00:16.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.341+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f203c029070 con 0x7f204c106be0 2024-04-25T02:00:16.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.341+0000 7f2042ffd700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 0x7f203803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:16.345 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.342+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f203c01e070 con 0x7f204c106be0 2024-04-25T02:00:16.346 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.342+0000 7f205124a700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 0x7f203803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:16.347 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.343+0000 7f205124a700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 0x7f203803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:16.359 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.356+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f203c013070 con 0x7f204c106be0 2024-04-25T02:00:16.635 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.631+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f204c198ad0 con 0x7f204c106be0 2024-04-25T02:00:16.636 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.632+0000 7f2042ffd700 1 -- 172.21.15.174:0/1976802287 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f203c020370 con 0x7f204c106be0 2024-04-25T02:00:16.636 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T02:00:16.636 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T01:58:08.818093Z","created":"2024-04-25T01:58:08.818093Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T02:00:16.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 msgr2=0x7f203803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:16.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 0x7f203803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048006e40 comp rx=0 tx=0).stop 2024-04-25T02:00:16.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 msgr2=0x7f204c19d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:16.639 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f203c0052a0 tx=0x7f203c004cc0 comp rx=0 tx=0).stop 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 shutdown_connections 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20380390f0 0x7f203803b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 --2- 172.21.15.174:0/1976802287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f204c106be0 0x7f204c19d3e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 >> 172.21.15.174:0/1976802287 conn(0x7f204c077800 msgr2=0x7f204c069660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 shutdown_connections 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:16.635+0000 7f2053caf700 1 -- 172.21.15.174:0/1976802287 wait complete. 2024-04-25T02:00:16.640 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-04-25T02:00:16.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:16 smithi137 ceph-mon[28303]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:17.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:17 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/1976802287' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:18.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 podman[33152]: 2024-04-25 02:00:18.313181981 +0000 UTC m=+0.118741954 container create 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-25T02:00:18.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:18 smithi137 ceph-mon[28303]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.793 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T02:00:18.794 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 podman[33152]: 2024-04-25 02:00:18.498685135 +0000 UTC m=+0.304245108 container init 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 podman[33152]: 2024-04-25 02:00:18.50160874 +0000 UTC m=+0.307168714 container start 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev), process ceph-mon, pid 2 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pidfile_write: ignore empty --pid-file 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: load: jerasure load: lrc 2024-04-25T02:00:18.817 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: RocksDB version: 7.9.2 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Git sha 0 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Compile date 2024-04-24 16:41:23 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: DB SUMMARY 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: DB Session ID: 4Z01I2NQYALUN2PGTEBP 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: CURRENT file: CURRENT 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.error_if_exists: 0 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.create_if_missing: 0 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.paranoid_checks: 1 2024-04-25T02:00:18.818 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.env: 0x5576db344c60 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.info_log: 0x5576dbca1aa0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.statistics: (nil) 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.use_fsync: 0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_log_file_size: 0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T02:00:18.819 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_fallocate: 1 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.use_direct_reads: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.db_log_dir: 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.wal_dir: 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T02:00:18.820 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.write_buffer_manager: 0x5576dbc741e0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.unordered_write: 0 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T02:00:18.821 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.row_cache: None 2024-04-25T02:00:18.822 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.wal_filter: None 2024-04-25T02:00:18.823 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.two_write_queues: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.wal_compression: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.atomic_flush: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.log_readahead_size: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T02:00:18.824 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_background_jobs: 2 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_background_compactions: -1 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_subcompactions: 1 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T02:00:18.825 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_open_files: -1 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_background_flushes: -1 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Compression algorithms supported: 2024-04-25T02:00:18.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kZSTD supported: 0 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kXpressCompression supported: 0 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kZlibCompression supported: 1 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kSnappyCompression supported: 1 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kLZ4Compression supported: 1 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: kBZip2Compression supported: 0 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.merge_operator: 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_filter: None 2024-04-25T02:00:18.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5576dbca1ba0) 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks: 1 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_top_level_index_and_filter: 1 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_type: 0 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_index_type: 0 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_shortening: 1 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: checksum: 4 2024-04-25T02:00:18.828 INFO:journalctl@ceph.mon.c.smithi174.stdout: no_block_cache: 0 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache: 0x5576dbca5090 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_name: BinnedLRUCache 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_options: 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: capacity : 536870912 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_shard_bits : 4 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: strict_capacity_limit : 0 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: high_pri_pool_ratio: 0.000 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_compressed: (nil) 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: persistent_cache: (nil) 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size: 4096 2024-04-25T02:00:18.829 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size_deviation: 10 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_restart_interval: 16 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_block_restart_interval: 1 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: metadata_block_size: 4096 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: partition_filters: 0 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: use_delta_encoding: 1 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: filter_policy: bloomfilter 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: whole_key_filtering: 1 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: verify_compression: 0 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: read_amp_bytes_per_bit: 0 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: format_version: 5 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_index_compression: 1 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_align: 0 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: max_auto_readahead_size: 262144 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: prepopulate_block_cache: 0 2024-04-25T02:00:18.830 INFO:journalctl@ceph.mon.c.smithi174.stdout: initial_auto_readahead_size: 8192 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression: NoCompression 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.num_levels: 7 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T02:00:18.831 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T02:00:18.832 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T02:00:18.833 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T02:00:18.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.table_properties_collectors: 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.inplace_update_support: 0 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.bloom_locality: 0 2024-04-25T02:00:18.835 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.max_successive_merges: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.ttl: 2592000 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enable_blob_files: false 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.min_blob_size: 0 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T02:00:18.836 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 783fd6cd-f1f2-4e46-9d01-b39f24fdec64 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010418531365, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010418531778, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714010418, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "783fd6cd-f1f2-4e46-9d01-b39f24fdec64", "db_session_id": "4Z01I2NQYALUN2PGTEBP", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010418531864, "job": 1, "event": "recovery_finished"} 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T02:00:18.837 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5576dbd96000 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: DB pointer 0x5576dbd80000 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** DB Stats ** 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-04-25T02:00:18.838 INFO:journalctl@ceph.mon.c.smithi174.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T02:00:18.839 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache BinnedLRUCache@0x5576dbca5090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: using public_addr v2:172.21.15.174:0/0 -> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: starting mon.c rank -1 at public addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] at bind addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(???) e0 preinit fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:18.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).mds e1 new map 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: e1 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: legacy client fscid: -1 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout: No filesystems configured 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T02:00:18.841 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:18.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Deploying cephadm binary to smithi174 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Added host smithi174 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.844 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:00:18.845 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:18.846 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c;count:3 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: Deploying daemon mon.c on smithi174 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/1976802287' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 ceph-mon[33171]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 bash[33152]: 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 2024-04-25T02:00:18.847 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:18 smithi174 systemd[1]: Started Ceph mon.c for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:00:19.025 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:00:23.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:23.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: mon.a calling monitor election 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: mon.c calling monitor election 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: monmap epoch 2 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: last_changed 2024-04-25T02:00:18.572133+0000 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: min_mon_release 19 (squid) 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: election_strategy: 1 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: fsmap 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: mgrmap e13: x(active, since 57s) 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: overall HEALTH_OK 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:23.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/2338616369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 msgr2=0x7f5c08005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:23.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/2338616369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c08005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c18079470 tx=0x7f5c0c014ec0 comp rx=0 tx=0).stop 2024-04-25T02:00:23.967 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/2338616369 shutdown_connections 2024-04-25T02:00:23.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/2338616369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c08005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:23.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/2338616369 >> 172.21.15.174:0/2338616369 conn(0x7f5c180772e0 msgr2=0x7f5c180776f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:23.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/2338616369 shutdown_connections 2024-04-25T02:00:23.968 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.963+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/2338616369 wait complete. 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.964+0000 7f5c1f0f6700 1 Processor -- start 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.964+0000 7f5c1f0f6700 1 -- start start 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c1f0f6700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c1819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c1f0f6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c1f0f6700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18109f20 con 0x7f5c080035c0 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c1f0f6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18109da0 con 0x7f5c1819dbc0 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:45742/0 (socket says 172.21.15.174:45742) 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 -- 172.21.15.174:0/3553535439 learned_addr learned my addr 172.21.15.174:0/3553535439 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:00:23.969 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 -- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 msgr2=0x7f5c18197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T02:00:23.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 -- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 msgr2=0x7f5c18197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:00:23.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:00:23.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c17fff700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:00:23.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.965+0000 7f5c1ce92700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c1819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:23.970 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.966+0000 7f5c1ce92700 1 -- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 msgr2=0x7f5c18197750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.966+0000 7f5c1ce92700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.966+0000 7f5c1ce92700 1 -- 172.21.15.174:0/3553535439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1819e140 con 0x7f5c080035c0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.966+0000 7f5c1ce92700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c1819d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c01d000 tx=0x7f5c0c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.967+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5c0c004aa0 con 0x7f5c080035c0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.967+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c18197cf0 con 0x7f5c080035c0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.967+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c18198280 con 0x7f5c080035c0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.967+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c0c004c40 con 0x7f5c080035c0 2024-04-25T02:00:23.971 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.967+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5c0c012650 con 0x7f5c080035c0 2024-04-25T02:00:23.972 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.968+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1806a190 con 0x7f5c080035c0 2024-04-25T02:00:23.972 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.968+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5c0c01e470 con 0x7f5c080035c0 2024-04-25T02:00:23.972 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.969+0000 7f5c15ffb700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 0x7f5bfc03b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:23.972 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.969+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5c0c025070 con 0x7f5c080035c0 2024-04-25T02:00:23.973 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.969+0000 7f5c17fff700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 0x7f5bfc03b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:23.974 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.970+0000 7f5c17fff700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 0x7f5bfc03b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009180 tx=0x7f5c04008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:23.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:23.984+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5c0c01cbf0 con 0x7f5c080035c0 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: mon.a calling monitor election 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: mon.c calling monitor election 2024-04-25T02:00:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: monmap epoch 2 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: last_changed 2024-04-25T02:00:18.572133+0000 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: min_mon_release 19 (squid) 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: election_strategy: 1 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: fsmap 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: mgrmap e13: x(active, since 57s) 2024-04-25T02:00:24.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: overall HEALTH_OK 2024-04-25T02:00:24.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:24.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:24.269 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.265+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5c18198c80 con 0x7f5c080035c0 2024-04-25T02:00:24.270 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.266+0000 7f5c15ffb700 1 -- 172.21.15.174:0/3553535439 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f5c0c00c2d0 con 0x7f5c080035c0 2024-04-25T02:00:24.270 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T02:00:24.270 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T02:00:18.572133Z","created":"2024-04-25T01:58:08.818093Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 msgr2=0x7f5bfc03b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 0x7f5bfc03b350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009180 tx=0x7f5c04008040 comp rx=0 tx=0).stop 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 msgr2=0x7f5c1819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c1819d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c01d000 tx=0x7f5c0c00fc60 comp rx=0 tx=0).stop 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 shutdown_connections 2024-04-25T02:00:24.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5bfc038e90 0x7f5bfc03b350 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c080035c0 0x7f5c1819d680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 --2- 172.21.15.174:0/3553535439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c1819dbc0 0x7f5c18197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 >> 172.21.15.174:0/3553535439 conn(0x7f5c180772e0 msgr2=0x7f5c180fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 shutdown_connections 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:24.269+0000 7f5c1f0f6700 1 -- 172.21.15.174:0/3553535439 wait complete. 2024-04-25T02:00:24.274 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: Deploying daemon mon.b on smithi163 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/3553535439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:24.851 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:25.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: Deploying daemon mon.b on smithi163 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/3553535439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:25.881 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-25T02:00:25.881 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T02:00:26.125 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:00:27.367 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 podman[32558]: 2024-04-25 02:00:27.255095975 +0000 UTC m=+0.117198435 container create 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-25T02:00:27.424 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:27 smithi174 ceph-mon[33171]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.628 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 podman[32558]: 2024-04-25 02:00:27.474352608 +0000 UTC m=+0.336455066 container init 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-25T02:00:27.628 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 podman[32558]: 2024-04-25 02:00:27.477398407 +0000 UTC m=+0.339500867 container start 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0) 2024-04-25T02:00:27.628 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev), process ceph-mon, pid 2 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pidfile_write: ignore empty --pid-file 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: load: jerasure load: lrc 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: RocksDB version: 7.9.2 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Git sha 0 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Compile date 2024-04-24 16:41:23 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: DB SUMMARY 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: DB Session ID: QTVQBDFWTC1BOLUFNRK8 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: CURRENT file: CURRENT 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-04-25T02:00:27.629 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.error_if_exists: 0 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.create_if_missing: 0 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.paranoid_checks: 1 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.env: 0x561d522bcc60 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.info_log: 0x561d53951aa0 2024-04-25T02:00:27.630 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.statistics: (nil) 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.use_fsync: 0 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_log_file_size: 0 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_fallocate: 1 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T02:00:27.631 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.use_direct_reads: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.db_log_dir: 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.wal_dir: 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T02:00:27.632 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.write_buffer_manager: 0x561d539241e0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.unordered_write: 0 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T02:00:27.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.row_cache: None 2024-04-25T02:00:27.634 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.wal_filter: None 2024-04-25T02:00:27.635 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T02:00:27.635 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T02:00:27.635 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.two_write_queues: 0 2024-04-25T02:00:27.635 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.wal_compression: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.atomic_flush: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.log_readahead_size: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T02:00:27.636 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_background_jobs: 2 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_background_compactions: -1 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_subcompactions: 1 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_open_files: -1 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T02:00:27.637 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_background_flushes: -1 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Compression algorithms supported: 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kZSTD supported: 0 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kXpressCompression supported: 0 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kZlibCompression supported: 1 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kSnappyCompression supported: 1 2024-04-25T02:00:27.638 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kLZ4Compression supported: 1 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: kBZip2Compression supported: 0 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.merge_operator: 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_filter: None 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T02:00:27.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561d53951ba0) 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: cache_index_and_filter_blocks: 1 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: pin_top_level_index_and_filter: 1 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: index_type: 0 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: data_block_index_type: 0 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: index_shortening: 1 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T02:00:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout: checksum: 4 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: no_block_cache: 0 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_cache: 0x561d53955090 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_cache_name: BinnedLRUCache 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_cache_options: 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: capacity : 536870912 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: num_shard_bits : 4 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: strict_capacity_limit : 0 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: high_pri_pool_ratio: 0.000 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_cache_compressed: (nil) 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: persistent_cache: (nil) 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_size: 4096 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_size_deviation: 10 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_restart_interval: 16 2024-04-25T02:00:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout: index_block_restart_interval: 1 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: metadata_block_size: 4096 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: partition_filters: 0 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: use_delta_encoding: 1 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: filter_policy: bloomfilter 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: whole_key_filtering: 1 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: verify_compression: 0 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: read_amp_bytes_per_bit: 0 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: format_version: 5 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: enable_index_compression: 1 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: block_align: 0 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: max_auto_readahead_size: 262144 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: prepopulate_block_cache: 0 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: initial_auto_readahead_size: 8192 2024-04-25T02:00:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression: NoCompression 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.num_levels: 7 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T02:00:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T02:00:27.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T02:00:27.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T02:00:27.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.table_properties_collectors: 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.inplace_update_support: 0 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T02:00:27.647 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.bloom_locality: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.max_successive_merges: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.ttl: 2592000 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enable_blob_files: false 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.min_blob_size: 0 2024-04-25T02:00:27.648 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fcaa2f49-9cf5-4452-ae5e-3ac4337388cf 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010427507396, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-25T02:00:27.649 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010427507836, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714010427, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fcaa2f49-9cf5-4452-ae5e-3ac4337388cf", "db_session_id": "QTVQBDFWTC1BOLUFNRK8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714010427507917, "job": 1, "event": "recovery_finished"} 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561d53a46000 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: DB pointer 0x561d53a30000 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: ** DB Stats ** 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T02:00:27.650 INFO:journalctl@ceph.mon.b.smithi163.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: ** Compaction Stats [default] ** 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: ** Compaction Stats [default] ** 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-25T02:00:27.651 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Block cache BinnedLRUCache@0x561d53955090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-25T02:00:27.652 INFO:journalctl@ceph.mon.b.smithi163.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: using public_addr v2:172.21.15.163:0/0 -> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: starting mon.b rank -1 at public addrs [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] at bind addrs [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(???) e0 preinit fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).mds e1 new map 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: e1 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: legacy client fscid: -1 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: 2024-04-25T02:00:27.653 INFO:journalctl@ceph.mon.b.smithi163.stdout: No filesystems configured 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.654 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:27.655 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Deploying cephadm binary to smithi174 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Added host smithi174 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.656 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1493818208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:27.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Saving service mon spec with placement smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c;count:3 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Deploying daemon mon.c on smithi174 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/1976802287' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.a calling monitor election 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.c calling monitor election 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.659 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: monmap epoch 2 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: last_changed 2024-04-25T02:00:18.572133+0000 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: min_mon_release 19 (squid) 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: election_strategy: 1 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: fsmap 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:27.660 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mgrmap e13: x(active, since 57s) 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: overall HEALTH_OK 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: Deploying daemon mon.b on smithi163 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/3553535439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 ceph-mon[32577]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 bash[32558]: 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da 2024-04-25T02:00:27.661 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:27 smithi163 systemd[1]: Started Ceph mon.b for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:00:27.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:27 smithi137 ceph-mon[28303]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:32.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: mon.c calling monitor election 2024-04-25T02:00:32.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: mon.a calling monitor election 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:32.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: monmap epoch 3 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: min_mon_release 19 (squid) 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: election_strategy: 1 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: fsmap 2024-04-25T02:00:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: mgrmap e13: x(active, since 66s) 2024-04-25T02:00:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: overall HEALTH_OK 2024-04-25T02:00:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:32 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: mon.c calling monitor election 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: mon.a calling monitor election 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: monmap epoch 3 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: min_mon_release 19 (squid) 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: election_strategy: 1 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:33.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: fsmap 2024-04-25T02:00:33.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:33.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: mgrmap e13: x(active, since 66s) 2024-04-25T02:00:33.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: overall HEALTH_OK 2024-04-25T02:00:33.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:32 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.570 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 -- 172.21.15.174:0/2212066471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62f80084b0 msgr2=0x7f62f800a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 --2- 172.21.15.174:0/2212066471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62f80084b0 0x7f62f800a920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6310101cf0 tx=0x7f630400fe90 comp rx=0 tx=0).stop 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 -- 172.21.15.174:0/2212066471 shutdown_connections 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 --2- 172.21.15.174:0/2212066471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62f80084b0 0x7f62f800a920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 -- 172.21.15.174:0/2212066471 >> 172.21.15.174:0/2212066471 conn(0x7f63100fc720 msgr2=0x7f63100feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 -- 172.21.15.174:0/2212066471 shutdown_connections 2024-04-25T02:00:33.571 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.566+0000 7f6314b87700 1 -- 172.21.15.174:0/2212066471 wait complete. 2024-04-25T02:00:33.574 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 Processor -- start 2024-04-25T02:00:33.574 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 -- start start 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6310195ce0 0x7f6310196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6310107c90 con 0x7f6310195ce0 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6310107b10 con 0x7f631019bb60 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f6314b87700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6310107e10 con 0x7f62f80084b0 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f630e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f630e59c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:60586/0 (socket says 172.21.15.174:60586) 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.567+0000 7f630e59c700 1 -- 172.21.15.174:0/2727238010 learned_addr learned my addr 172.21.15.174:0/2727238010 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630dd9b700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630ed9d700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6310195ce0 0x7f6310196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630dd9b700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 msgr2=0x7f63101957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T02:00:33.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630dd9b700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 msgr2=0x7f63101957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630dd9b700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630dd9b700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 msgr2=0x7f63101957a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6310195ce0 msgr2=0x7f6310196190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6310195ce0 0x7f6310196190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 -- 172.21.15.174:0/2727238010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63101a2480 con 0x7f62f80084b0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f630e59c700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6304013f80 tx=0x7f63040056e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630402c030 con 0x7f62f80084b0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6304011c80 con 0x7f62f80084b0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63101a26b0 con 0x7f62f80084b0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630401d670 con 0x7f62f80084b0 2024-04-25T02:00:33.576 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.568+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63101a2b60 con 0x7f62f80084b0 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.569+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f630402f070 con 0x7f62f80084b0 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.569+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6310102370 con 0x7f62f80084b0 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.569+0000 7f62ff7fe700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 0x7f62f003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.569+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f630404ec40 con 0x7f62f80084b0 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.570+0000 7f630dd9b700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 0x7f62f003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:33.577 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.570+0000 7f630dd9b700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 0x7f62f003ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6300009850 tx=0x7f6300008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:33.578 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.574+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f63040103d0 con 0x7f62f80084b0 2024-04-25T02:00:33.724 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.724 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.724 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:33.725 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.866 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.867 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:33.867 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:33.867 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:33.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.862+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f631002db30 con 0x7f62f80084b0 2024-04-25T02:00:33.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.862+0000 7f62ff7fe700 1 -- 172.21.15.174:0/2727238010 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f630402d270 con 0x7f62f80084b0 2024-04-25T02:00:33.868 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-04-25T02:00:33.868 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","modified":"2024-04-25T02:00:27.530631Z","created":"2024-04-25T01:58:08.818093Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:3300","nonce":0},{"type":"v1","addr":"172.21.15.163:6789","nonce":0}]},"addr":"172.21.15.163:6789/0","public_addr":"172.21.15.163:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 msgr2=0x7f62f003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 0x7f62f003ba40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6300009850 tx=0x7f6300008040 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 msgr2=0x7f631019b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6304013f80 tx=0x7f63040056e0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 shutdown_connections 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62f0039580 0x7f62f003ba40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6310195ce0 0x7f6310196190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62f80084b0 0x7f631019b620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 --2- 172.21.15.174:0/2727238010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f631019bb60 0x7f63101957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 >> 172.21.15.174:0/2727238010 conn(0x7f63100fc720 msgr2=0x7f63100ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:33.869 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 shutdown_connections 2024-04-25T02:00:33.870 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:33.865+0000 7f6314b87700 1 -- 172.21.15.174:0/2727238010 wait complete. 2024-04-25T02:00:33.870 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 3 2024-04-25T02:00:34.828 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T02:00:34.828 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: mon.c calling monitor election 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: mon.a calling monitor election 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:34.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: monmap epoch 3 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: min_mon_release 19 (squid) 2024-04-25T02:00:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: election_strategy: 1 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: fsmap 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: mgrmap e13: x(active, since 66s) 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: overall HEALTH_OK 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:35.213 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:00:35.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mon.b calling monitor election 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mon.b calling monitor election 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mon.c calling monitor election 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mon.a calling monitor election 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: monmap epoch 3 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:35.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: min_mon_release 19 (squid) 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: election_strategy: 1 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: fsmap 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: mgrmap e13: x(active, since 68s) 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: overall HEALTH_OK 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mon.b calling monitor election 2024-04-25T02:00:35.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mon.b calling monitor election 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mon.c calling monitor election 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mon.a calling monitor election 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: monmap epoch 3 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: min_mon_release 19 (squid) 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: election_strategy: 1 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: fsmap 2024-04-25T02:00:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: mgrmap e13: x(active, since 68s) 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: overall HEALTH_OK 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mon.b calling monitor election 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mon.b calling monitor election 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mon.c calling monitor election 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mon.a calling monitor election 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: monmap epoch 3 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: last_changed 2024-04-25T02:00:27.530631+0000 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: created 2024-04-25T01:58:08.818093+0000 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: min_mon_release 19 (squid) 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: election_strategy: 1 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: 0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: fsmap 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: mgrmap e13: x(active, since 68s) 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: overall HEALTH_OK 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:36.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:36.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:36 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:36.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:36 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:36 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:37.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:37 smithi163 ceph-mon[32577]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T02:00:37.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:37 smithi163 ceph-mon[32577]: Reconfiguring daemon mon.a on smithi137 2024-04-25T02:00:37.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:37 smithi163 ceph-mon[32577]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:37.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:37.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:37 smithi137 ceph-mon[28303]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T02:00:37.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:37 smithi137 ceph-mon[28303]: Reconfiguring daemon mon.a on smithi137 2024-04-25T02:00:37.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:37 smithi137 ceph-mon[28303]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:37.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:37.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:37 smithi174 ceph-mon[33171]: Reconfiguring mon.a (unknown last config time)... 2024-04-25T02:00:37.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:37 smithi174 ceph-mon[33171]: Reconfiguring daemon mon.a on smithi137 2024-04-25T02:00:37.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:37 smithi174 ceph-mon[33171]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:37.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 -- 172.21.15.137:0/2197730679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 msgr2=0x7fb078104480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 --2- 172.21.15.137:0/2197730679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb078104480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009910 tx=0x7fb06c009c20 comp rx=0 tx=0).stop 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 -- 172.21.15.137:0/2197730679 shutdown_connections 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 --2- 172.21.15.137:0/2197730679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb078104480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 -- 172.21.15.137:0/2197730679 >> 172.21.15.137:0/2197730679 conn(0x7fb0780ff910 msgr2=0x7fb078101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:38.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 -- 172.21.15.137:0/2197730679 shutdown_connections 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.886+0000 7fb07fe00700 1 -- 172.21.15.137:0/2197730679 wait complete. 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.887+0000 7fb07fe00700 1 Processor -- start 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.887+0000 7fb07fe00700 1 -- start start 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 0x7fb078199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 0x7fb07819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb07810e570 con 0x7fb0781040a0 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb07810e3f0 con 0x7fb07819fe50 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07fe00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb07810e6f0 con 0x7fb07819a010 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48528/0 (socket says 172.21.15.137:48528) 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 -- 172.21.15.137:0/3602902857 learned_addr learned my addr 172.21.15.137:0/3602902857 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07de00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 0x7fb07819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:38.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07ca00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 0x7fb078199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 -- 172.21.15.137:0/3602902857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 msgr2=0x7fb07819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 0x7fb07819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 -- 172.21.15.137:0/3602902857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 msgr2=0x7fb078199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 0x7fb078199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07d400700 1 -- 172.21.15.137:0/3602902857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0781a67e0 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07de00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 0x7fb07819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.888+0000 7fb07ca00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 0x7fb078199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb07d400700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb06c006010 tx=0x7fb06c0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c026070 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb06c00be30 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00fc10 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0781a6a10 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.889+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0781a6f00 con 0x7fb0781040a0 2024-04-25T02:00:38.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.890+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb06c029070 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.890+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb078063890 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.891+0000 7fb076000700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 0x7fb06003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.891+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb06c04cf80 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.891+0000 7fb07ca00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 0x7fb06003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.892+0000 7fb07ca00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 0x7fb06003ba40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb064009910 tx=0x7fb064008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:37.897+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fb06c013070 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.124+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb0781a71f0 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.125+0000 7fb076000700 1 -- 172.21.15.137:0/3602902857 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fb06c030020 con 0x7fb0781040a0 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stdout:# minimal ceph.conf for 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:38.153 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stdout: mon_host = [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 msgr2=0x7fb06003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 0x7fb06003ba40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb064009910 tx=0x7fb064008040 comp rx=0 tx=0).stop 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 msgr2=0x7fb07819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb06c006010 tx=0x7fb06c0057a0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 shutdown_connections 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb060039580 0x7fb06003ba40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb07819a010 0x7fb07819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0781040a0 0x7fb07819f910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 --2- 172.21.15.137:0/3602902857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07819fe50 0x7fb078199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:38.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 >> 172.21.15.137:0/3602902857 conn(0x7fb0780ff910 msgr2=0x7fb078105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:38.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.128+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 shutdown_connections 2024-04-25T02:00:38.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:38.129+0000 7fb07fe00700 1 -- 172.21.15.137:0/3602902857 wait complete. 2024-04-25T02:00:38.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3602902857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:38.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:38.485 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3602902857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:38.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:38.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3602902857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:38.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:38.847 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T02:00:38.847 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:00:38.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T02:00:38.937 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:00:38.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:39.065 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T02:00:39.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T02:00:39.092 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T02:00:39.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:39.155 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T02:00:39.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T02:00:39.186 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T02:00:39.187 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:00:39.253 INFO:tasks.cephadm:Adding mgr.x on smithi137 2024-04-25T02:00:39.253 INFO:tasks.cephadm:Adding mgr.y on smithi163 2024-04-25T02:00:39.253 INFO:tasks.cephadm:Adding mgr.z on smithi174 2024-04-25T02:00:39.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi137=x;smithi163=y;smithi174=z' 2024-04-25T02:00:39.424 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:39 smithi174 ceph-mon[33171]: Reconfiguring mon.b (monmap changed)... 2024-04-25T02:00:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:39 smithi174 ceph-mon[33171]: Reconfiguring daemon mon.b on smithi163 2024-04-25T02:00:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:39 smithi174 ceph-mon[33171]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:39.536 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:00:39.621 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:39 smithi163 ceph-mon[32577]: Reconfiguring mon.b (monmap changed)... 2024-04-25T02:00:39.621 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:39 smithi163 ceph-mon[32577]: Reconfiguring daemon mon.b on smithi163 2024-04-25T02:00:39.621 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:39 smithi163 ceph-mon[32577]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:39.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:39 smithi137 ceph-mon[28303]: Reconfiguring mon.b (monmap changed)... 2024-04-25T02:00:39.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:39 smithi137 ceph-mon[28303]: Reconfiguring daemon mon.b on smithi163 2024-04-25T02:00:39.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:39 smithi137 ceph-mon[28303]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:40.917 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:40.917 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:40.917 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: Reconfiguring mon.c (monmap changed)... 2024-04-25T02:00:40.917 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:40.917 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:40.918 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:40.918 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: Reconfiguring daemon mon.c on smithi174 2024-04-25T02:00:40.918 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:40 smithi174 ceph-mon[33171]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:41.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: Reconfiguring mon.c (monmap changed)... 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: Reconfiguring daemon mon.c on smithi174 2024-04-25T02:00:41.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:40 smithi137 ceph-mon[28303]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:41.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:41.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: Reconfiguring mon.c (monmap changed)... 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: Reconfiguring daemon mon.c on smithi174 2024-04-25T02:00:41.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:40 smithi163 ceph-mon[32577]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 -- 172.21.15.174:0/895383623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff420102d80 msgr2=0x7ff420105170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 --2- 172.21.15.174:0/895383623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff420102d80 0x7ff420105170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009990 tx=0x7ff41c009ca0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 -- 172.21.15.174:0/895383623 shutdown_connections 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 --2- 172.21.15.174:0/895383623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420107fe0 0x7ff42010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 --2- 172.21.15.174:0/895383623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff420102d80 0x7ff420105170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.028 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 --2- 172.21.15.174:0/895383623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff4201056b0 0x7ff420107aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 -- 172.21.15.174:0/895383623 >> 172.21.15.174:0/895383623 conn(0x7ff4200fc730 msgr2=0x7ff4200feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 -- 172.21.15.174:0/895383623 shutdown_connections 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.022+0000 7ff427bc6700 1 -- 172.21.15.174:0/895383623 wait complete. 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 Processor -- start 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 -- start start 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102d80 0x7ff4201985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff420107fe0 0x7ff42019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff42010e020 con 0x7ff420102d80 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff42010dea0 con 0x7ff420107fe0 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff427bc6700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff42010e1a0 con 0x7ff4201056b0 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:55398/0 (socket says 172.21.15.174:55398) 2024-04-25T02:00:42.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 -- 172.21.15.174:0/406874810 learned_addr learned my addr 172.21.15.174:0/406874810 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 -- 172.21.15.174:0/406874810 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff420107fe0 msgr2=0x7ff42019fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff420107fe0 0x7ff42019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 -- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102d80 msgr2=0x7ff4201985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102d80 0x7ff4201985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.023+0000 7ff425161700 1 -- 172.21.15.174:0/406874810 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4201a0210 con 0x7ff4201056b0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff425161700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c9e0 tx=0x7ff41000cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410007ac0 con 0x7ff4201056b0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4201a0500 con 0x7ff4201056b0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff410007c60 con 0x7ff4201056b0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff410018760 con 0x7ff4201056b0 2024-04-25T02:00:42.030 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4201a0a90 con 0x7ff4201056b0 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.024+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff410018940 con 0x7ff4201056b0 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.025+0000 7ff416ffd700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 0x7ff40c03b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.025+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff41004c290 con 0x7ff4201056b0 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.025+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42002db30 con 0x7ff4201056b0 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.025+0000 7ff425962700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 0x7ff40c03b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:42.031 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.026+0000 7ff425962700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 0x7ff40c03b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0098e0 tx=0x7ff41c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:42.034 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.030+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff410014030 con 0x7ff4201056b0 2024-04-25T02:00:42.241 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.237+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi137=x;smithi163=y;smithi174=z", "target": ["mon-mgr", ""]}) -- 0x7ff420062670 con 0x7ff40c039330 2024-04-25T02:00:42.256 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.253+0000 7ff416ffd700 1 -- 172.21.15.174:0/406874810 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff420062670 con 0x7ff40c039330 2024-04-25T02:00:42.256 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mgr update... 2024-04-25T02:00:42.259 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 msgr2=0x7ff40c03b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 0x7ff40c03b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0098e0 tx=0x7ff41c005fb0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 msgr2=0x7ff420198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c9e0 tx=0x7ff41000cda0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 shutdown_connections 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff40c039330 0x7ff40c03b7f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff420107fe0 0x7ff42019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff420102d80 0x7ff4201985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 --2- 172.21.15.174:0/406874810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4201056b0 0x7ff420198af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.254+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 >> 172.21.15.174:0/406874810 conn(0x7ff4200fc730 msgr2=0x7ff4201036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.255+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 shutdown_connections 2024-04-25T02:00:42.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:00:42.255+0000 7ff427bc6700 1 -- 172.21.15.174:0/406874810 wait complete. 2024-04-25T02:00:42.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:42.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:42.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:42.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:42.826 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi137=x;smithi163=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: Saving service mgr spec with placement smithi137=x;smithi163=y;smithi174=z;count:3 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:42.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:42 smithi174 ceph-mon[33171]: Deploying daemon mgr.z on smithi174 2024-04-25T02:00:42.829 DEBUG:teuthology.orchestra.run.smithi163:mgr.y> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.y.service 2024-04-25T02:00:42.831 DEBUG:teuthology.orchestra.run.smithi174:mgr.z> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.z.service 2024-04-25T02:00:42.833 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T02:00:42.834 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:00:42.834 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:00:42.889 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:00:42.889 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-25 01:59:39.093540393 +0000 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-25 01:54:30.437917036 +0000 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-25 01:54:30.437917036 +0000 2024-04-25T02:00:42.937 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-25 01:54:30.437917036 +0000 2024-04-25T02:00:42.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:00:43.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi137=x;smithi163=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: Saving service mgr spec with placement smithi137=x;smithi163=y;smithi174=z;count:3 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:42 smithi137 ceph-mon[28303]: Deploying daemon mgr.z on smithi174 2024-04-25T02:00:43.068 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-25T02:00:43.069 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-25T02:00:43.069 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000380368 s, 1.3 MB/s 2024-04-25T02:00:43.073 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:00:43.131 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-25T02:00:43.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi137=x;smithi163=y;smithi174=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: Saving service mgr spec with placement smithi137=x;smithi163=y;smithi174=z;count:3 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:43.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:43.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:43.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:43.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:42 smithi163 ceph-mon[32577]: Deploying daemon mgr.z on smithi174 2024-04-25T02:00:43.181 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:00:43.181 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-25 01:59:39.142539537 +0000 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-25 01:54:31.054906260 +0000 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-25 01:54:31.054906260 +0000 2024-04-25T02:00:43.182 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-25 01:54:31.054906260 +0000 2024-04-25T02:00:43.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:00:43.264 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-25T02:00:43.265 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-25T02:00:43.265 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000313445 s, 1.6 MB/s 2024-04-25T02:00:43.269 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:00:43.325 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-25T02:00:43.375 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:00:43.375 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-25 01:59:39.189538716 +0000 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-25 01:54:31.638896061 +0000 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-25 01:54:31.638896061 +0000 2024-04-25T02:00:43.376 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-25 01:54:31.638896061 +0000 2024-04-25T02:00:43.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:00:43.461 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-25T02:00:43.461 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-25T02:00:43.462 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000378677 s, 1.4 MB/s 2024-04-25T02:00:43.466 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:00:43.521 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-25T02:00:43.572 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:00:43.572 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:43.572 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-25 01:59:39.239537844 +0000 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-25 01:54:32.248885407 +0000 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-25 01:54:32.248885407 +0000 2024-04-25T02:00:43.573 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-25 01:54:32.248885407 +0000 2024-04-25T02:00:43.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:00:43.649 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-25T02:00:43.650 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-25T02:00:43.650 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000382274 s, 1.3 MB/s 2024-04-25T02:00:43.653 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:00:43.711 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-25T02:00:43.711 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:00:43.730 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:00:43.730 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-25 02:00:26.945051448 +0000 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-25 01:53:31.572054716 +0000 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-25 01:53:31.572054716 +0000 2024-04-25T02:00:43.789 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-25 01:53:31.572054716 +0000 2024-04-25T02:00:43.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:00:43.856 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-25T02:00:43.856 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-25T02:00:43.856 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00024905 s, 2.1 MB/s 2024-04-25T02:00:43.857 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:00:43.915 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-04-25T02:00:43.972 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:00:43.972 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:43.972 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-25 02:00:26.945051448 +0000 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-25 01:53:31.939046139 +0000 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-25 01:53:31.939046139 +0000 2024-04-25T02:00:43.973 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-25 01:53:31.939046139 +0000 2024-04-25T02:00:43.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:00:44.037 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-25T02:00:44.037 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-25T02:00:44.037 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000206196 s, 2.5 MB/s 2024-04-25T02:00:44.039 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:00:44.099 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-25 02:00:26.946051424 +0000 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-25 01:53:32.279038193 +0000 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-25 01:53:32.279038193 +0000 2024-04-25T02:00:44.154 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-25 01:53:32.279038193 +0000 2024-04-25T02:00:44.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:00:44.216 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-25T02:00:44.216 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-25T02:00:44.216 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000182017 s, 2.8 MB/s 2024-04-25T02:00:44.217 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:00:44.274 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-25 02:00:26.946051424 +0000 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-25 01:53:32.630029990 +0000 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-25 01:53:32.630029990 +0000 2024-04-25T02:00:44.329 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-25 01:53:32.630029990 +0000 2024-04-25T02:00:44.330 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:00:44.392 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-25T02:00:44.392 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-25T02:00:44.392 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00018002 s, 2.8 MB/s 2024-04-25T02:00:44.393 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:00:44.451 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-04-25T02:00:44.451 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:00:44.468 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:00:44.469 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-25 02:00:44.341198309 +0000 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-25 01:53:43.447044912 +0000 2024-04-25T02:00:44.525 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-25 01:53:43.447044912 +0000 2024-04-25T02:00:44.526 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-04-25 01:53:43.447044912 +0000 2024-04-25T02:00:44.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:00:44.587 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 systemd[1]: Starting Ceph mgr.z for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:00:44.590 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-25T02:00:44.590 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-25T02:00:44.590 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000278378 s, 1.8 MB/s 2024-04-25T02:00:44.592 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:00:44.648 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-04-25T02:00:44.703 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-25 02:00:44.341198309 +0000 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-25 01:53:43.790040206 +0000 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-25 01:53:43.790040206 +0000 2024-04-25T02:00:44.704 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-04-25 01:53:43.790040206 +0000 2024-04-25T02:00:44.704 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:00:44.766 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-25T02:00:44.766 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-25T02:00:44.766 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000194366 s, 2.6 MB/s 2024-04-25T02:00:44.768 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:00:44.824 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-04-25T02:00:44.878 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:00:44.878 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-25 02:00:44.341198309 +0000 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-25 01:53:44.144035349 +0000 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-25 01:53:44.144035349 +0000 2024-04-25T02:00:44.879 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-04-25 01:53:44.144035349 +0000 2024-04-25T02:00:44.879 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:00:44.893 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 podman[34840]: 2024-04-25 02:00:44.519926743 +0000 UTC m=+0.019214752 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:00:44.893 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 podman[34840]: 2024-04-25 02:00:44.637129438 +0000 UTC m=+0.136417433 container create b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-25T02:00:44.894 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 podman[34840]: 2024-04-25 02:00:44.89005948 +0000 UTC m=+0.389347484 container init b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T02:00:44.915 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-25T02:00:44.916 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-25T02:00:44.916 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000204039 s, 2.5 MB/s 2024-04-25T02:00:44.917 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:00:44.972 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-04-25T02:00:45.028 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:00:45.028 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-04-25 02:00:44.342198296 +0000 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-04-25 01:53:44.484030685 +0000 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-04-25 01:53:44.484030685 +0000 2024-04-25T02:00:45.029 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-04-25 01:53:44.484030685 +0000 2024-04-25T02:00:45.029 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:00:45.091 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-04-25T02:00:45.092 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-04-25T02:00:45.092 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000212448 s, 2.4 MB/s 2024-04-25T02:00:45.093 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:00:45.149 INFO:tasks.cephadm:Deploying osd.0 on smithi137 with /dev/vg_nvme/lv_4... 2024-04-25T02:00:45.149 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T02:00:45.174 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 podman[34840]: 2024-04-25 02:00:44.892876536 +0000 UTC m=+0.392164531 container start b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:00:45.175 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 ceph-mgr[34982]: -- 172.21.15.174:0/2254765853 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dbca0285a0 con 0x55dbc9ffcc00 2024-04-25T02:00:45.175 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:44 smithi174 bash[34840]: b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d 2024-04-25T02:00:45.175 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 systemd[1]: Started Ceph mgr.z for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:00:45.175 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:45.047+0000 7f8d22166200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:00:45.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:45.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:45.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:45.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:45.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:45.572 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:00:45.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:45.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:45.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:45.653 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:45.238+0000 7f8d22166200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:00:45.653 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:45.340+0000 7f8d22166200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:00:45.653 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:45.648+0000 7f8d22166200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:00:45.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:45.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:45.925 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:45.732+0000 7f8d22166200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:00:46.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:46 smithi174 ceph-mon[33171]: Deploying daemon mgr.y on smithi163 2024-04-25T02:00:46.634 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:46 smithi137 ceph-mon[28303]: Deploying daemon mgr.y on smithi163 2024-04-25T02:00:46.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:46 smithi163 ceph-mon[32577]: Deploying daemon mgr.y on smithi163 2024-04-25T02:00:47.265 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:46.923+0000 7f8d22166200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:00:47.265 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:47.089+0000 7f8d22166200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:00:47.265 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:47.261+0000 7f8d22166200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:00:47.329 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 systemd[1]: Starting Ceph mgr.y for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:00:47.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:47 smithi137 ceph-mon[28303]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:47.547 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-mon[33171]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:47.619 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:47 smithi163 ceph-mon[32577]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:47.619 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 podman[33990]: 2024-04-25 02:00:47.289866738 +0000 UTC m=+0.017902234 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:00:47.619 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 podman[33990]: 2024-04-25 02:00:47.412995593 +0000 UTC m=+0.141031059 container create 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T02:00:47.619 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 podman[33990]: 2024-04-25 02:00:47.615440186 +0000 UTC m=+0.343475649 container init 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-25T02:00:47.841 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:47.543+0000 7f8d22166200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:00:47.841 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:47.633+0000 7f8d22166200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:00:47.841 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:47.836+0000 7f8d22166200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:00:47.889 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 podman[33990]: 2024-04-25 02:00:47.618072116 +0000 UTC m=+0.346107580 container start 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y, RELEASE=squid-d2c45d9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-25T02:00:47.890 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 ceph-mgr[34009]: -- 172.21.15.163:0/661825021 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8447765a0 con 0x55b84474ac00 2024-04-25T02:00:47.890 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 bash[33990]: 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c 2024-04-25T02:00:47.890 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 systemd[1]: Started Ceph mgr.y for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:00:47.890 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:47.776+0000 7f46767a7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0366839 s, 286 MB/s 2024-04-25T02:00:48.135 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-25T02:00:48.174 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:48.027+0000 7f8d22166200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:00:48.389 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:47.965+0000 7f46767a7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:00:48.389 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:48.070+0000 7f46767a7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:00:48.810 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:48.392+0000 7f46767a7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:00:48.810 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:48.479+0000 7f46767a7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:00:48.899 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.899 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.899 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.900 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.900 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:48.900 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:48 smithi137 ceph-mon[28303]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:48.924 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:48.653+0000 7f8d22166200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:48 smithi174 ceph-mon[33171]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:48.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2024-04-25T02:00:49.111 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:49.112 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:49.112 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:49.112 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:49.112 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:49.112 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:48 smithi163 ceph-mon[32577]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:49.370 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:00:49.412 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:49.101+0000 7f8d22166200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:00:49.412 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:49.197+0000 7f8d22166200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:00:49.412 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:49.407+0000 7f8d22166200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:00:50.072 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:49.729+0000 7f46767a7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:00:50.072 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:49.897+0000 7f46767a7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:00:50.072 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:50.067+0000 7f46767a7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:00:50.268 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:49.934+0000 7f8d22166200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:00:50.268 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.024+0000 7f8d22166200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:00:50.614 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.263+0000 7f8d22166200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:00:50.614 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.397+0000 7f8d22166200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:00:50.614 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.492+0000 7f8d22166200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:00:50.614 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.610+0000 7f8d22166200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:50.615 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:50.357+0000 7f46767a7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:00:50.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:50.450+0000 7f46767a7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:00:50.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:50.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.689 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.689 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T02:00:50.690 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:50.925 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:50.701+0000 7f8d22166200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:00:51.139 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:50.654+0000 7f46767a7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:00:51.139 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:50.846+0000 7f46767a7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:00:51.675 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:51.531+0000 7f8d22166200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:00:51.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-mon[33171]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T02:00:51.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-mon[33171]: Reconfiguring daemon mgr.x on smithi137 2024-04-25T02:00:51.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-mon[33171]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:51.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:51.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:51 smithi137 ceph-mon[28303]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T02:00:51.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:51 smithi137 ceph-mon[28303]: Reconfiguring daemon mgr.x on smithi137 2024-04-25T02:00:51.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:51 smithi137 ceph-mon[28303]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:51.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:51 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:51.871 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:51.447+0000 7f46767a7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:00:51.871 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-mon[32577]: Reconfiguring mgr.x (unknown last config time)... 2024-04-25T02:00:51.871 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-mon[32577]: Reconfiguring daemon mgr.x on smithi137 2024-04-25T02:00:51.871 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-mon[32577]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:51.871 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:51.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 -- 172.21.15.137:0/3329104725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2214105f70 msgr2=0x7f221410c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 --2- 172.21.15.137:0/3329104725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2214105f70 0x7f221410c820 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f220c009920 tx=0x7f220c009c30 comp rx=0 tx=0).stop 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 -- 172.21.15.137:0/3329104725 shutdown_connections 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 --2- 172.21.15.137:0/3329104725 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2214105f70 0x7f221410c820 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 --2- 172.21.15.137:0/3329104725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22141043d0 0x7f22141047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 --2- 172.21.15.137:0/3329104725 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141055d0 0x7f2214105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.975+0000 7f221a000700 1 -- 172.21.15.137:0/3329104725 >> 172.21.15.137:0/3329104725 conn(0x7f22140ff970 msgr2=0x7f2214101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.976+0000 7f221a000700 1 -- 172.21.15.137:0/3329104725 shutdown_connections 2024-04-25T02:00:51.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.976+0000 7f221a000700 1 -- 172.21.15.137:0/3329104725 wait complete. 2024-04-25T02:00:51.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.977+0000 7f221a000700 1 Processor -- start 2024-04-25T02:00:51.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 -- start start 2024-04-25T02:00:51.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141043d0 0x7f221419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:51.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:51.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2214105f70 0x7f22141a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22141101a0 con 0x7f2214105f70 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2214110020 con 0x7f22141055d0 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f221a000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2214110320 con 0x7f22141043d0 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f2213e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f2213e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:38048/0 (socket says 172.21.15.137:38048) 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f2213e00700 1 -- 172.21.15.137:0/1350761956 learned_addr learned my addr 172.21.15.137:0/1350761956 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f2219600700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2214105f70 0x7f22141a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.978+0000 7f2218c00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141043d0 0x7f221419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 -- 172.21.15.137:0/1350761956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141043d0 msgr2=0x7f221419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141043d0 0x7f221419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 -- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2214105f70 msgr2=0x7f22141a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:00:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2214105f70 0x7f22141a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:00:51.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 -- 172.21.15.137:0/1350761956 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141a22f0 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2213e00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f220000e9a0 tx=0x7f220000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220000ca10 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f220000cbb0 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141a25e0 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22000187a0 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.979+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22141a2b20 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.980+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2200018940 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.980+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2214068f20 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.981+0000 7f2211600700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 0x7f21fc03b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.981+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f220004c590 con 0x7f22141055d0 2024-04-25T02:00:51.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.981+0000 7f2218c00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 0x7f21fc03b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:00:51.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.982+0000 7f2218c00700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 0x7f21fc03b7f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2214105430 tx=0x7f220800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:00:51.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:51.986+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f220000fc70 con 0x7f22141055d0 2024-04-25T02:00:52.139 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:51.866+0000 7f46767a7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:00:52.139 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:51.961+0000 7f46767a7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:00:52.175 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:00:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:00:51.745+0000 7f8d22166200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:00:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:52.236+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2214062730 con 0x7f21fc039330 2024-04-25T02:00:52.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:52.409+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f22000178f0 con 0x7f22141055d0 2024-04-25T02:00:52.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:52.162+0000 7f46767a7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: Standby manager daemon z started 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:00:52.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: Standby manager daemon z started 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:00:52.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:52.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:00:52.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:52.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: Standby manager daemon z started 2024-04-25T02:00:52.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:00:52.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/685505310' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:52.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:00:52.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:00:52.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:53.018 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:52.685+0000 7f46767a7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:00:53.018 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:52.777+0000 7f46767a7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:00:53.356 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:53.014+0000 7f46767a7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:00:53.357 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:53.145+0000 7f46767a7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:00:53.357 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:53.238+0000 7f46767a7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:00:53.357 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:53.352+0000 7f46767a7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:00:53.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:53.443+0000 7f46767a7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:53.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: mgrmap e14: x(active, since 86s), standbys: z 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:00:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:00:54.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:54.257+0000 7f46767a7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:00:54.640 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:00:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:00:54.466+0000 7f46767a7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:00:55.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:00:55.425+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mon.2 v2:172.21.15.163:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f22000173d0 con 0x7f22141055d0 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: Standby manager daemon y started 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:00:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:55 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:55.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:00:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: Standby manager daemon y started 2024-04-25T02:00:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:00:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:55 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:55.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:00:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: Standby manager daemon y started 2024-04-25T02:00:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:00:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:00:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:55 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/2355601269' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: mgrmap e15: x(active, since 89s), standbys: y, z 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2897466510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]': finished 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T02:00:56.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:00:56.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: mgrmap e15: x(active, since 89s), standbys: y, z 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2897466510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]': finished 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T02:00:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:00:56.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: mgrmap e15: x(active, since 89s), standbys: y, z 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2897466510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]: dispatch 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e559d91-361d-49dd-8183-384013ae9660"}]': finished 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: osdmap e5: 1 total, 0 up, 1 in 2024-04-25T02:00:56.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:00:57.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:57 smithi137 ceph-mon[28303]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:57.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:57 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1602046203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:00:57.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:57 smithi163 ceph-mon[32577]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:57.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:57 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1602046203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:00:57.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:57 smithi174 ceph-mon[33171]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:57.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:57 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1602046203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:00:59.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:00:59 smithi137 ceph-mon[28303]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:59.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:00:59 smithi163 ceph-mon[32577]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:00:59.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:00:59 smithi174 ceph-mon[33171]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:01.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:01 smithi137 ceph-mon[28303]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:01.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:01 smithi163 ceph-mon[32577]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:01.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:01 smithi174 ceph-mon[33171]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:02.684 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:02 smithi137 ceph-mon[28303]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:02.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:02 smithi163 ceph-mon[32577]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:02.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:02 smithi174 ceph-mon[33171]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:05.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:05 smithi137 ceph-mon[28303]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:05.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:01:05.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:05.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:05 smithi163 ceph-mon[32577]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:01:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:05.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:05 smithi174 ceph-mon[33171]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:05.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T02:01:05.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:06.383 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:06 smithi137 ceph-mon[28303]: Deploying daemon osd.0 on smithi137 2024-04-25T02:01:06.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:06 smithi163 ceph-mon[32577]: Deploying daemon osd.0 on smithi137 2024-04-25T02:01:06.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:06 smithi174 ceph-mon[33171]: Deploying daemon osd.0 on smithi137 2024-04-25T02:01:07.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:07 smithi137 ceph-mon[28303]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:07.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:07 smithi163 ceph-mon[32577]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:07.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:07 smithi174 ceph-mon[33171]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:09.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:09 smithi163 ceph-mon[32577]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:09.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:09 smithi174 ceph-mon[33171]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:09.768 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:09 smithi137 ceph-mon[28303]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:11.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:11 smithi163 ceph-mon[32577]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:11.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:11 smithi174 ceph-mon[33171]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:11 smithi137 ceph-mon[28303]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:13.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:13 smithi163 ceph-mon[32577]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:13 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:13 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:13 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:13.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:13 smithi174 ceph-mon[33171]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:13.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:13 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:13 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:13 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:13 smithi137 ceph-mon[28303]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:13.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:15.616 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:15 smithi137 ceph-mon[28303]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:15.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:15 smithi163 ceph-mon[32577]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:15.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:15 smithi174 ceph-mon[33171]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:17.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:17.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:17.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:16 smithi137 ceph-mon[28303]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:16 smithi163 ceph-mon[32577]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:17.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:16 smithi174 ceph-mon[33171]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:17.686 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 0 on host 'smithi137' 2024-04-25T02:01:17.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.680+0000 7f2211600700 1 -- 172.21.15.137:0/1350761956 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2214062730 con 0x7f21fc039330 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 msgr2=0x7f21fc03b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 0x7f21fc03b7f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2214105430 tx=0x7f220800b040 comp rx=0 tx=0).stop 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 msgr2=0x7f221419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f220000e9a0 tx=0x7f220000ecb0 comp rx=0 tx=0).stop 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 shutdown_connections 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f21fc039330 0x7f21fc03b7f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:17.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2214105f70 0x7f22141a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:17.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22141043d0 0x7f221419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:17.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 --2- 172.21.15.137:0/1350761956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22141055d0 0x7f221419abd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:17.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.685+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 >> 172.21.15.137:0/1350761956 conn(0x7f22140ff970 msgr2=0x7f2214108800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:17.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.686+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 shutdown_connections 2024-04-25T02:01:17.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:01:17.686+0000 7f221a000700 1 -- 172.21.15.137:0/1350761956 wait complete. 2024-04-25T02:01:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:17 smithi137 ceph-mon[28303]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:17 smithi137 ceph-mon[28303]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:17 smithi163 ceph-mon[32577]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:17 smithi163 ceph-mon[32577]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:17 smithi174 ceph-mon[33171]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:17 smithi174 ceph-mon[33171]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T02:01:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:18.471 DEBUG:teuthology.orchestra.run.smithi137:osd.0> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T02:01:18.477 INFO:tasks.cephadm:Deploying osd.1 on smithi163 with /dev/vg_nvme/lv_4... 2024-04-25T02:01:18.477 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T02:01:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:18.997 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:18 smithi137 ceph-mon[28303]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:19.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:18 smithi163 ceph-mon[32577]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:19.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T02:01:19.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: from='osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:19.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T02:01:19.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:19.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:01:19.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:18 smithi174 ceph-mon[33171]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:19.973 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:19 smithi163 ceph-mon[32577]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:01:19.974 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:19 smithi163 ceph-mon[32577]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T02:01:19.974 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:19.974 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-mon[28303]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:01:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-mon[28303]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T02:01:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:20.032 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0[40304]: 2024-04-25T02:01:19.865+0000 7f51e9c00700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:01:20.032 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:01:19 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0[40304]: 2024-04-25T02:01:19.881+0000 7f51de600700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:01:20.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:19 smithi174 ceph-mon[33171]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:01:20.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:19 smithi174 ceph-mon[33171]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T02:01:20.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:20.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:20.546 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T02:01:20.546 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T02:01:20.547 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2024-04-25T02:01:20.547 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2024-04-25T02:01:20.547 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113137 s, 927 MB/s 2024-04-25T02:01:20.547 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2024-04-25T02:01:21.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:20 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:01:21.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:20 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:01:21.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:20 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:21.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:20 smithi137 ceph-mon[28303]: from='osd.0 ' entity='osd.0' 2024-04-25T02:01:21.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:20 smithi137 ceph-mon[28303]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:21.053 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:20 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:01:21.053 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:20 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:01:21.053 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:20 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:21.053 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:20 smithi163 ceph-mon[32577]: from='osd.0 ' entity='osd.0' 2024-04-25T02:01:21.054 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:20 smithi163 ceph-mon[32577]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:21.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi163:vg_nvme/lv_4 2024-04-25T02:01:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:20 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:01:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:20 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:01:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:20 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:20 smithi174 ceph-mon[33171]: from='osd.0 ' entity='osd.0' 2024-04-25T02:01:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:20 smithi174 ceph-mon[33171]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T02:01:21.315 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:01:22.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:21 smithi137 ceph-mon[28303]: osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] boot 2024-04-25T02:01:22.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:21 smithi137 ceph-mon[28303]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T02:01:22.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.075 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.076 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:21 smithi163 ceph-mon[32577]: osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] boot 2024-04-25T02:01:22.076 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:21 smithi163 ceph-mon[32577]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T02:01:22.076 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:21 smithi174 ceph-mon[33171]: osd.0 [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] boot 2024-04-25T02:01:22.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:21 smithi174 ceph-mon[33171]: osdmap e8: 1 total, 1 up, 1 in 2024-04-25T02:01:22.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.780+0000 7f3739644700 1 -- 172.21.15.163:0/3706705460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 msgr2=0x7f37341027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.780+0000 7f3739644700 1 --2- 172.21.15.163:0/3706705460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f37341027f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f37280099c0 tx=0x7f3728009cd0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 -- 172.21.15.163:0/3706705460 shutdown_connections 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 --2- 172.21.15.163:0/3706705460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734102d30 0x7f37341095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 --2- 172.21.15.163:0/3706705460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3734101190 0x7f37341015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 --2- 172.21.15.163:0/3706705460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f37341027f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 -- 172.21.15.163:0/3706705460 >> 172.21.15.163:0/3706705460 conn(0x7f37340fc730 msgr2=0x7f37340feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 -- 172.21.15.163:0/3706705460 shutdown_connections 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 -- 172.21.15.163:0/3706705460 wait complete. 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.781+0000 7f3739644700 1 Processor -- start 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 -- start start 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734101190 0x7f37341975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3734102d30 0x7f373419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f373410cf50 con 0x7f3734102d30 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f373410cdd0 con 0x7f3734102390 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3739644700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f373410d0d0 con 0x7f3734101190 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:34980/0 (socket says 172.21.15.163:34980) 2024-04-25T02:01:22.788 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 -- 172.21.15.163:0/2878801205 learned_addr learned my addr 172.21.15.163:0/2878801205 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f3732ffd700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734101190 0x7f37341975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 -- 172.21.15.163:0/2878801205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734101190 msgr2=0x7f37341975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734101190 0x7f37341975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 -- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3734102d30 msgr2=0x7f373419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3734102d30 0x7f373419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 -- 172.21.15.163:0/2878801205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373419f220 con 0x7f3734102390 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f37327fc700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37280098e0 tx=0x7f3728005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.782+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728027070 con 0x7f3734102390 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.783+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373419f4b0 con 0x7f3734102390 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.783+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3728022470 con 0x7f3734102390 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.783+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372800bea0 con 0x7f3734102390 2024-04-25T02:01:22.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.783+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373419f9e0 con 0x7f3734102390 2024-04-25T02:01:22.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.784+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3734068f20 con 0x7f3734102390 2024-04-25T02:01:22.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.784+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f372802a070 con 0x7f3734102390 2024-04-25T02:01:22.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.785+0000 7f371bfff700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 0x7f371c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:22.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.785+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f37280ce3a0 con 0x7f3734102390 2024-04-25T02:01:22.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.785+0000 7f3732ffd700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 0x7f371c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:22.791 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.786+0000 7f3732ffd700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 0x7f371c0a5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37341021f0 tx=0x7f3724009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:22.794 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:22.790+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f3728013070 con 0x7f3734102390 2024-04-25T02:01:23.004 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T02:01:23.004 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:23.004 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.004 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.004 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:23.005 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.005 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:23.005 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:23.005 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:23.000+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3734062670 con 0x7f371c0a2b90 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:23.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:23.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:23.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:23.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:23.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:23.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi137 2024-04-25T02:01:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-25T02:01:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:24.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:24.260 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi137 2024-04-25T02:01:24.261 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-25T02:01:24.261 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:24.261 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:24.261 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:24.261 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:23 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi137 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 17089M 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:24.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:25.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:24 smithi163 ceph-mon[32577]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:25.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:24 smithi174 ceph-mon[33171]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:25.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:24 smithi137 ceph-mon[28303]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:25 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/907189790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:25 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:25 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]': finished 2024-04-25T02:01:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:25 smithi174 ceph-mon[33171]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T02:01:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:26.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:25 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/907189790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:25 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:25 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]': finished 2024-04-25T02:01:26.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:25 smithi137 ceph-mon[28303]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T02:01:26.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:26.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:25 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/907189790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:25 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]: dispatch 2024-04-25T02:01:26.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:25 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30f001bf-a25c-4c29-be9a-d5b9c20ff743"}]': finished 2024-04-25T02:01:26.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:25 smithi163 ceph-mon[32577]: osdmap e10: 2 total, 1 up, 2 in 2024-04-25T02:01:26.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:27.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:26 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/369081631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:27.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:26 smithi174 ceph-mon[33171]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:27.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:26 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/369081631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:27.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:26 smithi137 ceph-mon[28303]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:27.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:26 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/369081631' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:27.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:26 smithi163 ceph-mon[32577]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:29.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:29 smithi163 ceph-mon[32577]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:29.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:29 smithi174 ceph-mon[33171]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:29.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:29 smithi137 ceph-mon[28303]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:31.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:31 smithi163 ceph-mon[32577]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:31 smithi174 ceph-mon[33171]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:31.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:31 smithi137 ceph-mon[28303]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:33.616 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:33 smithi137 ceph-mon[28303]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:33.616 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:01:33.616 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:33.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:33 smithi163 ceph-mon[32577]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:33.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:33 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:01:33.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:33 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:33.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:33 smithi174 ceph-mon[33171]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:33.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T02:01:33.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:34.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:34 smithi137 ceph-mon[28303]: Deploying daemon osd.1 on smithi163 2024-04-25T02:01:34.614 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:34 smithi163 ceph-mon[32577]: Deploying daemon osd.1 on smithi163 2024-04-25T02:01:34.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:34 smithi174 ceph-mon[33171]: Deploying daemon osd.1 on smithi163 2024-04-25T02:01:35.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:35 smithi137 ceph-mon[28303]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:35.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:35 smithi163 ceph-mon[32577]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:35.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:35 smithi174 ceph-mon[33171]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:37.555 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:37 smithi163 ceph-mon[32577]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:37.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:37 smithi174 ceph-mon[33171]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:37.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:37 smithi137 ceph-mon[28303]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:39.364 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.364 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.364 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:39.365 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:39 smithi163 ceph-mon[32577]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:39.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:39 smithi174 ceph-mon[33171]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:39 smithi137 ceph-mon[28303]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:41.290 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.285+0000 7f371bfff700 1 -- 172.21.15.163:0/2878801205 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3734062670 con 0x7f371c0a2b90 2024-04-25T02:01:41.290 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 1 on host 'smithi163' 2024-04-25T02:01:41.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 msgr2=0x7f371c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:41.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 0x7f371c0a5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37341021f0 tx=0x7f3724009190 comp rx=0 tx=0).stop 2024-04-25T02:01:41.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 msgr2=0x7f3734197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:41.292 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37280098e0 tx=0x7f3728005f10 comp rx=0 tx=0).stop 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 shutdown_connections 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f371c0a2b90 0x7f371c0a5050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3734102d30 0x7f373419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3734101190 0x7f37341975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 --2- 172.21.15.163:0/2878801205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3734102390 0x7f3734197b00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 >> 172.21.15.163:0/2878801205 conn(0x7f37340fc730 msgr2=0x7f3734105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 shutdown_connections 2024-04-25T02:01:41.293 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:01:41.288+0000 7f3739644700 1 -- 172.21.15.163:0/2878801205 wait complete. 2024-04-25T02:01:41.586 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:41 smithi163 ceph-mon[32577]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:41.586 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:41 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.586 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:41 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:41 smithi174 ceph-mon[33171]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:41.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:41 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:41 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:41 smithi137 ceph-mon[28303]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:41.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:41.847 DEBUG:teuthology.orchestra.run.smithi163:osd.1> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T02:01:41.849 INFO:tasks.cephadm:Deploying osd.2 on smithi174 with /dev/vg_nvme/lv_4... 2024-04-25T02:01:41.850 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T02:01:42.093 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:01:42.140 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:01:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:01:41.948+0000 7f7e9806f7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T02:01:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:42 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:42 smithi163 ceph-mon[32577]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:42 smithi163 ceph-mon[32577]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:42 smithi163 ceph-mon[32577]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:43.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:42 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:42 smithi174 ceph-mon[33171]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:42 smithi174 ceph-mon[33171]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:42 smithi174 ceph-mon[33171]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:43.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:42 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:43.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:42 smithi137 ceph-mon[28303]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:42 smithi137 ceph-mon[28303]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T02:01:43.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:42 smithi137 ceph-mon[28303]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014129 s, 742 MB/s 2024-04-25T02:01:43.929 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-04-25T02:01:44.268 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:43 smithi174 ceph-mon[33171]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:01:44.268 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:43 smithi174 ceph-mon[33171]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.268 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:43 smithi174 ceph-mon[33171]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T02:01:44.268 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:44.268 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:43 smithi174 ceph-mon[33171]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:43 smithi137 ceph-mon[28303]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:01:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:43 smithi137 ceph-mon[28303]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:43 smithi137 ceph-mon[28303]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T02:01:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:43 smithi137 ceph-mon[28303]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:43 smithi163 ceph-mon[32577]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T02:01:44.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:43 smithi163 ceph-mon[32577]: from='osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:43 smithi163 ceph-mon[32577]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T02:01:44.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:44.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:43 smithi163 ceph-mon[32577]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:01:44.542 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-04-25T02:01:44.781 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:01:45.026 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:01:45.026 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T02:01:45.026 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.026 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.026 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:45.027 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: from='osd.1 ' entity='osd.1' 2024-04-25T02:01:45.027 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.027 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:01:44.741+0000 7f7e8ced3700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:01:45.027 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:01:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:01:44.748+0000 7f7e854bf700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:01:45.140 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: from='osd.1 ' entity='osd.1' 2024-04-25T02:01:45.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: from='osd.1 ' entity='osd.1' 2024-04-25T02:01:45.251 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:01:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:01:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi163 2024-04-25T02:01:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 17088M 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] boot 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T02:01:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:46.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:01:46.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi163 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 17088M 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] boot 2024-04-25T02:01:46.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T02:01:46.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:46.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi163 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 17088M 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:01:46.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:01:46.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: osd.1 [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] boot 2024-04-25T02:01:46.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: osdmap e13: 2 total, 2 up, 2 in 2024-04-25T02:01:46.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 -- 172.21.15.174:0/723527715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf8103e50 msgr2=0x7f2bf810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/723527715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf8103e50 0x7f2bf810a700 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000b0a0 tx=0x7f2bf000b3b0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 -- 172.21.15.174:0/723527715 shutdown_connections 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/723527715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81022b0 0x7f2bf81026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/723527715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf8103e50 0x7f2bf810a700 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/723527715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bf81034b0 0x7f2bf8103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 -- 172.21.15.174:0/723527715 >> 172.21.15.174:0/723527715 conn(0x7f2bf80fd850 msgr2=0x7f2bf80ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 -- 172.21.15.174:0/723527715 shutdown_connections 2024-04-25T02:01:46.419 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.412+0000 7f2bfeb25700 1 -- 172.21.15.174:0/723527715 wait complete. 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 Processor -- start 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 -- start start 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81034b0 0x7f2bf8074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bf8103e50 0x7f2bf8074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf810e120 con 0x7f2bf8103e50 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf810dfa0 con 0x7f2bf81034b0 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfeb25700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf810e2a0 con 0x7f2bf81022b0 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfc8c1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfc8c1700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:36800/0 (socket says 172.21.15.174:36800) 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.413+0000 7f2bfc8c1700 1 -- 172.21.15.174:0/878671445 learned_addr learned my addr 172.21.15.174:0/878671445 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 -- 172.21.15.174:0/878671445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81034b0 msgr2=0x7f2bf8074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81034b0 0x7f2bf8074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:46.420 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81034b0 0x7f2bf8074620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 -- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bf8103e50 msgr2=0x7f2bf8074b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bf8103e50 0x7f2bf8074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 -- 172.21.15.174:0/878671445 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8075410 con 0x7f2bf81022b0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfc8c1700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b500 tx=0x7f2bec00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec015020 con 0x7f2bf81022b0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bec011d30 con 0x7f2bf81022b0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00f2e0 con 0x7f2bf81022b0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf81a2870 con 0x7f2bf81022b0 2024-04-25T02:01:46.421 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.414+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf81a2e00 con 0x7f2bf81022b0 2024-04-25T02:01:46.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.415+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf8068f20 con 0x7f2bf81022b0 2024-04-25T02:01:46.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.416+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f2bec018020 con 0x7f2bf81022b0 2024-04-25T02:01:46.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.417+0000 7f2bf5ffb700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 0x7f2be80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:01:46.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.417+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f2bec0ccfd0 con 0x7f2bf81022b0 2024-04-25T02:01:46.422 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.418+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 0x7f2be80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:01:46.423 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.419+0000 7f2bf7fff700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 0x7f2be80a5050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:01:46.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.422+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f2bec01f020 con 0x7f2bf81022b0 2024-04-25T02:01:46.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:01:46.627+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2bf8062670 con 0x7f2be80a2b90 2024-04-25T02:01:47.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:46 smithi163 ceph-mon[32577]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:47.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:46 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:47.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:46 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:47.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:46 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:47.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:46 smithi163 ceph-mon[32577]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T02:01:47.267 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:46 smithi174 ceph-mon[33171]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:47.267 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:46 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:47.267 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:46 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:47.267 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:46 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:47.267 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:46 smithi174 ceph-mon[33171]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T02:01:47.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:46 smithi137 ceph-mon[28303]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:47.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:46 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:01:47.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:46 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:01:47.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:46 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:47.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:46 smithi137 ceph-mon[28303]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T02:01:48.168 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:47 smithi174 ceph-mon[33171]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:48.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:47 smithi137 ceph-mon[28303]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:48.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:47 smithi163 ceph-mon[32577]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:01:49.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:48 smithi137 ceph-mon[28303]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:49.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:48 smithi163 ceph-mon[32577]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:49.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:48 smithi174 ceph-mon[33171]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:50.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/1773932934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]': finished 2024-04-25T02:01:50.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T02:01:50.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:01:50.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:49 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/2612876353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/1773932934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]': finished 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:01:50.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:49 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/2612876353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:50.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/1773932934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]: dispatch 2024-04-25T02:01:50.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d1acbadd-93be-4154-b3c1-1fb8b007154b"}]': finished 2024-04-25T02:01:50.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: osdmap e15: 3 total, 2 up, 3 in 2024-04-25T02:01:50.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:01:50.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:49 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/2612876353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:01:51.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:50 smithi137 ceph-mon[28303]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:51.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:50 smithi163 ceph-mon[32577]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:51.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:50 smithi174 ceph-mon[33171]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:53.551 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:53 smithi174 ceph-mon[33171]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:53 smithi163 ceph-mon[32577]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:53 smithi137 ceph-mon[28303]: pgmap v78: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:55.624 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:55 smithi174 ceph-mon[33171]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:55 smithi163 ceph-mon[32577]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:55 smithi137 ceph-mon[28303]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:57.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:57 smithi163 ceph-mon[32577]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:57.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:57 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:01:57.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:57 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:57.665 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:57 smithi174 ceph-mon[33171]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:57.665 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:57 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:01:57.665 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:57 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:57.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:57 smithi137 ceph-mon[28303]: pgmap v80: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:57.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:57 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T02:01:57.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:57 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:01:58.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:58 smithi163 ceph-mon[32577]: Deploying daemon osd.2 on smithi174 2024-04-25T02:01:58.568 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:58 smithi174 ceph-mon[33171]: Deploying daemon osd.2 on smithi174 2024-04-25T02:01:58.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:58 smithi137 ceph-mon[28303]: Deploying daemon osd.2 on smithi174 2024-04-25T02:01:59.499 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:01:59 smithi174 ceph-mon[33171]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:01:59 smithi163 ceph-mon[32577]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:01:59.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:01:59 smithi137 ceph-mon[28303]: pgmap v81: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:01.481 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:01 smithi174 ceph-mon[33171]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:01.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:01 smithi163 ceph-mon[32577]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:01.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:01 smithi137 ceph-mon[28303]: pgmap v82: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:03.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:03 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:03 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:03.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:03 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:03 smithi163 ceph-mon[32577]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:03.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:03 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:03 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:03.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:03 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:03 smithi174 ceph-mon[33171]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:03.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:03 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:03 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:03.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:03 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:03.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:03 smithi137 ceph-mon[28303]: pgmap v83: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:05.590 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:05.590 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.590 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.590 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:05.590 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:05.591 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.666 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.662+0000 7f2bf5ffb700 1 -- 172.21.15.174:0/878671445 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2bf8062670 con 0x7f2be80a2b90 2024-04-25T02:02:05.666 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 2 on host 'smithi174' 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 msgr2=0x7f2be80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 0x7f2be80a5050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2be4006fd0 tx=0x7f2be4008040 comp rx=0 tx=0).stop 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 msgr2=0x7f2bf8075fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b500 tx=0x7f2bec00b8c0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 shutdown_connections 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f2be80a2b90 0x7f2be80a5050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.669 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2bf8103e50 0x7f2bf8074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf81022b0 0x7f2bf8075fd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 --2- 172.21.15.174:0/878671445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bf81034b0 0x7f2bf8074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:05.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 >> 172.21.15.174:0/878671445 conn(0x7f2bf80fd850 msgr2=0x7f2bf81067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:05.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.664+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 shutdown_connections 2024-04-25T02:02:05.670 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:02:05.665+0000 7f2bfeb25700 1 -- 172.21.15.174:0/878671445 wait complete. 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: pgmap v84: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:05.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.269 DEBUG:teuthology.orchestra.run.smithi174:osd.2> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T02:02:06.272 INFO:tasks.cephadm:Deploying osd.3 on smithi137 with /dev/vg_nvme/lv_3... 2024-04-25T02:02:06.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T02:02:06.704 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:06 smithi163 ceph-mon[32577]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:06 smithi174 ceph-mon[33171]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T02:02:06.966 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:06 smithi137 ceph-mon[28303]: pgmap v85: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:07.851 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:07 smithi137 ceph-mon[28303]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:02:07.851 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:07 smithi137 ceph-mon[28303]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T02:02:07.851 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:07.851 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:07 smithi137 ceph-mon[28303]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:07.852 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:07 smithi137 ceph-mon[28303]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:07.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:07 smithi174 ceph-mon[33171]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:02:07.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:07 smithi174 ceph-mon[33171]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T02:02:07.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:07.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:07 smithi174 ceph-mon[33171]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:07.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:07 smithi174 ceph-mon[33171]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:07 smithi163 ceph-mon[32577]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T02:02:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:07 smithi163 ceph-mon[32577]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T02:02:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:07 smithi163 ceph-mon[32577]: from='osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:07 smithi163 ceph-mon[32577]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:08 smithi137 ceph-mon[28303]: from='osd.2 ' entity='osd.2' 2024-04-25T02:02:08.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:02:08.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T02:02:08.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:08.796 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:08.797 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:08.797 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-mon[33171]: from='osd.2 ' entity='osd.2' 2024-04-25T02:02:08.797 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2[38384]: 2024-04-25T02:02:08.421+0000 7ff0cc2a5700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:02:08.797 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2[38384]: 2024-04-25T02:02:08.430+0000 7ff0c4891700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: pgmap v88: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-04-25T02:02:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:08 smithi163 ceph-mon[32577]: from='osd.2 ' entity='osd.2' 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0563442 s, 186 MB/s 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 2024-04-25T02:02:09.389 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-25T02:02:09.816 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi174 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 17088M 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] boot 2024-04-25T02:02:09.817 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T02:02:09.818 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi174 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 17088M 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] boot 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T02:02:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:10.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi174 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 17088M 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: osd.2 [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] boot 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: osdmap e18: 3 total, 3 up, 3 in 2024-04-25T02:02:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:02:10.555 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:02:11.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:11 smithi137 ceph-mon[28303]: pgmap v90: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:11.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:11.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:11.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:11 smithi137 ceph-mon[28303]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T02:02:11.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:11.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:11 smithi163 ceph-mon[32577]: pgmap v90: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:11.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:11.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:11.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:11 smithi163 ceph-mon[32577]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T02:02:11.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:11.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:11 smithi174 ceph-mon[33171]: pgmap v90: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:11.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:11 smithi174 ceph-mon[33171]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T02:02:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 -- 172.21.15.137:0/1724619256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c102390 msgr2=0x7f419c1027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 --2- 172.21.15.137:0/1724619256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c102390 0x7f419c1027f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41880099c0 tx=0x7f4188009cd0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 -- 172.21.15.137:0/1724619256 shutdown_connections 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 --2- 172.21.15.137:0/1724619256 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c101190 0x7f419c1015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 --2- 172.21.15.137:0/1724619256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102d30 0x7f419c1095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 --2- 172.21.15.137:0/1724619256 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c102390 0x7f419c1027f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 -- 172.21.15.137:0/1724619256 >> 172.21.15.137:0/1724619256 conn(0x7f419c0fc730 msgr2=0x7f419c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 -- 172.21.15.137:0/1724619256 shutdown_connections 2024-04-25T02:02:12.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.640+0000 7f41a0c00700 1 -- 172.21.15.137:0/1724619256 wait complete. 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.641+0000 7f41a0c00700 1 Processor -- start 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.641+0000 7f41a0c00700 1 -- start start 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c101190 0x7f419c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c102d30 0x7f419c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10ced0 con 0x7f419c101190 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10cd50 con 0x7f419c102d30 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f41a0c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f419c10d050 con 0x7f419c102390 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c101190 0x7f419c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45896/0 (socket says 172.21.15.137:45896) 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 -- 172.21.15.137:0/557397984 learned_addr learned my addr 172.21.15.137:0/557397984 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f419a800700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c102d30 0x7f419c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 -- 172.21.15.137:0/557397984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c102d30 msgr2=0x7f419c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c102d30 0x7f419c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 -- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c101190 msgr2=0x7f419c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c101190 0x7f419c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.642+0000 7f4199400700 1 -- 172.21.15.137:0/557397984 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c1a0250 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f4199400700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4188005910 tx=0x7f418800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188027070 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f418800be40 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188022e30 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c1a04e0 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.643+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c1a08e0 con 0x7f419c102390 2024-04-25T02:02:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.644+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c1a0b40 con 0x7f419c102390 2024-04-25T02:02:12.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.646+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f418802a070 con 0x7f419c102390 2024-04-25T02:02:12.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.647+0000 7f4192a00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 0x7f41800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:12.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.648+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3237+0+0 (secure 0 0 0) 0x7f41880ce630 con 0x7f419c102390 2024-04-25T02:02:12.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.648+0000 7f4199e00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 0x7f41800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:12.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.648+0000 7f4199e00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 0x7f41800a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f418c009680 tx=0x7f418c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:12.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.652+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4188013070 con 0x7f419c102390 2024-04-25T02:02:12.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.885+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f419c0fe8d0 con 0x7f41800a2c10 2024-04-25T02:02:12.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:12.975+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f41880989a0 con 0x7f419c102390 2024-04-25T02:02:13.281 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:12 smithi137 sudo[44710]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:13.281 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:12 smithi137 sudo[44710]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:13.281 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:12 smithi137 sudo[44710]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:13.281 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:12 smithi137 sudo[44710]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T02:02:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:13.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:13.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:13.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:02:13.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T02:02:13.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:13.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:13.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:13.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:13.773 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:13 smithi137 sudo[44780]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:13.773 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:13 smithi137 sudo[44780]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:13.773 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:13 smithi137 sudo[44780]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:13.773 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:02:13 smithi137 sudo[44780]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:13.944 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40930]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:13.944 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40930]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:13.944 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40930]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:13.944 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40930]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:13 smithi137 ceph-mon[28303]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:13 smithi137 ceph-mon[28303]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T02:02:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:13 smithi137 ceph-mon[28303]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-04-25T02:02:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:13 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:14.229 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:13 smithi174 ceph-mon[33171]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:14.229 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:13 smithi174 ceph-mon[33171]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T02:02:14.229 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:13 smithi174 ceph-mon[33171]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-04-25T02:02:14.229 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:13 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:14.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:13 smithi163 ceph-mon[32577]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:14.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:13 smithi163 ceph-mon[32577]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T02:02:14.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:13 smithi163 ceph-mon[32577]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-04-25T02:02:14.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:13 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:14.390 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:14.391 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:14.391 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40933]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:14.391 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:02:13 smithi163 sudo[40933]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:14.482 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42034]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:14.483 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42034]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:14.483 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42034]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:14.483 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42034]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:14.925 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:14.925 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:14.925 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42037]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:14.925 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:02:14 smithi174 sudo[42037]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:15.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44878]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:15.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44878]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:15.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44878]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:15.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44878]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44890]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44890]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44890]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:15 smithi137 sudo[44890]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:16.201 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:15 smithi174 sudo[42040]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:16.201 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:15 smithi174 sudo[42040]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:16.201 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:15 smithi174 sudo[42040]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:16.202 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:15 smithi174 sudo[42040]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:16.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:16.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:16 smithi137 ceph-mon[28303]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:16.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:16.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:16 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:16.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 sudo[42043]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:16.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 sudo[42043]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 sudo[42043]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 sudo[42043]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 ceph-mon[33171]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:16.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:16 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40936]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T02:02:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40936]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40936]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40939]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40939]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 sudo[40939]: pam_unix(sudo:session): session closed for user root 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 ceph-mon[32577]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:17.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:16 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2765271905' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]': finished 2024-04-25T02:02:17.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: osdmap e22: 4 total, 3 up, 4 in 2024-04-25T02:02:17.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:17.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2765271905' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]': finished 2024-04-25T02:02:17.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: osdmap e22: 4 total, 3 up, 4 in 2024-04-25T02:02:17.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:17.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T02:02:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2765271905' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]: dispatch 2024-04-25T02:02:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e53d03ce-79d0-490e-b2d7-6767e008fa8a"}]': finished 2024-04-25T02:02:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: osdmap e22: 4 total, 3 up, 4 in 2024-04-25T02:02:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:18.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:18 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/507320114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:18.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/507320114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:18.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:18 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/507320114' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:19.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:19 smithi163 ceph-mon[32577]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:19.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:19 smithi174 ceph-mon[33171]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:19.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:19 smithi137 ceph-mon[28303]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:21.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:21 smithi174 ceph-mon[33171]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:21.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:21 smithi163 ceph-mon[32577]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:21.753 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:21 smithi137 ceph-mon[28303]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:23.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:23 smithi163 ceph-mon[32577]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-25T02:02:23.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:23 smithi174 ceph-mon[33171]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-25T02:02:23.676 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:23 smithi137 ceph-mon[28303]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-25T02:02:25.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:25 smithi137 ceph-mon[28303]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-25T02:02:25.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:25 smithi163 ceph-mon[32577]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-25T02:02:25.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:25 smithi174 ceph-mon[33171]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-25T02:02:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:27 smithi163 ceph-mon[32577]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-25T02:02:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:02:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:27 smithi163 ceph-mon[32577]: Deploying daemon osd.3 on smithi137 2024-04-25T02:02:27.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:27 smithi174 ceph-mon[33171]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-25T02:02:27.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:02:27.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:27.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:27 smithi174 ceph-mon[33171]: Deploying daemon osd.3 on smithi137 2024-04-25T02:02:27.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:27 smithi137 ceph-mon[28303]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-25T02:02:27.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T02:02:27.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:27.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:27 smithi137 ceph-mon[28303]: Deploying daemon osd.3 on smithi137 2024-04-25T02:02:29.456 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:29 smithi137 ceph-mon[28303]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 906 B/s rd, 23 KiB/s wr, 2 op/s 2024-04-25T02:02:29.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:29 smithi163 ceph-mon[32577]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 906 B/s rd, 23 KiB/s wr, 2 op/s 2024-04-25T02:02:29.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:29 smithi174 ceph-mon[33171]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 906 B/s rd, 23 KiB/s wr, 2 op/s 2024-04-25T02:02:31.477 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:31 smithi137 ceph-mon[28303]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:31.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:31 smithi163 ceph-mon[32577]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:31.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:31 smithi174 ceph-mon[33171]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:33.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:33 smithi163 ceph-mon[32577]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:33.653 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:33 smithi137 ceph-mon[28303]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:33.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:33 smithi174 ceph-mon[33171]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-04-25T02:02:35.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:35.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:35 smithi174 ceph-mon[33171]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:35.443 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.443 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.443 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:35.443 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:35 smithi137 ceph-mon[28303]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:35 smithi163 ceph-mon[32577]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:37.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:37 smithi163 ceph-mon[32577]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:37.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:37 smithi174 ceph-mon[33171]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:37.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:37 smithi137 ceph-mon[28303]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:38.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:38.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:38.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:38 smithi137 ceph-mon[28303]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:38.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.882+0000 7f4192a00700 1 -- 172.21.15.137:0/557397984 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f419c0fe8d0 con 0x7f41800a2c10 2024-04-25T02:02:38.887 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 3 on host 'smithi137' 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:38 smithi163 ceph-mon[32577]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 msgr2=0x7f41800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 0x7f41800a50d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f418c009680 tx=0x7f418c009260 comp rx=0 tx=0).stop 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 msgr2=0x7f419c198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4188005910 tx=0x7f418800f690 comp rx=0 tx=0).stop 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 shutdown_connections 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f41800a2c10 0x7f41800a50d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f419c102d30 0x7f419c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:38.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f419c101190 0x7f419c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 --2- 172.21.15.137:0/557397984 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f419c102390 0x7f419c198b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.885+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 >> 172.21.15.137:0/557397984 conn(0x7f419c0fc730 msgr2=0x7f419c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.886+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 shutdown_connections 2024-04-25T02:02:38.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:02:38.886+0000 7f41a0c00700 1 -- 172.21.15.137:0/557397984 wait complete. 2024-04-25T02:02:38.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:38.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:38.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:38.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T02:02:38.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:38 smithi174 ceph-mon[33171]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:39.628 DEBUG:teuthology.orchestra.run.smithi137:osd.3> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T02:02:39.633 INFO:tasks.cephadm:Deploying osd.4 on smithi163 with /dev/vg_nvme/lv_3... 2024-04-25T02:02:39.633 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.827 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.848 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.848 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:39.881 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: osdmap e23: 4 total, 3 up, 4 in 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:40.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:40 smithi137 ceph-mon[28303]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:02:40.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:40 smithi137 ceph-mon[28303]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T02:02:40.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:40 smithi137 ceph-mon[28303]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:40.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:40 smithi174 ceph-mon[33171]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:02:40.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:40 smithi174 ceph-mon[33171]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T02:02:40.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.843 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:40 smithi174 ceph-mon[33171]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:40.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:40 smithi163 ceph-mon[32577]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:02:40.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:40 smithi163 ceph-mon[32577]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T02:02:40.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:40.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:40 smithi163 ceph-mon[32577]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] boot 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: osdmap e25: 4 total, 4 up, 4 in 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:41 smithi137 ceph-mon[28303]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T02:02:41.819 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T02:02:41.820 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T02:02:41.820 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2024-04-25T02:02:41.820 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2024-04-25T02:02:41.820 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013008 s, 806 MB/s 2024-04-25T02:02:41.820 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2024-04-25T02:02:41.843 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:02:41.843 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:02:41.843 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] boot 2024-04-25T02:02:41.844 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: osdmap e25: 4 total, 4 up, 4 in 2024-04-25T02:02:41.844 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:41.844 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:41 smithi163 ceph-mon[32577]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: osd.3 [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] boot 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: osdmap e25: 4 total, 4 up, 4 in 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:02:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:41 smithi174 ceph-mon[33171]: osdmap e26: 4 total, 4 up, 4 in 2024-04-25T02:02:42.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi163:vg_nvme/lv_3 2024-04-25T02:02:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:02:42.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:42 smithi163 ceph-mon[32577]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:42.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:42 smithi163 ceph-mon[32577]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T02:02:42.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:42 smithi174 ceph-mon[33171]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:42.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:42 smithi174 ceph-mon[33171]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T02:02:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:42 smithi137 ceph-mon[28303]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:43.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:42 smithi137 ceph-mon[28303]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 -- 172.21.15.163:0/2707579950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 msgr2=0x7fed041015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 --2- 172.21.15.163:0/2707579950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041015b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fed000099c0 tx=0x7fed00009cd0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 -- 172.21.15.163:0/2707579950 shutdown_connections 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 --2- 172.21.15.163:0/2707579950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041015b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 --2- 172.21.15.163:0/2707579950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102d30 0x7fed041095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 --2- 172.21.15.163:0/2707579950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102390 0x7fed041027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 -- 172.21.15.163:0/2707579950 >> 172.21.15.163:0/2707579950 conn(0x7fed040fc730 msgr2=0x7fed040feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 -- 172.21.15.163:0/2707579950 shutdown_connections 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.018+0000 7fed0b120700 1 -- 172.21.15.163:0/2707579950 wait complete. 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 Processor -- start 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 -- start start 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 0x7fed04198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 0x7fed0419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fed0410cee0 con 0x7fed04102390 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fed0410cd60 con 0x7fed04101190 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed0b120700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fed0410d060 con 0x7fed04102d30 2024-04-25T02:02:44.028 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:33984/0 (socket says 172.21.15.163:33984) 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 -- 172.21.15.163:0/2527380846 learned_addr learned my addr 172.21.15.163:0/2527380846 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fecfbfff700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 0x7fed04198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 -- 172.21.15.163:0/2527380846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 msgr2=0x7fed0419fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed096bd700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 0x7fed0419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 0x7fed0419fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 -- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 msgr2=0x7fed04198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:02:44.029 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 0x7fed04198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed08ebc700 1 -- 172.21.15.163:0/2527380846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed041a0290 con 0x7fed04101190 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fecfbfff700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 0x7fed04198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.019+0000 7fed096bd700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 0x7fed0419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fed08ebc700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed000047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00003800 con 0x7fed04101190 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed041a0520 con 0x7fed04101190 2024-04-25T02:02:44.030 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed00004830 con 0x7fed04101190 2024-04-25T02:02:44.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00005580 con 0x7fed04101190 2024-04-25T02:02:44.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.020+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041a09f0 con 0x7fed04101190 2024-04-25T02:02:44.031 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.021+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04068f20 con 0x7fed04101190 2024-04-25T02:02:44.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.022+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fed000049e0 con 0x7fed04101190 2024-04-25T02:02:44.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.022+0000 7fecf9ffb700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 0x7fecec0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:02:44.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.023+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7fed000cedd0 con 0x7fed04101190 2024-04-25T02:02:44.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.023+0000 7fecfbfff700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 0x7fecec0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:02:44.032 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.024+0000 7fecfbfff700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 0x7fecec0a5280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecf4005fd0 tx=0x7fecf4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:02:44.033 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.027+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fed00013070 con 0x7fed04101190 2024-04-25T02:02:44.242 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:02:44.236+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fed040fe910 con 0x7fecec0a2dc0 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi137 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:44.882 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:44.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:44 smithi163 ceph-mon[32577]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:44.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi137 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:44.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:44 smithi174 ceph-mon[33171]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi137 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:02:45.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 8544M 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:45.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:44 smithi137 ceph-mon[28303]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:45.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:45 smithi163 ceph-mon[32577]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T02:02:45.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:45 smithi174 ceph-mon[33171]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T02:02:46.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:45 smithi137 ceph-mon[28303]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T02:02:46.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:46 smithi163 ceph-mon[32577]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-04-25T02:02:46.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:46 smithi174 ceph-mon[33171]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-04-25T02:02:47.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:46 smithi137 ceph-mon[28303]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-04-25T02:02:47.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/3691265189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]': finished 2024-04-25T02:02:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T02:02:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:02:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/2289823395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/3691265189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]': finished 2024-04-25T02:02:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T02:02:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:02:48.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/2289823395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/3691265189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]: dispatch 2024-04-25T02:02:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d77d217-ffdb-41c9-aeb0-ee27621608dc"}]': finished 2024-04-25T02:02:48.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: osdmap e30: 5 total, 4 up, 5 in 2024-04-25T02:02:48.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:02:48.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/2289823395' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:02:48.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:48 smithi174 ceph-mon[33171]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-25T02:02:49.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:48 smithi137 ceph-mon[28303]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-25T02:02:49.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:48 smithi163 ceph-mon[32577]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-25T02:02:51.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:51 smithi163 ceph-mon[32577]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-25T02:02:51.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:51 smithi174 ceph-mon[33171]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-25T02:02:51.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:51 smithi137 ceph-mon[28303]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-25T02:02:53.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:53 smithi163 ceph-mon[32577]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:02:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:53 smithi174 ceph-mon[33171]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:02:53.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:53 smithi137 ceph-mon[28303]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:02:54.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:02:54.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:54.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:02:54.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:54.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T02:02:54.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:02:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:55 smithi163 ceph-mon[32577]: Deploying daemon osd.4 on smithi163 2024-04-25T02:02:55.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:55 smithi163 ceph-mon[32577]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T02:02:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:55 smithi174 ceph-mon[33171]: Deploying daemon osd.4 on smithi163 2024-04-25T02:02:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:55 smithi174 ceph-mon[33171]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T02:02:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:55 smithi137 ceph-mon[28303]: Deploying daemon osd.4 on smithi163 2024-04-25T02:02:55.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:55 smithi137 ceph-mon[28303]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-25T02:02:57.625 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:57 smithi163 ceph-mon[32577]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:57.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:57 smithi174 ceph-mon[33171]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:57.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:57 smithi137 ceph-mon[28303]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:59 smithi163 ceph-mon[32577]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:02:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:59.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:59 smithi174 ceph-mon[33171]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:59.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:02:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:02:59.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:59 smithi137 ceph-mon[28303]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:02:59.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:02:59.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:02:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:01.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:01 smithi163 ceph-mon[32577]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:01.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:01 smithi174 ceph-mon[33171]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:01.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:01 smithi137 ceph-mon[28303]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:02.787 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 4 on host 'smithi163' 2024-04-25T02:03:02.787 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.781+0000 7fecf9ffb700 1 -- 172.21.15.163:0/2527380846 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed040fe910 con 0x7fecec0a2dc0 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 msgr2=0x7fecec0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 0x7fecec0a5280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fecf4005fd0 tx=0x7fecf4005ee0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 msgr2=0x7fed041986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed000047b0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 shutdown_connections 2024-04-25T02:03:02.789 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fecec0a2dc0 0x7fecec0a5280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed04101190 0x7fed041986a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed04102d30 0x7fed0419fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 --2- 172.21.15.163:0/2527380846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fed04102390 0x7fed04198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 >> 172.21.15.163:0/2527380846 conn(0x7fed040fc730 msgr2=0x7fed040fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 shutdown_connections 2024-04-25T02:03:02.790 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:03:02.784+0000 7fed0b120700 1 -- 172.21.15.163:0/2527380846 wait complete. 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.136 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:03.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:03.453 DEBUG:teuthology.orchestra.run.smithi163:osd.4> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T02:03:03.456 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_3... 2024-04-25T02:03:03.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T02:03:03.702 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:03:04.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:03 smithi163 ceph-mon[32577]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:04.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:03 smithi163 ceph-mon[32577]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:04.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:03 smithi174 ceph-mon[33171]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:04.150 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:03 smithi174 ceph-mon[33171]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:04.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:03 smithi137 ceph-mon[28303]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:04.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:03 smithi137 ceph-mon[28303]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T02:03:05.103 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:03:05.103 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.103 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T02:03:05.104 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:05.104 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.104 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:04 smithi174 ceph-mon[33171]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:05.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:03:05.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T02:03:05.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:05.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:04 smithi163 ceph-mon[32577]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:05.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T02:03:05.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: from='osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: osdmap e31: 5 total, 4 up, 5 in 2024-04-25T02:03:05.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:05.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:03:05.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:04 smithi137 ceph-mon[28303]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0130757 s, 802 MB/s 2024-04-25T02:03:05.660 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-04-25T02:03:06.073 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-mon[32577]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:03:06.073 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-mon[32577]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T02:03:06.073 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.073 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-mon[32577]: from='osd.4 ' entity='osd.4' 2024-04-25T02:03:06.073 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.074 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:03:05.794+0000 7fe34d3eb700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T02:03:06.074 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:03:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:03:05.803+0000 7fe3441d4700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:03:06.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:05 smithi137 ceph-mon[28303]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:03:06.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:05 smithi137 ceph-mon[28303]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T02:03:06.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:05 smithi137 ceph-mon[28303]: from='osd.4 ' entity='osd.4' 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:05 smithi174 ceph-mon[33171]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:05 smithi174 ceph-mon[33171]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:05 smithi174 ceph-mon[33171]: from='osd.4 ' entity='osd.4' 2024-04-25T02:03:06.282 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:06.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-04-25T02:03:06.550 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi163 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 8544M 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] boot 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T02:03:07.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi163 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 8544M 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] boot 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T02:03:07.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:07.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi163 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 8544M 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:07.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:07.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: osd.4 [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] boot 2024-04-25T02:03:07.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: osdmap e33: 5 total, 5 up, 5 in 2024-04-25T02:03:07.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:03:08.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 -- 172.21.15.174:0/3234431128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103e20 msgr2=0x7f460010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:08.022 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 --2- 172.21.15.174:0/3234431128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103e20 0x7f460010a6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45f800b0a0 tx=0x7f45f800b3b0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 -- 172.21.15.174:0/3234431128 shutdown_connections 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 --2- 172.21.15.174:0/3234431128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103e20 0x7f460010a6d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 --2- 172.21.15.174:0/3234431128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4600102280 0x7f46001026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 --2- 172.21.15.174:0/3234431128 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103480 0x7f46001038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 -- 172.21.15.174:0/3234431128 >> 172.21.15.174:0/3234431128 conn(0x7f46000fd820 msgr2=0x7f46000ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 -- 172.21.15.174:0/3234431128 shutdown_connections 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.015+0000 7f460659c700 1 -- 172.21.15.174:0/3234431128 wait complete. 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 Processor -- start 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 -- start start 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4600102280 0x7f46001984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103e20 0x7f460019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f460010e020 con 0x7f4600102280 2024-04-25T02:03:08.023 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f460010dea0 con 0x7f4600103e20 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f460659c700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f460010e1a0 con 0x7f4600103480 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f45ff7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.016+0000 7f45ff7fe700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:37614/0 (socket says 172.21.15.174:37614) 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 -- 172.21.15.174:0/3318382327 learned_addr learned my addr 172.21.15.174:0/3318382327 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f4604b39700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103e20 0x7f460019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 -- 172.21.15.174:0/3318382327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103e20 msgr2=0x7f460019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103e20 0x7f460019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 -- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4600102280 msgr2=0x7f46001984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4600102280 0x7f46001984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 -- 172.21.15.174:0/3318382327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46001a0120 con 0x7f4600103480 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45ff7fe700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f45f400c9e0 tx=0x7f45f400ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4007ac0 con 0x7f4600103480 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45f4007c60 con 0x7f4600103480 2024-04-25T02:03:08.024 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46001a0410 con 0x7f4600103480 2024-04-25T02:03:08.025 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4018780 con 0x7f4600103480 2024-04-25T02:03:08.025 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.017+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46001a09d0 con 0x7f4600103480 2024-04-25T02:03:08.025 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.018+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4600068f20 con 0x7f4600103480 2024-04-25T02:03:08.025 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.019+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f45f4018920 con 0x7f4600103480 2024-04-25T02:03:08.026 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.020+0000 7f45fd7fa700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 0x7f45e80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:08.026 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.020+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f45f40cdfa0 con 0x7f4600103480 2024-04-25T02:03:08.026 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.020+0000 7f45fffff700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 0x7f45e80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:08.026 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.021+0000 7f45fffff700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 0x7f45e80a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46001032e0 tx=0x7f45f0006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:08.029 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.024+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f45f4014030 con 0x7f4600103480 2024-04-25T02:03:08.235 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:08.230+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4600062670 con 0x7f45e80a2c20 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:09.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:08 smithi174 ceph-mon[33171]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:09.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:08 smithi137 ceph-mon[28303]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:09.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: osdmap e34: 5 total, 5 up, 5 in 2024-04-25T02:03:09.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:09.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:09.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:08 smithi163 ceph-mon[32577]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/3263062277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]': finished 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T02:03:11.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:11.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:11.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/3263062277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]': finished 2024-04-25T02:03:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T02:03:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/3263062277' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]: dispatch 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4948650-970a-4d7d-ad93-1735d9fffdfe"}]': finished 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: osdmap e35: 6 total, 5 up, 6 in 2024-04-25T02:03:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:12.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:12 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/3881856368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:12.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:12 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/3881856368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:12.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:12 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/3881856368' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:13 smithi163 ceph-mon[32577]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:13.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:13 smithi174 ceph-mon[33171]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:13 smithi137 ceph-mon[28303]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:15.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:15 smithi174 ceph-mon[33171]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:15.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:15 smithi163 ceph-mon[32577]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:15.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:15 smithi137 ceph-mon[28303]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:17 smithi163 ceph-mon[32577]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:17 smithi174 ceph-mon[33171]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:17.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:17 smithi137 ceph-mon[28303]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:18.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:03:18.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:18.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:03:18.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:18.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T02:03:18.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:19.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:19 smithi174 ceph-mon[33171]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:19.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:19 smithi174 ceph-mon[33171]: Deploying daemon osd.5 on smithi174 2024-04-25T02:03:19.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:19 smithi137 ceph-mon[28303]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:19.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:19 smithi137 ceph-mon[28303]: Deploying daemon osd.5 on smithi174 2024-04-25T02:03:19.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:19 smithi163 ceph-mon[32577]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:19.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:19 smithi163 ceph-mon[32577]: Deploying daemon osd.5 on smithi174 2024-04-25T02:03:21.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:21 smithi174 ceph-mon[33171]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:21.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:21 smithi137 ceph-mon[28303]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:21.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:21 smithi163 ceph-mon[32577]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:23.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:23 smithi174 ceph-mon[33171]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:23.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:23 smithi137 ceph-mon[28303]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:23.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:23 smithi163 ceph-mon[32577]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:24.953 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:24.953 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:24.954 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:24 smithi174 ceph-mon[33171]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:25.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:25.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:25.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:24 smithi137 ceph-mon[28303]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:25.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:25.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:25.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:25.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:24 smithi163 ceph-mon[32577]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.270 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:27 smithi174 ceph-mon[33171]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:27.270 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.265+0000 7f45fd7fa700 1 -- 172.21.15.174:0/3318382327 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4600062670 con 0x7f45e80a2c20 2024-04-25T02:03:27.271 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.266+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 msgr2=0x7f45e80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.266+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 0x7f45e80a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46001032e0 tx=0x7f45f0006d20 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.266+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 msgr2=0x7f4600198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.266+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f45f400c9e0 tx=0x7f45f400ccf0 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 shutdown_connections 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f45e80a2c20 0x7f45e80a50e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4600103e20 0x7f460019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4600102280 0x7f46001984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 --2- 172.21.15.174:0/3318382327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4600103480 0x7f4600198a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:27.272 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 >> 172.21.15.174:0/3318382327 conn(0x7f46000fd820 msgr2=0x7f46001066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:27.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 shutdown_connections 2024-04-25T02:03:27.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:03:27.267+0000 7f460659c700 1 -- 172.21.15.174:0/3318382327 wait complete. 2024-04-25T02:03:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:27 smithi137 ceph-mon[28303]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:27.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:27 smithi163 ceph-mon[32577]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:27.901 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T02:03:27.903 INFO:tasks.cephadm:Deploying osd.6 on smithi137 with /dev/vg_nvme/lv_2... 2024-04-25T02:03:27.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T02:03:28.362 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:03:28.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:28 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:28 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:28 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:28.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:28 smithi174 ceph-mon[33171]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:28.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:28 smithi174 ceph-mon[33171]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:28.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:28 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:28 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:28 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:28.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:28 smithi137 ceph-mon[28303]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:28.504 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:28 smithi137 ceph-mon[28303]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:28.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:28 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:28 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:28 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:28 smithi163 ceph-mon[32577]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:28 smithi163 ceph-mon[32577]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:29 smithi163 ceph-mon[32577]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:03:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T02:03:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:29 smithi174 ceph-mon[33171]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: from='osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: osdmap e36: 6 total, 5 up, 6 in 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:03:29.693 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:29 smithi137 ceph-mon[28303]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: from='osd.5 ' entity='osd.5' 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] boot 2024-04-25T02:03:30.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T02:03:30.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:30.427 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:03:30.091+0000 7f417dca3700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T02:03:30.427 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:03:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:03:30.099+0000 7f4174a8c700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:03:30.588 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: from='osd.5 ' entity='osd.5' 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] boot 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T02:03:30.589 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:30 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: from='osd.5 ' entity='osd.5' 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: osd.5 [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] boot 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: osdmap e38: 6 total, 6 up, 6 in 2024-04-25T02:03:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:30 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:03:31.156 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T02:03:31.156 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T02:03:31.156 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-25T02:03:31.156 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-25T02:03:31.156 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0341552 s, 307 MB/s 2024-04-25T02:03:31.157 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:31 smithi137 ceph-mon[28303]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T02:03:31.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:31 smithi163 ceph-mon[32577]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:31 smithi174 ceph-mon[33171]: osdmap e39: 6 total, 6 up, 6 in 2024-04-25T02:03:32.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2024-04-25T02:03:32.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:32 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi174 2024-04-25T02:03:32.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:32 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 8544M 2024-04-25T02:03:32.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:32 smithi137 ceph-mon[28303]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T02:03:32.560 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:03:32.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:32 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi174 2024-04-25T02:03:32.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:32 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 8544M 2024-04-25T02:03:32.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:32 smithi163 ceph-mon[32577]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T02:03:32.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:32 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi174 2024-04-25T02:03:32.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:32 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 8544M 2024-04-25T02:03:32.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:32 smithi174 ceph-mon[33171]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T02:03:33.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:33 smithi163 ceph-mon[32577]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:33.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:33 smithi174 ceph-mon[33171]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:33.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:33 smithi137 ceph-mon[28303]: pgmap v153: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.461+0000 7fca1b000700 1 -- 172.21.15.137:0/3994833352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14076200 msgr2=0x7fca14074660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 --2- 172.21.15.137:0/3994833352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14076200 0x7fca14074660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fca04009990 tx=0x7fca04009ca0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 -- 172.21.15.137:0/3994833352 shutdown_connections 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 --2- 172.21.15.137:0/3994833352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca1410a170 0x7fca1410c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 --2- 172.21.15.137:0/3994833352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14076200 0x7fca14074660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 --2- 172.21.15.137:0/3994833352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca14074c30 0x7fca140750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 -- 172.21.15.137:0/3994833352 >> 172.21.15.137:0/3994833352 conn(0x7fca140fd830 msgr2=0x7fca140ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 -- 172.21.15.137:0/3994833352 shutdown_connections 2024-04-25T02:03:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.462+0000 7fca1b000700 1 -- 172.21.15.137:0/3994833352 wait complete. 2024-04-25T02:03:34.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 Processor -- start 2024-04-25T02:03:34.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 -- start start 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca14076200 0x7fca1419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 0x7fca141a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca14110190 con 0x7fca14074c30 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fca14110010 con 0x7fca1410a170 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.463+0000 7fca1b000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca14110310 con 0x7fca14076200 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36886/0 (socket says 172.21.15.137:36886) 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 -- 172.21.15.137:0/2534030538 learned_addr learned my addr 172.21.15.137:0/2534030538 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca0b400700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca14076200 0x7fca1419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca19000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 0x7fca141a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 -- 172.21.15.137:0/2534030538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca14076200 msgr2=0x7fca1419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca14076200 0x7fca1419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 -- 172.21.15.137:0/2534030538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 msgr2=0x7fca141a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 0x7fca141a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca13e00700 1 -- 172.21.15.137:0/2534030538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141a23b0 con 0x7fca14074c30 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.464+0000 7fca19000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 0x7fca141a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca13e00700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca04005910 tx=0x7fca0400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04026070 con 0x7fca14074c30 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca0400fe50 con 0x7fca14074c30 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca141a2640 con 0x7fca14074c30 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04017650 con 0x7fca14074c30 2024-04-25T02:03:34.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.465+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca141a2af0 con 0x7fca14074c30 2024-04-25T02:03:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.466+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca14068f20 con 0x7fca14074c30 2024-04-25T02:03:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.468+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fca04029070 con 0x7fca14074c30 2024-04-25T02:03:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.470+0000 7fca11600700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 0x7fc9f80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:03:34.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.470+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7fca040cf460 con 0x7fca14074c30 2024-04-25T02:03:34.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.470+0000 7fca0b400700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 0x7fc9f80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:03:34.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.471+0000 7fca0b400700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 0x7fc9f80a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009c60 tx=0x7fc9fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:03:34.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.473+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fca04030070 con 0x7fca14074c30 2024-04-25T02:03:34.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:34 smithi163 ceph-mon[32577]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T02:03:34.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:34 smithi174 ceph-mon[33171]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T02:03:34.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:03:34.706+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fca14062670 con 0x7fc9f80a2ca0 2024-04-25T02:03:34.712 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:34 smithi137 ceph-mon[28303]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T02:03:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:35 smithi163 ceph-mon[32577]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:35 smithi163 ceph-mon[32577]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T02:03:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:35 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:35.665 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:35 smithi137 ceph-mon[28303]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:35.665 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:35 smithi137 ceph-mon[28303]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T02:03:35.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:35.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:35.666 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:35 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:35 smithi174 ceph-mon[33171]: pgmap v155: 1 pgs: 1 remapped+peering; 577 KiB data, 582 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:35 smithi174 ceph-mon[33171]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T02:03:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:03:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:03:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:35 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:36.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:36 smithi163 ceph-mon[32577]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:36.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:36 smithi174 ceph-mon[33171]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:36.685 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:36 smithi137 ceph-mon[28303]: from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:03:37.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:37 smithi163 ceph-mon[32577]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-25T02:03:37.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:37 smithi174 ceph-mon[33171]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-25T02:03:37.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:37 smithi137 ceph-mon[28303]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-25T02:03:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:03:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1130812294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]': finished 2024-04-25T02:03:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: osdmap e43: 7 total, 6 up, 7 in 2024-04-25T02:03:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:03:39.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:03:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1130812294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]': finished 2024-04-25T02:03:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: osdmap e43: 7 total, 6 up, 7 in 2024-04-25T02:03:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1130812294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]: dispatch 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e22c068f-0298-47f3-a90b-8735effc8206"}]': finished 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: osdmap e43: 7 total, 6 up, 7 in 2024-04-25T02:03:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:03:40.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:40 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1185050030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:40.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:40 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1185050030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:40.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:40 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1185050030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:03:41.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:41 smithi163 ceph-mon[32577]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-25T02:03:41.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:41 smithi174 ceph-mon[33171]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-25T02:03:41.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:41 smithi137 ceph-mon[28303]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-04-25T02:03:43.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:43 smithi163 ceph-mon[32577]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:03:43.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:43 smithi174 ceph-mon[33171]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:03:43.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:43 smithi137 ceph-mon[28303]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:03:45.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:45 smithi137 ceph-mon[28303]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:03:45.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:45 smithi163 ceph-mon[32577]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:03:45.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:45 smithi174 ceph-mon[33171]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:03:47.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:47 smithi163 ceph-mon[32577]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:47.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:47 smithi174 ceph-mon[33171]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:47.716 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:47 smithi137 ceph-mon[28303]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:48.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T02:03:48.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:48.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T02:03:48.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:48.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-25T02:03:48.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:03:49.466 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:49 smithi137 ceph-mon[28303]: Deploying daemon osd.6 on smithi137 2024-04-25T02:03:49.466 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:49 smithi137 ceph-mon[28303]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:49.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:49 smithi163 ceph-mon[32577]: Deploying daemon osd.6 on smithi137 2024-04-25T02:03:49.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:49 smithi163 ceph-mon[32577]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:49.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:49 smithi174 ceph-mon[33171]: Deploying daemon osd.6 on smithi137 2024-04-25T02:03:49.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:49 smithi174 ceph-mon[33171]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:51.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:51 smithi137 ceph-mon[28303]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:51.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:51 smithi163 ceph-mon[32577]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:51.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:51 smithi174 ceph-mon[33171]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:53.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:53 smithi163 ceph-mon[32577]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:53.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:53 smithi174 ceph-mon[33171]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:53.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:53 smithi137 ceph-mon[28303]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:55.649 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:55 smithi137 ceph-mon[28303]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:55 smithi174 ceph-mon[33171]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:55.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:55 smithi163 ceph-mon[32577]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:56.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:56.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:56.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:56.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:56.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:03:56.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:56.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:03:57.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:57 smithi174 ceph-mon[33171]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:57.753 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:57 smithi137 ceph-mon[28303]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:57.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:57 smithi163 ceph-mon[32577]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:59.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:03:59 smithi137 ceph-mon[28303]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:59.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:03:59 smithi174 ceph-mon[33171]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:03:59.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:03:59 smithi163 ceph-mon[32577]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:00.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.897+0000 7fca11600700 1 -- 172.21.15.137:0/2534030538 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fca14062670 con 0x7fc9f80a2ca0 2024-04-25T02:04:00.903 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 6 on host 'smithi137' 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.900+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 msgr2=0x7fc9f80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.900+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 0x7fc9f80a5160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009c60 tx=0x7fc9fc009260 comp rx=0 tx=0).stop 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.900+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 msgr2=0x7fca1419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.900+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca04005910 tx=0x7fca0400f690 comp rx=0 tx=0).stop 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 shutdown_connections 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f80a2ca0 0x7fc9f80a5160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1410a170 0x7fca141a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:00.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca14074c30 0x7fca1419a750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:00.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 --2- 172.21.15.137:0/2534030538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca14076200 0x7fca1419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:00.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 >> 172.21.15.137:0/2534030538 conn(0x7fca140fd830 msgr2=0x7fca141060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:00.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 shutdown_connections 2024-04-25T02:04:00.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:00.901+0000 7fca1b000700 1 -- 172.21.15.137:0/2534030538 wait complete. 2024-04-25T02:04:01.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:00 smithi137 ceph-mon[28303]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:00 smithi163 ceph-mon[32577]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:01.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:01.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:01.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:01.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-25T02:04:01.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:00 smithi174 ceph-mon[33171]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:01.637 DEBUG:teuthology.orchestra.run.smithi137:osd.6> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.6.service 2024-04-25T02:04:01.644 INFO:tasks.cephadm:Deploying osd.7 on smithi163 with /dev/vg_nvme/lv_2... 2024-04-25T02:04:01.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T02:04:01.896 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:04:02.002 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.003 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:01 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:02.032 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:04:01.758+0000 7f7efa600700 -1 osd.6 0 waiting for initial osdmap 2024-04-25T02:04:02.032 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:04:01.779+0000 7f7ef5e00700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:04:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T02:04:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T02:04:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:01 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:02.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-25T02:04:02.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: osdmap e44: 7 total, 6 up, 7 in 2024-04-25T02:04:02.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:02.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:04:02.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:02.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:01 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:03.006 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:02 smithi163 ceph-mon[32577]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:04:03.007 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:02 smithi163 ceph-mon[32577]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T02:04:03.007 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.007 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.007 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:02 smithi163 ceph-mon[32577]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:03.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:02 smithi137 ceph-mon[28303]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:04:03.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:02 smithi137 ceph-mon[28303]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T02:04:03.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:02 smithi137 ceph-mon[28303]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:02 smithi174 ceph-mon[33171]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:04:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:02 smithi174 ceph-mon[33171]: osdmap e45: 7 total, 6 up, 7 in 2024-04-25T02:04:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:03.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:02 smithi174 ceph-mon[33171]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-04-25T02:04:03.695 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T02:04:03.695 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T02:04:03.695 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2024-04-25T02:04:03.696 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2024-04-25T02:04:03.696 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011456 s, 915 MB/s 2024-04-25T02:04:03.696 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2024-04-25T02:04:04.031 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:03 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:04:04.031 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:03 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:04:04.031 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:03 smithi163 ceph-mon[32577]: osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] boot 2024-04-25T02:04:04.031 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:03 smithi163 ceph-mon[32577]: osdmap e46: 7 total, 7 up, 7 in 2024-04-25T02:04:04.031 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:03 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:03 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:04:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:03 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:04:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:03 smithi137 ceph-mon[28303]: osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] boot 2024-04-25T02:04:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:03 smithi137 ceph-mon[28303]: osdmap e46: 7 total, 7 up, 7 in 2024-04-25T02:04:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:03 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:04.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:03 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:04:04.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:03 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:04:04.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:03 smithi174 ceph-mon[33171]: osd.6 [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] boot 2024-04-25T02:04:04.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:03 smithi174 ceph-mon[33171]: osdmap e46: 7 total, 7 up, 7 in 2024-04-25T02:04:04.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:03 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:04:04.294 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi163:vg_nvme/lv_2 2024-04-25T02:04:04.538 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:04:04.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:04 smithi163 ceph-mon[32577]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T02:04:04.883 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:04 smithi163 ceph-mon[32577]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:05.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:04 smithi137 ceph-mon[28303]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T02:04:05.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:04 smithi137 ceph-mon[28303]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:05.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:04 smithi174 ceph-mon[33171]: osdmap e47: 7 total, 7 up, 7 in 2024-04-25T02:04:05.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:04 smithi174 ceph-mon[33171]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:06.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 -- 172.21.15.163:0/2857726320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc103610 msgr2=0x7f61bc103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:06.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/2857726320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc103610 0x7f61bc103a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009990 tx=0x7f61a8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 -- 172.21.15.163:0/2857726320 shutdown_connections 2024-04-25T02:04:06.015 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/2857726320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103fb0 0x7f61bc10a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/2857726320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc100630 0x7f61bc100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/2857726320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc103610 0x7f61bc103a70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.002+0000 7f61c2ba4700 1 -- 172.21.15.163:0/2857726320 >> 172.21.15.163:0/2857726320 conn(0x7f61bc0fbf90 msgr2=0x7f61bc0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- 172.21.15.163:0/2857726320 shutdown_connections 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- 172.21.15.163:0/2857726320 wait complete. 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 Processor -- start 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- start start 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 0x7f61bc1015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 0x7f61bc101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc10e0a0 con 0x7f61bc103fb0 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc10df20 con 0x7f61bc100630 2024-04-25T02:04:06.016 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c2ba4700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc10e220 con 0x7f61bc103610 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c0940700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c0940700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:44046/0 (socket says 172.21.15.163:44046) 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.003+0000 7f61c0940700 1 -- 172.21.15.163:0/981760992 learned_addr learned my addr 172.21.15.163:0/981760992 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61bbfff700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 0x7f61bc1015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c1141700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 0x7f61bc101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 -- 172.21.15.163:0/981760992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 msgr2=0x7f61bc1015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 0x7f61bc1015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 -- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 msgr2=0x7f61bc101b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 0x7f61bc101b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 -- 172.21.15.163:0/981760992 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc1023b0 con 0x7f61bc100630 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61bbfff700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 0x7f61bc1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c1141700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 0x7f61bc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c0940700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c970 tx=0x7f61b000cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:06.017 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0004220 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc1a2730 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61b0007da0 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b000f450 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.004+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc1a2c70 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.005+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc068f20 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.006+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f61b00078a0 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.007+0000 7f61b9ffb700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 0x7f61ac0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.007+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f61b00cdfc0 con 0x7f61bc100630 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.007+0000 7f61bbfff700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 0x7f61ac0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.008+0000 7f61bbfff700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 0x7f61ac0a5160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b5c0 tx=0x7f61a8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:06.018 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.012+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f61b0014030 con 0x7f61bc100630 2024-04-25T02:04:06.223 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:06.217+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f61bc062670 con 0x7f61ac0a2ca0 2024-04-25T02:04:06.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:06.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:06.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:06.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:06.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:06.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:06.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:06.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:06.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:07.419 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:07.419 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:07.420 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:07 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:07.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:07 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:07 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:08.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:08 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi137 2024-04-25T02:04:08.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:08 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-25T02:04:08.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:08 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi137 2024-04-25T02:04:08.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:08 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-25T02:04:08.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:08 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi137 2024-04-25T02:04:08.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:08 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 5696M 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/3492658779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]': finished 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: osdmap e48: 8 total, 7 up, 8 in 2024-04-25T02:04:09.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:09.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:09.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/3492658779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]': finished 2024-04-25T02:04:09.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: osdmap e48: 8 total, 7 up, 8 in 2024-04-25T02:04:09.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/3492658779' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]: dispatch 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "967eb934-6a0b-4f22-8bc7-5c0da457ffd3"}]': finished 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: osdmap e48: 8 total, 7 up, 8 in 2024-04-25T02:04:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:10.597 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:10 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/3874280260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:10.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:10 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/3874280260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:10.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:10 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/3874280260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:11 smithi163 ceph-mon[32577]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:11.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:11 smithi174 ceph-mon[33171]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:11.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:11 smithi137 ceph-mon[28303]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:13 smithi163 ceph-mon[32577]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:13.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:13 smithi174 ceph-mon[33171]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:13.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:13 smithi137 ceph-mon[28303]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:15.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:15 smithi163 ceph-mon[32577]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:15.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:15 smithi174 ceph-mon[33171]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:15.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:15 smithi137 ceph-mon[28303]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:16.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T02:04:16.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:16.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T02:04:16.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:16.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-25T02:04:16.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:17 smithi174 ceph-mon[33171]: Deploying daemon osd.7 on smithi163 2024-04-25T02:04:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:17 smithi174 ceph-mon[33171]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:17.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:17 smithi163 ceph-mon[32577]: Deploying daemon osd.7 on smithi163 2024-04-25T02:04:17.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:17 smithi163 ceph-mon[32577]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:17.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:17 smithi137 ceph-mon[28303]: Deploying daemon osd.7 on smithi163 2024-04-25T02:04:17.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:17 smithi137 ceph-mon[28303]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:19.519 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:19 smithi163 ceph-mon[32577]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:19.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:19 smithi174 ceph-mon[33171]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:19 smithi137 ceph-mon[28303]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:21.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:21 smithi174 ceph-mon[33171]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:21.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:21 smithi137 ceph-mon[28303]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:21.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:21 smithi163 ceph-mon[32577]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:22.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:22.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:22.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:22 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:22.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:22 smithi163 ceph-mon[32577]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:22.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:22.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:22.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:22 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:22.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:22 smithi174 ceph-mon[33171]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:23.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:23.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:23.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:22 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:23.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:22 smithi137 ceph-mon[28303]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:25.163 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 7 on host 'smithi163' 2024-04-25T02:04:25.163 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.157+0000 7f61b9ffb700 1 -- 172.21.15.163:0/981760992 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f61bc062670 con 0x7f61ac0a2ca0 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 msgr2=0x7f61ac0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 0x7f61ac0a5160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61a800b5c0 tx=0x7f61a8005fb0 comp rx=0 tx=0).stop 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 msgr2=0x7f61bc102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61b000c970 tx=0x7f61b000cd30 comp rx=0 tx=0).stop 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 shutdown_connections 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61ac0a2ca0 0x7f61ac0a5160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61bc100630 0x7f61bc102f70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:25.165 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61bc103fb0 0x7f61bc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:25.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 --2- 172.21.15.163:0/981760992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61bc103610 0x7f61bc1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:25.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.159+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 >> 172.21.15.163:0/981760992 conn(0x7f61bc0fbf90 msgr2=0x7f61bc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:25.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.160+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 shutdown_connections 2024-04-25T02:04:25.166 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:04:25.160+0000 7f61c2ba4700 1 -- 172.21.15.163:0/981760992 wait complete. 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:25.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:25.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:25.815 DEBUG:teuthology.orchestra.run.smithi163:osd.7> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.7.service 2024-04-25T02:04:25.818 INFO:tasks.cephadm:Deploying osd.8 on smithi174 with /dev/vg_nvme/lv_2... 2024-04-25T02:04:25.818 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T02:04:26.065 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:04:26.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:26 smithi163 ceph-mon[32577]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:26.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:26 smithi163 ceph-mon[32577]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:26.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:26 smithi174 ceph-mon[33171]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:26.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:26 smithi174 ceph-mon[33171]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:26.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:26 smithi137 ceph-mon[28303]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:26.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:26 smithi137 ceph-mon[28303]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-25T02:04:27.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:27.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T02:04:27.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:27.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T02:04:27.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:27.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:27 smithi174 ceph-mon[33171]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:27 smithi163 ceph-mon[32577]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: from='osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: osdmap e49: 8 total, 7 up, 8 in 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:27 smithi137 ceph-mon[28303]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116506 s, 900 MB/s 2024-04-25T02:04:28.045 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-04-25T02:04:28.355 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:04:28.179+0000 7f9ad25e6700 -1 osd.7 0 waiting for initial osdmap 2024-04-25T02:04:28.355 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:04:28.193+0000 7f9acabd2700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:04:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-mon[32577]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:04:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-mon[32577]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T02:04:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:28 smithi163 ceph-mon[32577]: from='osd.7 ' entity='osd.7' 2024-04-25T02:04:28.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:28 smithi174 ceph-mon[33171]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:04:28.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:28 smithi174 ceph-mon[33171]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T02:04:28.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:28 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:28 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:28 smithi174 ceph-mon[33171]: from='osd.7 ' entity='osd.7' 2024-04-25T02:04:28.739 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-04-25T02:04:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:28 smithi137 ceph-mon[28303]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:04:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:28 smithi137 ceph-mon[28303]: osdmap e50: 8 total, 7 up, 8 in 2024-04-25T02:04:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:28 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:28 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:28 smithi137 ceph-mon[28303]: from='osd.7 ' entity='osd.7' 2024-04-25T02:04:28.982 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] boot 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: osdmap e51: 8 total, 8 up, 8 in 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:29 smithi163 ceph-mon[32577]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T02:04:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:04:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:04:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] boot 2024-04-25T02:04:29.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: osdmap e51: 8 total, 8 up, 8 in 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:29 smithi174 ceph-mon[33171]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T02:04:29.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:04:29.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: osd.7 [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] boot 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: osdmap e51: 8 total, 8 up, 8 in 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:29 smithi137 ceph-mon[28303]: osdmap e52: 8 total, 8 up, 8 in 2024-04-25T02:04:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:30 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi163 2024-04-25T02:04:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:30 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 5696M 2024-04-25T02:04:30.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:30 smithi163 ceph-mon[32577]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T02:04:30.670 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:30 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi163 2024-04-25T02:04:30.671 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:30 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 5696M 2024-04-25T02:04:30.671 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:30 smithi174 ceph-mon[33171]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 -- 172.21.15.174:0/1981619084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc105700 msgr2=0x7f53dc107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 --2- 172.21.15.174:0/1981619084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc105700 0x7f53dc107af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009990 tx=0x7f53c8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 -- 172.21.15.174:0/1981619084 shutdown_connections 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 --2- 172.21.15.174:0/1981619084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 0x7f53dc1051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 --2- 172.21.15.174:0/1981619084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53dc108030 0x7f53dc10a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 --2- 172.21.15.174:0/1981619084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc105700 0x7f53dc107af0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 -- 172.21.15.174:0/1981619084 >> 172.21.15.174:0/1981619084 conn(0x7f53dc0fc720 msgr2=0x7f53dc0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 -- 172.21.15.174:0/1981619084 shutdown_connections 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.667+0000 7f53e2b91700 1 -- 172.21.15.174:0/1981619084 wait complete. 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 Processor -- start 2024-04-25T02:04:30.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 -- start start 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 0x7f53dc1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53dc105700 0x7f53dc198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10dfe0 con 0x7f53dc105700 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10de60 con 0x7f53dc102dd0 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e2b91700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc10e160 con 0x7f53dc108030 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e112e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e112e700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:35698/0 (socket says 172.21.15.174:35698) 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e112e700 1 -- 172.21.15.174:0/4080250458 learned_addr learned my addr 172.21.15.174:0/4080250458 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.668+0000 7f53e092d700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 0x7f53dc1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 -- 172.21.15.174:0/4080250458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 msgr2=0x7f53dc1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 0x7f53dc1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 -- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53dc105700 msgr2=0x7f53dc198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:30.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53dc105700 0x7f53dc198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 -- 172.21.15.174:0/4080250458 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc1a0140 con 0x7f53dc108030 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e112e700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53d400b9a0 tx=0x7f53d400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4019070 con 0x7f53dc108030 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f53d4014440 con 0x7f53dc108030 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc1a0430 con 0x7f53dc108030 2024-04-25T02:04:30.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40075d0 con 0x7f53dc108030 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.669+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a0970 con 0x7f53dc108030 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.670+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc068f20 con 0x7f53dc108030 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.672+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f53d401c070 con 0x7f53dc108030 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.672+0000 7f53d9ffb700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 0x7f53cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.673+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5426+0+0 (secure 0 0 0) 0x7f53d40cde00 con 0x7f53dc108030 2024-04-25T02:04:30.678 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.673+0000 7f53e092d700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 0x7f53cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:30.679 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.674+0000 7f53e092d700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 0x7f53cc0a50e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53d0005ea0 tx=0x7f53d0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:30.681 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.676+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f53d409b930 con 0x7f53dc108030 2024-04-25T02:04:30.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:30 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi163 2024-04-25T02:04:30.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:30 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 5696M 2024-04-25T02:04:30.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:30 smithi137 ceph-mon[28303]: osdmap e53: 8 total, 8 up, 8 in 2024-04-25T02:04:30.885 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:30.879+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f53dc062670 con 0x7f53cc0a2c20 2024-04-25T02:04:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:31 smithi163 ceph-mon[32577]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 408 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:31 smithi163 ceph-mon[32577]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-04-25T02:04:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:31 smithi174 ceph-mon[33171]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 408 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:31 smithi174 ceph-mon[33171]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-04-25T02:04:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:31 smithi137 ceph-mon[28303]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 408 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:31 smithi137 ceph-mon[28303]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-04-25T02:04:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:32.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:32 smithi174 ceph-mon[33171]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:32.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:32 smithi174 ceph-mon[33171]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T02:04:32.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:32 smithi137 ceph-mon[28303]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:32.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:32 smithi137 ceph-mon[28303]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T02:04:32.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:32 smithi163 ceph-mon[32577]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:32.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:32 smithi163 ceph-mon[32577]: osdmap e54: 8 total, 8 up, 8 in 2024-04-25T02:04:33.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:33 smithi174 ceph-mon[33171]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 409 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:33.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:33 smithi174 ceph-mon[33171]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T02:04:33.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:33 smithi137 ceph-mon[28303]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 409 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:33.683 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:33 smithi137 ceph-mon[28303]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T02:04:33.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:33 smithi163 ceph-mon[32577]: pgmap v197: 1 pgs: 1 remapped+peering; 577 KiB data, 409 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:33.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:33 smithi163 ceph-mon[32577]: osdmap e55: 8 total, 8 up, 8 in 2024-04-25T02:04:34.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/1416442402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]': finished 2024-04-25T02:04:34.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: osdmap e56: 9 total, 8 up, 9 in 2024-04-25T02:04:34.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:34.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/2694757437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:34.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/1416442402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]': finished 2024-04-25T02:04:34.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: osdmap e56: 9 total, 8 up, 9 in 2024-04-25T02:04:34.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:34.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/2694757437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/1416442402' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]: dispatch 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "574d3bea-4097-4bf7-ac49-a60fbe0b1f7f"}]': finished 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: osdmap e56: 9 total, 8 up, 9 in 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:34.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/2694757437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:04:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:35 smithi137 ceph-mon[28303]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:35.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:35 smithi137 ceph-mon[28303]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-04-25T02:04:35.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:35 smithi137 ceph-mon[28303]: Cluster is now healthy 2024-04-25T02:04:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:35 smithi174 ceph-mon[33171]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:35 smithi174 ceph-mon[33171]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-04-25T02:04:35.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:35 smithi174 ceph-mon[33171]: Cluster is now healthy 2024-04-25T02:04:35.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:35 smithi163 ceph-mon[32577]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:35.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:35 smithi163 ceph-mon[32577]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-04-25T02:04:35.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:35 smithi163 ceph-mon[32577]: Cluster is now healthy 2024-04-25T02:04:37.667 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:37 smithi174 ceph-mon[33171]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:37.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:37 smithi137 ceph-mon[28303]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:37.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:37 smithi163 ceph-mon[32577]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:39 smithi174 ceph-mon[33171]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:39.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:39 smithi137 ceph-mon[28303]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:39.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:39 smithi163 ceph-mon[32577]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:41.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:41 smithi174 ceph-mon[33171]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:41.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:41 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T02:04:41.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:41 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:41 smithi137 ceph-mon[28303]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T02:04:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:41 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:41.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:41 smithi163 ceph-mon[32577]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:41.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:41 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-25T02:04:41.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:41 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:42.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:42 smithi174 ceph-mon[33171]: Deploying daemon osd.8 on smithi174 2024-04-25T02:04:42.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:42 smithi137 ceph-mon[28303]: Deploying daemon osd.8 on smithi174 2024-04-25T02:04:42.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:42 smithi163 ceph-mon[32577]: Deploying daemon osd.8 on smithi174 2024-04-25T02:04:43.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:43 smithi174 ceph-mon[33171]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:43.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:43 smithi137 ceph-mon[28303]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:43.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:43 smithi163 ceph-mon[32577]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:45.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:45 smithi137 ceph-mon[28303]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:45.842 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:45 smithi174 ceph-mon[33171]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:45.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:45 smithi163 ceph-mon[32577]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:47.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:47 smithi174 ceph-mon[33171]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:47.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:47.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:47 smithi163 ceph-mon[32577]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:47.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:47.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:47 smithi137 ceph-mon[28303]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:47.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:47.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:49.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:49 smithi174 ceph-mon[33171]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:49.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:49 smithi137 ceph-mon[28303]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:49.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:49 smithi163 ceph-mon[32577]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:50.572 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.565+0000 7f53d9ffb700 1 -- 172.21.15.174:0/4080250458 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f53dc062670 con 0x7f53cc0a2c20 2024-04-25T02:04:50.573 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 8 on host 'smithi174' 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 msgr2=0x7f53cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 0x7f53cc0a50e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53d0005ea0 tx=0x7f53d0005e30 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 msgr2=0x7f53dc19faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53d400b9a0 tx=0x7f53d400bd60 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 shutdown_connections 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f53cc0a2c20 0x7f53cc0a50e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53dc102dd0 0x7f53dc1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f53dc108030 0x7f53dc19faa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 --2- 172.21.15.174:0/4080250458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53dc105700 0x7f53dc198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 >> 172.21.15.174:0/4080250458 conn(0x7f53dc0fc720 msgr2=0x7f53dc1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 shutdown_connections 2024-04-25T02:04:50.575 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:04:50.568+0000 7f53e2b91700 1 -- 172.21.15.174:0/4080250458 wait complete. 2024-04-25T02:04:50.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:50.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:50.889 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:50 smithi174 ceph-mon[33171]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:50 smithi163 ceph-mon[32577]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:50 smithi137 ceph-mon[28303]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-25T02:04:51.231 DEBUG:teuthology.orchestra.run.smithi174:osd.8> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.8.service 2024-04-25T02:04:51.234 INFO:tasks.cephadm:Deploying osd.9 on smithi137 with /dev/vg_nvme/lv_1... 2024-04-25T02:04:51.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T02:04:51.674 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.574 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-mon[33171]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:52.575 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:04:52.522+0000 7fe28a29f700 -1 osd.8 0 waiting for initial osdmap 2024-04-25T02:04:52.575 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:04:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:04:52.535+0000 7fe286893700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:52 smithi163 ceph-mon[32577]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:52.950 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-25T02:04:52.950 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: from='osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.950 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: osdmap e57: 9 total, 8 up, 9 in 2024-04-25T02:04:52.951 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:52.951 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:04:52.951 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:52 smithi137 ceph-mon[28303]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-04-25T02:04:53.666 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:53 smithi174 ceph-mon[33171]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:04:53.667 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:53 smithi174 ceph-mon[33171]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T02:04:53.667 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:53.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:53 smithi163 ceph-mon[32577]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:04:53.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:53 smithi163 ceph-mon[32577]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T02:04:53.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:54.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:53 smithi137 ceph-mon[28303]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:04:54.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:53 smithi137 ceph-mon[28303]: osdmap e58: 9 total, 8 up, 9 in 2024-04-25T02:04:54.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:54.449 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0355133 s, 295 MB/s 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 2024-04-25T02:04:54.450 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2024-04-25T02:04:54.718 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:04:54.718 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:04:54.718 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] boot 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: osdmap e59: 9 total, 9 up, 9 in 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi174 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 5696M 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:54.719 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:54 smithi137 ceph-mon[28303]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T02:04:54.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:04:54.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:04:54.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] boot 2024-04-25T02:04:54.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: osdmap e59: 9 total, 9 up, 9 in 2024-04-25T02:04:54.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi174 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 5696M 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:54 smithi163 ceph-mon[32577]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T02:04:54.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:04:54.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: osd.8 [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] boot 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: osdmap e59: 9 total, 9 up, 9 in 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi174 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 5696M 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:04:54.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:04:54.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:54.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:54 smithi174 ceph-mon[33171]: osdmap e60: 9 total, 9 up, 9 in 2024-04-25T02:04:55.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi137:vg_nvme/lv_1 2024-04-25T02:04:55.700 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:04:56.861 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:56 smithi137 ceph-mon[28303]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T02:04:56.861 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:56 smithi137 ceph-mon[28303]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:56.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:56 smithi163 ceph-mon[32577]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T02:04:56.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:56 smithi163 ceph-mon[32577]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:56.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:56 smithi174 ceph-mon[33171]: osdmap e61: 9 total, 9 up, 9 in 2024-04-25T02:04:56.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:56 smithi174 ceph-mon[33171]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 -- 172.21.15.137:0/2173898176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa55010a090 msgr2=0x7fa55010c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 --2- 172.21.15.137:0/2173898176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa55010a090 0x7fa55010c520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa54800b0a0 tx=0x7fa54800b3b0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 -- 172.21.15.137:0/2173898176 shutdown_connections 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 --2- 172.21.15.137:0/2173898176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa55010a090 0x7fa55010c520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 --2- 172.21.15.137:0/2173898176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550076200 0x7fa550074660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 --2- 172.21.15.137:0/2173898176 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa550074c30 0x7fa5500750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 -- 172.21.15.137:0/2173898176 >> 172.21.15.137:0/2173898176 conn(0x7fa5500fd770 msgr2=0x7fa5500ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:04:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 -- 172.21.15.137:0/2173898176 shutdown_connections 2024-04-25T02:04:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.748+0000 7fa54fe00700 1 -- 172.21.15.137:0/2173898176 wait complete. 2024-04-25T02:04:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 Processor -- start 2024-04-25T02:04:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 -- start start 2024-04-25T02:04:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa55010a090 0x7fa5501a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501100e0 con 0x7fa550076200 2024-04-25T02:04:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa55010ff60 con 0x7fa55010a090 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.749+0000 7fa54fe00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa550110260 con 0x7fa550074c30 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54e000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:38520/0 (socket says 172.21.15.137:38520) 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54e000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35664/0 (socket says 172.21.15.137:35664) 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 -- 172.21.15.137:0/824669171 learned_addr learned my addr 172.21.15.137:0/824669171 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54f400700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa55010a090 0x7fa5501a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 -- 172.21.15.137:0/824669171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa55010a090 msgr2=0x7fa5501a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa55010a090 0x7fa5501a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 -- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 msgr2=0x7fa55019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 -- 172.21.15.137:0/824669171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5501a2260 con 0x7fa550074c30 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54e000700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:04:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.750+0000 7fa54ea00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9d0 tx=0x7fa54000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.751+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000cbd0 con 0x7fa550074c30 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.751+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5501a2550 con 0x7fa550074c30 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.751+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa54000ee70 con 0x7fa550074c30 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.751+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540018710 con 0x7fa550074c30 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.751+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a2a90 con 0x7fa550074c30 2024-04-25T02:04:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.752+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550068f20 con 0x7fa550074c30 2024-04-25T02:04:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.754+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa5400188b0 con 0x7fa550074c30 2024-04-25T02:04:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.755+0000 7fa547400700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 0x7fa5340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:04:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.755+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fa5400ceb60 con 0x7fa550074c30 2024-04-25T02:04:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.756+0000 7fa54e000700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 0x7fa5340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:04:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.756+0000 7fa54e000700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 0x7fa5340a50e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa53c011490 tx=0x7fa53c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:04:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.758+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa54009c3d0 con 0x7fa550074c30 2024-04-25T02:04:57.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:57 smithi163 ceph-mon[32577]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T02:04:57.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:57 smithi174 ceph-mon[33171]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T02:04:58.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:04:57.996+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa550062670 con 0x7fa5340a2c20 2024-04-25T02:04:58.003 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:57 smithi137 ceph-mon[28303]: osdmap e62: 9 total, 9 up, 9 in 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:04:58 smithi163 ceph-mon[32577]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T02:04:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:58.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:04:58 smithi174 ceph-mon[33171]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:04:58.959 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: osdmap e63: 9 total, 9 up, 9 in 2024-04-25T02:04:58.960 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:04:58.960 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:04:58.960 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:04:58.960 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:04:58.960 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:04:58 smithi137 ceph-mon[28303]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:01.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:01 smithi163 ceph-mon[32577]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T02:05:01.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:01 smithi174 ceph-mon[33171]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T02:05:01.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:01 smithi137 ceph-mon[28303]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-04-25T02:05:02.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:02 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]: dispatch 2024-04-25T02:05:02.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:02 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]': finished 2024-04-25T02:05:02.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:02 smithi137 ceph-mon[28303]: osdmap e64: 10 total, 9 up, 10 in 2024-04-25T02:05:02.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:02.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:02 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]: dispatch 2024-04-25T02:05:02.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:02 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]': finished 2024-04-25T02:05:02.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:02 smithi174 ceph-mon[33171]: osdmap e64: 10 total, 9 up, 10 in 2024-04-25T02:05:02.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:02.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:02 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]: dispatch 2024-04-25T02:05:02.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:02 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1475407198' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53182274-54d4-4bf5-a2da-0edf8abc688f"}]': finished 2024-04-25T02:05:02.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:02 smithi163 ceph-mon[32577]: osdmap e64: 10 total, 9 up, 10 in 2024-04-25T02:05:02.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:03.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:03 smithi174 ceph-mon[33171]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:05:03.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:03 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/157692369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:03.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:03 smithi137 ceph-mon[28303]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:05:03.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:03 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/157692369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:03.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:03 smithi163 ceph-mon[32577]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:05:03.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:03 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/157692369' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:05.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:05 smithi174 ceph-mon[33171]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T02:05:05.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:05 smithi137 ceph-mon[28303]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T02:05:05.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:05 smithi163 ceph-mon[32577]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-25T02:05:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:07 smithi174 ceph-mon[33171]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T02:05:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:07 smithi137 ceph-mon[28303]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T02:05:07.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:07 smithi163 ceph-mon[32577]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-04-25T02:05:09.665 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:09 smithi137 ceph-mon[28303]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:05:09.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:09 smithi174 ceph-mon[33171]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:05:09.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:09 smithi163 ceph-mon[32577]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:05:11.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:11 smithi174 ceph-mon[33171]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:11.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T02:05:11.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:11 smithi137 ceph-mon[28303]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T02:05:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:11.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:11 smithi163 ceph-mon[32577]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:11.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-25T02:05:11.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:12.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:12 smithi174 ceph-mon[33171]: Deploying daemon osd.9 on smithi137 2024-04-25T02:05:12.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:12 smithi137 ceph-mon[28303]: Deploying daemon osd.9 on smithi137 2024-04-25T02:05:12.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:12 smithi163 ceph-mon[32577]: Deploying daemon osd.9 on smithi137 2024-04-25T02:05:13.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:13 smithi174 ceph-mon[33171]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:13.709 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:13 smithi137 ceph-mon[28303]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:13.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:13 smithi163 ceph-mon[32577]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:15.722 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:15 smithi137 ceph-mon[28303]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:15.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:15 smithi163 ceph-mon[32577]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:15.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:15 smithi174 ceph-mon[33171]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:17.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:17 smithi163 ceph-mon[32577]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:17.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:17 smithi137 ceph-mon[28303]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:17.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:17 smithi174 ceph-mon[33171]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:19 smithi137 ceph-mon[28303]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:19.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:19 smithi163 ceph-mon[32577]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:19.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:19.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:19 smithi174 ceph-mon[33171]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:19.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:19.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:21.752 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:21 smithi174 ceph-mon[33171]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:21.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:21 smithi137 ceph-mon[28303]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:21.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:21 smithi163 ceph-mon[32577]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:23.526 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:23 smithi137 ceph-mon[28303]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:23.526 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.526 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:23 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.526 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:23 smithi137 ceph-mon[28303]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:23.526 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:23 smithi137 ceph-mon[28303]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:23.612 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 9 on host 'smithi137' 2024-04-25T02:05:23.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.604+0000 7fa547400700 1 -- 172.21.15.137:0/824669171 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa550062670 con 0x7fa5340a2c20 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 msgr2=0x7fa5340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 0x7fa5340a50e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa53c011490 tx=0x7fa53c009260 comp rx=0 tx=0).stop 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 msgr2=0x7fa55019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa54000e9d0 tx=0x7fa54000ece0 comp rx=0 tx=0).stop 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 shutdown_connections 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5340a2c20 0x7fa5340a50e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa55010a090 0x7fa5501a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:23.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa550074c30 0x7fa55019a600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:23.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 --2- 172.21.15.137:0/824669171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa550076200 0x7fa55019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:23.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 >> 172.21.15.137:0/824669171 conn(0x7fa5500fd770 msgr2=0x7fa550105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:23.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 shutdown_connections 2024-04-25T02:05:23.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:05:23.608+0000 7fa54fe00700 1 -- 172.21.15.137:0/824669171 wait complete. 2024-04-25T02:05:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:23 smithi163 ceph-mon[32577]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:23 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:23 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:23 smithi163 ceph-mon[32577]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:23 smithi163 ceph-mon[32577]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:23 smithi174 ceph-mon[33171]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:23 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:23 smithi174 ceph-mon[33171]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:23 smithi174 ceph-mon[33171]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-25T02:05:24.403 DEBUG:teuthology.orchestra.run.smithi137:osd.9> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.9.service 2024-04-25T02:05:24.409 INFO:tasks.cephadm:Deploying osd.10 on smithi163 with /dev/vg_nvme/lv_1... 2024-04-25T02:05:24.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T02:05:24.658 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.682 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-mon[28303]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:24.683 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:05:24.516+0000 7f93ef400700 -1 osd.9 0 waiting for initial osdmap 2024-04-25T02:05:24.683 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:05:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:05:24.543+0000 7f93eac00700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:24.780 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:24 smithi163 ceph-mon[32577]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:24.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-25T02:05:24.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: osdmap e65: 10 total, 9 up, 10 in 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]: dispatch 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:24 smithi174 ceph-mon[33171]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:25 smithi137 ceph-mon[28303]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:05:25.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:25 smithi137 ceph-mon[28303]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T02:05:25.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:25.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:25 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:25.819 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:25 smithi163 ceph-mon[32577]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:05:25.819 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:25 smithi163 ceph-mon[32577]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T02:05:25.819 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:25.819 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:25 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:25.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:25 smithi174 ceph-mon[33171]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi137", "root=default"]}]': finished 2024-04-25T02:05:25.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:25 smithi174 ceph-mon[33171]: osdmap e66: 10 total, 9 up, 10 in 2024-04-25T02:05:25.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:25.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:25 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114827 s, 913 MB/s 2024-04-25T02:05:26.678 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2024-04-25T02:05:26.678 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:05:26.678 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:05:26.679 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] boot 2024-04-25T02:05:26.679 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: osdmap e67: 10 total, 10 up, 10 in 2024-04-25T02:05:26.679 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:26.679 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:26 smithi163 ceph-mon[32577]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:26.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:05:26.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:05:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] boot 2024-04-25T02:05:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: osdmap e67: 10 total, 10 up, 10 in 2024-04-25T02:05:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:26 smithi137 ceph-mon[28303]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:26.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:05:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:05:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: osd.9 [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] boot 2024-04-25T02:05:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: osdmap e67: 10 total, 10 up, 10 in 2024-04-25T02:05:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:05:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:26 smithi174 ceph-mon[33171]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-04-25T02:05:27.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi163:vg_nvme/lv_1 2024-04-25T02:05:27.529 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:05:27.844 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:27 smithi163 ceph-mon[32577]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T02:05:27.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:27 smithi174 ceph-mon[33171]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T02:05:28.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:27 smithi137 ceph-mon[28303]: osdmap e68: 10 total, 10 up, 10 in 2024-04-25T02:05:28.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:28 smithi137 ceph-mon[28303]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:28.869 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:28 smithi163 ceph-mon[32577]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:28.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:28 smithi174 ceph-mon[33171]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:29.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.093+0000 7f487799a700 1 -- 172.21.15.163:0/1986438717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870100940 msgr2=0x7f4870100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.101 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.093+0000 7f487799a700 1 --2- 172.21.15.163:0/1986438717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870100940 0x7f4870100d60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f486c0099c0 tx=0x7f486c009cd0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- 172.21.15.163:0/1986438717 shutdown_connections 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- 172.21.15.163:0/1986438717 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870100940 0x7f4870100d60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- 172.21.15.163:0/1986438717 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48701024e0 0x7f4870108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- 172.21.15.163:0/1986438717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4870101b40 0x7f4870101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- 172.21.15.163:0/1986438717 >> 172.21.15.163:0/1986438717 conn(0x7f48700fbee0 msgr2=0x7f48700fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- 172.21.15.163:0/1986438717 shutdown_connections 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- 172.21.15.163:0/1986438717 wait complete. 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 Processor -- start 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- start start 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4870100940 0x7f48701973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.102 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 0x7f487019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f487010cf00 con 0x7f4870100940 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f487010cd80 con 0x7f4870101b40 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.094+0000 7f487799a700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f487010d080 con 0x7f48701024e0 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:53850/0 (socket says 172.21.15.163:53850) 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 -- 172.21.15.163:0/2579125542 learned_addr learned my addr 172.21.15.163:0/2579125542 (peer_addr_for_me v2:172.21.15.163:0/0) 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4875f37700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 0x7f487019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4875736700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4870100940 0x7f48701973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 -- 172.21.15.163:0/2579125542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 msgr2=0x7f487019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 0x7f487019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 -- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4870100940 msgr2=0x7f48701973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4870100940 0x7f48701973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:29.103 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 -- 172.21.15.163:0/2579125542 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487019f040 con 0x7f4870101b40 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4875f37700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 0x7f487019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f4874f35700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f486000c9b0 tx=0x7f486000cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860007b00 con 0x7f4870101b40 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487019f330 con 0x7f4870101b40 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487019f8c0 con 0x7f4870101b40 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4860007ca0 con 0x7f4870101b40 2024-04-25T02:05:29.104 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.095+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600188c0 con 0x7f4870101b40 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.096+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4854005360 con 0x7f4870101b40 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.097+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4860018a60 con 0x7f4870101b40 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.098+0000 7f48667fc700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 0x7f485c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.098+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f48600cea50 con 0x7f4870101b40 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.098+0000 7f4875736700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 0x7f485c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:29.105 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.099+0000 7f4875736700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 0x7f485c0a50e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f486c003860 tx=0x7f486c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:29.107 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.101+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4860014030 con 0x7f4870101b40 2024-04-25T02:05:29.316 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:29.309+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4854000bf0 con 0x7f485c0a2c20 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi137 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.221 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:30.222 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:29 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi137 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:30.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:29 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi137 2024-04-25T02:05:30.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 4272M 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:30.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:30.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:30.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:29 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:31.092 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:30 smithi163 ceph-mon[32577]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:31.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:30 smithi137 ceph-mon[28303]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:31.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:30 smithi174 ceph-mon[33171]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:32.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:31 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/1961022761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:31 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:31 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]': finished 2024-04-25T02:05:32.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:31 smithi137 ceph-mon[28303]: osdmap e69: 11 total, 10 up, 11 in 2024-04-25T02:05:32.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:31 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:32.299 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:31 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/1961022761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.300 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:31 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.300 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:31 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]': finished 2024-04-25T02:05:32.300 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:31 smithi163 ceph-mon[32577]: osdmap e69: 11 total, 10 up, 11 in 2024-04-25T02:05:32.300 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:31 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:32.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:31 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/1961022761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:31 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]: dispatch 2024-04-25T02:05:32.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:31 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e169cc70-dd4a-44da-966d-8cf065db66d7"}]': finished 2024-04-25T02:05:32.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:31 smithi174 ceph-mon[33171]: osdmap e69: 11 total, 10 up, 11 in 2024-04-25T02:05:32.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:31 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:33.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:33 smithi137 ceph-mon[28303]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:33.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:33 smithi137 ceph-mon[28303]: from='client.? 172.21.15.163:0/2139528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:33.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:33 smithi163 ceph-mon[32577]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:33.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:33 smithi163 ceph-mon[32577]: from='client.? 172.21.15.163:0/2139528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:33.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:33 smithi174 ceph-mon[33171]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:33.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:33 smithi174 ceph-mon[33171]: from='client.? 172.21.15.163:0/2139528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:35.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:35 smithi174 ceph-mon[33171]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:35.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:35 smithi137 ceph-mon[28303]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:35.850 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:35 smithi163 ceph-mon[32577]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:37.595 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:37 smithi163 ceph-mon[32577]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:37.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:37 smithi174 ceph-mon[33171]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:37.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:37 smithi137 ceph-mon[28303]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:39.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:39 smithi174 ceph-mon[33171]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:39.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T02:05:39.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:39.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:39 smithi137 ceph-mon[28303]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:39.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T02:05:39.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:39.828 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:39 smithi163 ceph-mon[32577]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:39.828 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-25T02:05:39.828 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:40.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:40 smithi163 ceph-mon[32577]: Deploying daemon osd.10 on smithi163 2024-04-25T02:05:40.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:40 smithi174 ceph-mon[33171]: Deploying daemon osd.10 on smithi163 2024-04-25T02:05:40.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:40 smithi137 ceph-mon[28303]: Deploying daemon osd.10 on smithi163 2024-04-25T02:05:41.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:41 smithi174 ceph-mon[33171]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:41 smithi137 ceph-mon[28303]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:41.821 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:41 smithi163 ceph-mon[32577]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:43.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:43 smithi137 ceph-mon[28303]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:43.871 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:43 smithi163 ceph-mon[32577]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:43.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:43 smithi174 ceph-mon[33171]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:45 smithi163 ceph-mon[32577]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:45.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:45 smithi137 ceph-mon[28303]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:45.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:45.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:45 smithi174 ceph-mon[33171]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:47.476 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:47 smithi163 ceph-mon[32577]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:47.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:47 smithi137 ceph-mon[28303]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:47 smithi174 ceph-mon[33171]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:48.354 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 10 on host 'smithi163' 2024-04-25T02:05:48.355 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.348+0000 7f48667fc700 1 -- 172.21.15.163:0/2579125542 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4854000bf0 con 0x7f485c0a2c20 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 msgr2=0x7f485c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 0x7f485c0a50e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f486c003860 tx=0x7f486c005fb0 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 msgr2=0x7f4870197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f486000c9b0 tx=0x7f486000cd70 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 shutdown_connections 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f485c0a2c20 0x7f485c0a50e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48701024e0 0x7f487019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4870100940 0x7f48701973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 --2- 172.21.15.163:0/2579125542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4870101b40 0x7f4870197920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 >> 172.21.15.163:0/2579125542 conn(0x7f48700fbee0 msgr2=0x7f4870104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 shutdown_connections 2024-04-25T02:05:48.357 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-25T02:05:48.351+0000 7f487799a700 1 -- 172.21.15.163:0/2579125542 wait complete. 2024-04-25T02:05:48.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:48 smithi163 ceph-mon[32577]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:48 smithi174 ceph-mon[33171]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:49.005 DEBUG:teuthology.orchestra.run.smithi163:osd.10> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.10.service 2024-04-25T02:05:49.007 INFO:tasks.cephadm:Deploying osd.11 on smithi174 with /dev/vg_nvme/lv_1... 2024-04-25T02:05:49.007 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-25T02:05:49.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:49.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:49.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:05:49.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:48 smithi137 ceph-mon[28303]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:49.250 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:05:49.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:49 smithi174 ceph-mon[33171]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:49.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:49 smithi174 ceph-mon[33171]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:49.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:49 smithi163 ceph-mon[32577]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:49.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:49 smithi163 ceph-mon[32577]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:50.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:49 smithi137 ceph-mon[28303]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:50.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:49 smithi137 ceph-mon[28303]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:50.641 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:50 smithi174 ceph-mon[33171]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:50.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T02:05:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T02:05:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-mon[32577]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:50.892 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:05:50.561+0000 7f7ab78fb700 -1 osd.10 0 waiting for initial osdmap 2024-04-25T02:05:50.892 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:05:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:05:50.576+0000 7f7ab3eef700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:05:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-25T02:05:51.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: from='osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: osdmap e70: 11 total, 10 up, 11 in 2024-04-25T02:05:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-04-25T02:05:51.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:50 smithi137 ceph-mon[28303]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 894 GiB / 894 GiB avail 2024-04-25T02:05:51.357 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-25T02:05:51.358 INFO:teuthology.orchestra.run.smithi174.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-25T02:05:51.358 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10+0 records in 2024-04-25T02:05:51.358 INFO:teuthology.orchestra.run.smithi174.stderr:10+0 records out 2024-04-25T02:05:51.358 INFO:teuthology.orchestra.run.smithi174.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0201517 s, 520 MB/s 2024-04-25T02:05:51.358 INFO:teuthology.orchestra.run.smithi174.stderr:--> Zapping successful for: 2024-04-25T02:05:51.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:51 smithi174 ceph-mon[33171]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:05:51.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:51 smithi174 ceph-mon[33171]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T02:05:51.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:51 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:51.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:51 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:51.660 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:51 smithi174 ceph-mon[33171]: osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] boot 2024-04-25T02:05:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:51 smithi163 ceph-mon[32577]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:05:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:51 smithi163 ceph-mon[32577]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T02:05:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:51 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:51 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:51 smithi163 ceph-mon[32577]: osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] boot 2024-04-25T02:05:52.032 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi174:vg_nvme/lv_1 2024-04-25T02:05:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:51 smithi137 ceph-mon[28303]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-04-25T02:05:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:51 smithi137 ceph-mon[28303]: osdmap e71: 11 total, 10 up, 11 in 2024-04-25T02:05:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:51 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:51 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:51 smithi137 ceph-mon[28303]: osd.10 [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] boot 2024-04-25T02:05:52.276 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: osdmap e72: 11 total, 11 up, 11 in 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi163 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 4272M 2024-04-25T02:05:52.650 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:52.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:52.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T02:05:52.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:52 smithi174 ceph-mon[33171]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:05:52.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: osdmap e72: 11 total, 11 up, 11 in 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi163 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 4272M 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:52.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T02:05:52.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:52 smithi163 ceph-mon[32577]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: osdmap e72: 11 total, 11 up, 11 in 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi163 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:53.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 4272M 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: osdmap e73: 11 total, 11 up, 11 in 2024-04-25T02:05:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:52 smithi137 ceph-mon[28303]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:05:53.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 -- 172.21.15.174:0/2523881929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44108020 msgr2=0x7faf4410a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:53.903 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/2523881929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44108020 0x7faf4410a410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00b0a0 tx=0x7faf3c00b3b0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 -- 172.21.15.174:0/2523881929 shutdown_connections 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/2523881929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44108020 0x7faf4410a410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/2523881929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf44102dc0 0x7faf441051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/2523881929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf441056f0 0x7faf44107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.895+0000 7faf4b9aa700 1 -- 172.21.15.174:0/2523881929 >> 172.21.15.174:0/2523881929 conn(0x7faf440fc730 msgr2=0x7faf440feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- 172.21.15.174:0/2523881929 shutdown_connections 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- 172.21.15.174:0/2523881929 wait complete. 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 Processor -- start 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- start start 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf441056f0 0x7faf44196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:53.904 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf44108020 0x7faf441a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf4410e000 con 0x7faf441056f0 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7faf4410de80 con 0x7faf44108020 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf4b9aa700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faf4410e180 con 0x7faf44102dc0 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf49746700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf49746700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47344/0 (socket says 172.21.15.174:47344) 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.896+0000 7faf49746700 1 -- 172.21.15.174:0/1884311695 learned_addr learned my addr 172.21.15.174:0/1884311695 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49f47700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf44108020 0x7faf441a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 -- 172.21.15.174:0/1884311695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf44108020 msgr2=0x7faf441a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf44108020 0x7faf441a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 -- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf441056f0 msgr2=0x7faf44196660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf441056f0 0x7faf44196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 -- 172.21.15.174:0/1884311695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf441a6870 con 0x7faf44102dc0 2024-04-25T02:05:53.905 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf49746700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf3400b530 tx=0x7faf3400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:53.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34015020 con 0x7faf44102dc0 2024-04-25T02:05:53.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faf34011d30 con 0x7faf44102dc0 2024-04-25T02:05:53.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3400f2e0 con 0x7faf44102dc0 2024-04-25T02:05:53.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf441a6b00 con 0x7faf44102dc0 2024-04-25T02:05:53.906 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.897+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf441a6fc0 con 0x7faf44102dc0 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.898+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf44068f20 con 0x7faf44102dc0 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.899+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7faf34018020 con 0x7faf44102dc0 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.900+0000 7faf3a7fc700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 0x7faf300a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.900+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6723+0+0 (secure 0 0 0) 0x7faf340ce270 con 0x7faf44102dc0 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.901+0000 7faf48f45700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 0x7faf300a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:05:53.907 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.901+0000 7faf48f45700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 0x7faf300a50e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf44197850 tx=0x7faf40005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:05:53.910 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:53.904+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7faf3401f020 con 0x7faf44102dc0 2024-04-25T02:05:54.116 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:05:54.109+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faf44062670 con 0x7faf300a2c20 2024-04-25T02:05:54.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:54 smithi163 ceph-mon[32577]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T02:05:54.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:54.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:54.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:54.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:54 smithi174 ceph-mon[33171]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T02:05:54.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:54.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:54.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:54.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:54 smithi137 ceph-mon[28303]: osdmap e74: 11 total, 11 up, 11 in 2024-04-25T02:05:54.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T02:05:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T02:05:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:05:55.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:55 smithi163 ceph-mon[32577]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:55.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:55 smithi163 ceph-mon[32577]: pgmap v258: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:55.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:55 smithi163 ceph-mon[32577]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T02:05:55.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:55 smithi163 ceph-mon[32577]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-25T02:05:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:55 smithi174 ceph-mon[33171]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:55 smithi174 ceph-mon[33171]: pgmap v258: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:55 smithi174 ceph-mon[33171]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T02:05:55.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:55 smithi174 ceph-mon[33171]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-25T02:05:55.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:55 smithi137 ceph-mon[28303]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:05:55.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:55 smithi137 ceph-mon[28303]: pgmap v258: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:55.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:55 smithi137 ceph-mon[28303]: osdmap e75: 11 total, 11 up, 11 in 2024-04-25T02:05:55.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:55 smithi137 ceph-mon[28303]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-25T02:05:56.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:56 smithi163 ceph-mon[32577]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T02:05:56.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:56 smithi174 ceph-mon[33171]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T02:05:56.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:56 smithi137 ceph-mon[28303]: osdmap e76: 11 total, 11 up, 11 in 2024-04-25T02:05:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: pgmap v261: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/3614954392' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]': finished 2024-04-25T02:05:57.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: osdmap e77: 12 total, 11 up, 12 in 2024-04-25T02:05:57.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:57 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: pgmap v261: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/3614954392' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]': finished 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: osdmap e77: 12 total, 11 up, 12 in 2024-04-25T02:05:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:57 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:05:57.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: pgmap v261: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:57.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/3614954392' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]: dispatch 2024-04-25T02:05:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "64dcd982-78ef-4b76-9014-0a2b668457fb"}]': finished 2024-04-25T02:05:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: osdmap e77: 12 total, 11 up, 12 in 2024-04-25T02:05:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:57 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:05:58.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:58 smithi163 ceph-mon[32577]: from='client.? 172.21.15.174:0/2518049085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:58.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:58 smithi174 ceph-mon[33171]: from='client.? 172.21.15.174:0/2518049085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:58.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:58 smithi137 ceph-mon[28303]: from='client.? 172.21.15.174:0/2518049085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T02:05:59.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:05:59 smithi174 ceph-mon[33171]: pgmap v263: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:59.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:05:59 smithi137 ceph-mon[28303]: pgmap v263: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:05:59.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:05:59 smithi163 ceph-mon[32577]: pgmap v263: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-25T02:06:00.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:00 smithi137 ceph-mon[28303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-25T02:06:00.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:00 smithi137 ceph-mon[28303]: Cluster is now healthy 2024-04-25T02:06:00.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:00 smithi174 ceph-mon[33171]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-25T02:06:00.834 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:00 smithi174 ceph-mon[33171]: Cluster is now healthy 2024-04-25T02:06:00.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:00 smithi163 ceph-mon[32577]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-25T02:06:00.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:00 smithi163 ceph-mon[32577]: Cluster is now healthy 2024-04-25T02:06:01.525 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:01 smithi174 ceph-mon[33171]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:06:01.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:01 smithi137 ceph-mon[28303]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:06:01.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:01 smithi163 ceph-mon[32577]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-25T02:06:03.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:03 smithi174 ceph-mon[33171]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:06:03.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:03 smithi137 ceph-mon[28303]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:06:03.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:03 smithi163 ceph-mon[32577]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T02:06:05.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:05 smithi137 ceph-mon[28303]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T02:06:05.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T02:06:05.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:05 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:05.862 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:05 smithi174 ceph-mon[33171]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T02:06:05.863 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T02:06:05.863 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:05 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:05.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:05 smithi163 ceph-mon[32577]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-25T02:06:05.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-25T02:06:05.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:05 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:06.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:06 smithi174 ceph-mon[33171]: Deploying daemon osd.11 on smithi174 2024-04-25T02:06:06.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:06 smithi137 ceph-mon[28303]: Deploying daemon osd.11 on smithi174 2024-04-25T02:06:06.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:06 smithi163 ceph-mon[32577]: Deploying daemon osd.11 on smithi174 2024-04-25T02:06:07.759 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:07 smithi174 ceph-mon[33171]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:06:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:07 smithi137 ceph-mon[28303]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:06:07.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:07 smithi163 ceph-mon[32577]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-25T02:06:09.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:09 smithi174 ceph-mon[33171]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-25T02:06:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:09 smithi137 ceph-mon[28303]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-25T02:06:09.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:09 smithi163 ceph-mon[32577]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-04-25T02:06:11.602 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.602 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.602 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:11 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:11.603 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:11 smithi174 ceph-mon[33171]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T02:06:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:11 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:11.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:11 smithi163 ceph-mon[32577]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T02:06:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:11.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:11 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:11.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:11 smithi137 ceph-mon[28303]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-25T02:06:13.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:13 smithi174 ceph-mon[33171]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:13.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:13 smithi137 ceph-mon[28303]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:13.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:13 smithi163 ceph-mon[32577]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:14.100 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 11 on host 'smithi174' 2024-04-25T02:06:14.100 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.093+0000 7faf3a7fc700 1 -- 172.21.15.174:0/1884311695 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faf44062670 con 0x7faf300a2c20 2024-04-25T02:06:14.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 msgr2=0x7faf300a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 0x7faf300a50e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf44197850 tx=0x7faf40005c80 comp rx=0 tx=0).stop 2024-04-25T02:06:14.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 msgr2=0x7faf44196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:14.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf3400b530 tx=0x7faf3400b840 comp rx=0 tx=0).stop 2024-04-25T02:06:14.102 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 shutdown_connections 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7faf300a2c20 0x7faf300a50e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faf44108020 0x7faf441a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf44102dc0 0x7faf44196120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 --2- 172.21.15.174:0/1884311695 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf441056f0 0x7faf44196660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 >> 172.21.15.174:0/1884311695 conn(0x7faf440fc730 msgr2=0x7faf44102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 shutdown_connections 2024-04-25T02:06:14.103 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:14.096+0000 7faf4b9aa700 1 -- 172.21.15.174:0/1884311695 wait complete. 2024-04-25T02:06:14.725 DEBUG:teuthology.orchestra.run.smithi174:osd.11> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.11.service 2024-04-25T02:06:14.727 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-25T02:06:14.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T02:06:15.185 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:06:15.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:15.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.426 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:15.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:16.380 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:16 smithi137 ceph-mon[28303]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T02:06:16.380 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:16 smithi137 ceph-mon[28303]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:16.380 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:16 smithi137 ceph-mon[28303]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T02:06:16.380 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:16 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:16.380 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:16 smithi137 ceph-mon[28303]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:16.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:16 smithi163 ceph-mon[32577]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T02:06:16.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:16 smithi163 ceph-mon[32577]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:16.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:16 smithi163 ceph-mon[32577]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T02:06:16.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:16 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:16.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:16 smithi163 ceph-mon[32577]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:16.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-mon[33171]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-25T02:06:16.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-mon[33171]: from='osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:16.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-mon[33171]: osdmap e78: 12 total, 11 up, 12 in 2024-04-25T02:06:16.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:16.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-mon[33171]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]: dispatch 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: from='osd.11 ' entity='osd.11' 2024-04-25T02:06:17.107 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.107 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:06:16.895+0000 7f0f4418b700 -1 osd.11 0 waiting for initial osdmap 2024-04-25T02:06:17.108 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:06:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:06:16.916+0000 7f0f3c777700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:06:17.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.284+0000 7f657c800700 1 -- 172.21.15.137:0/663550915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574102d20 msgr2=0x7f6574105110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.284+0000 7f657c800700 1 --2- 172.21.15.137:0/663550915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574102d20 0x7f6574105110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6568009990 tx=0x7f6568009ca0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 -- 172.21.15.137:0/663550915 shutdown_connections 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 --2- 172.21.15.137:0/663550915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574107f80 0x7f657410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 --2- 172.21.15.137:0/663550915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574102d20 0x7f6574105110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 --2- 172.21.15.137:0/663550915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 0x7f6574107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 -- 172.21.15.137:0/663550915 >> 172.21.15.137:0/663550915 conn(0x7f65740fc730 msgr2=0x7f65740feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 -- 172.21.15.137:0/663550915 shutdown_connections 2024-04-25T02:06:17.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.285+0000 7f657c800700 1 -- 172.21.15.137:0/663550915 wait complete. 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 Processor -- start 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 -- start start 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 0x7f657419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 0x7f657419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 0x7f65741a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f657410dff0 con 0x7f6574105650 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f657410de70 con 0x7f6574102d20 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.286+0000 7f657c800700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f657410e170 con 0x7f6574107f80 2024-04-25T02:06:17.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f6579e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 0x7f657419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 0x7f65741a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f6579e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 0x7f657419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:36994/0 (socket says 172.21.15.137:36994) 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f6579e00700 1 -- 172.21.15.137:0/736392750 learned_addr learned my addr 172.21.15.137:0/736392750 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f6579400700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 0x7f657419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 -- 172.21.15.137:0/736392750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 msgr2=0x7f657419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 0x7f657419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 -- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 msgr2=0x7f657419ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 0x7f657419ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.287+0000 7f657a800700 1 -- 172.21.15.137:0/736392750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741a2470 con 0x7f6574107f80 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f657a800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 0x7f65741a1dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6570007f10 tx=0x7f657000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570004db0 con 0x7f6574107f80 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6570003a00 con 0x7f6574107f80 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65700046c0 con 0x7f6574107f80 2024-04-25T02:06:17.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65741a2760 con 0x7f6574107f80 2024-04-25T02:06:17.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.288+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741a2ca0 con 0x7f6574107f80 2024-04-25T02:06:17.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.290+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6574068f20 con 0x7f6574107f80 2024-04-25T02:06:17.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.291+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f657001c020 con 0x7f6574107f80 2024-04-25T02:06:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.292+0000 7f656ea00700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 0x7f655c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.292+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f65700ce1f0 con 0x7f6574107f80 2024-04-25T02:06:17.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.292+0000 7f6579e00700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 0x7f655c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:17.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.293+0000 7f6579e00700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 0x7f655c0a5160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6568006010 tx=0x7f656800b910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:17.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.296+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6570010070 con 0x7f6574107f80 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: from='osd.11 ' entity='osd.11' 2024-04-25T02:06:17.386 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-04-25T02:06:17.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: osdmap e79: 12 total, 11 up, 12 in 2024-04-25T02:06:17.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-04-25T02:06:17.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: from='osd.11 ' entity='osd.11' 2024-04-25T02:06:17.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:17.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.535+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6574062e40 con 0x7f6574107f80 2024-04-25T02:06:17.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.536+0000 7f656ea00700 1 -- 172.21.15.137:0/736392750 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f657009b670 con 0x7f6574107f80 2024-04-25T02:06:17.543 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 msgr2=0x7f655c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 0x7f655c0a5160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6568006010 tx=0x7f656800b910 comp rx=0 tx=0).stop 2024-04-25T02:06:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 msgr2=0x7f65741a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 0x7f65741a1dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6570007f10 tx=0x7f657000d3b0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 shutdown_connections 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f655c0a2ca0 0x7f655c0a5160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6574102d20 0x7f657419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6574107f80 0x7f65741a1dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 --2- 172.21.15.137:0/736392750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6574105650 0x7f657419ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 >> 172.21.15.137:0/736392750 conn(0x7f65740fc730 msgr2=0x7f65741023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 shutdown_connections 2024-04-25T02:06:17.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:17.539+0000 7f657c800700 1 -- 172.21.15.137:0/736392750 wait complete. 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: purged_snaps scrub starts 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: purged_snaps scrub ok 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/736392750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] boot 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T02:06:18.313 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: purged_snaps scrub starts 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: purged_snaps scrub ok 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/736392750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] boot 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T02:06:18.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: purged_snaps scrub starts 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: purged_snaps scrub ok 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/736392750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: osd.11 [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] boot 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: osdmap e80: 12 total, 12 up, 12 in 2024-04-25T02:06:18.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:06:18.408 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1714010751,"num_in_osds":12,"osd_in_since":1714010756,"num_remapped_pgs":0} 2024-04-25T02:06:19.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: Detected new or changed devices on smithi174 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 4272M 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:19 smithi163 ceph-mon[32577]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: Detected new or changed devices on smithi174 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 4272M 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:19 smithi174 ceph-mon[33171]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T02:06:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: Detected new or changed devices on smithi174 2024-04-25T02:06:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 4272M 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:19.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:19.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:19 smithi137 ceph-mon[28303]: osdmap e81: 12 total, 12 up, 12 in 2024-04-25T02:06:19.849 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:06:21.472 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:21 smithi137 ceph-mon[28303]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:21.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:21 smithi163 ceph-mon[32577]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:21 smithi174 ceph-mon[33171]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 -- 172.21.15.137:0/4069701603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4105640 msgr2=0x7f81f4107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 --2- 172.21.15.137:0/4069701603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4105640 0x7f81f4107a30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f81e00098f0 tx=0x7f81e0009c00 comp rx=0 tx=0).stop 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 -- 172.21.15.137:0/4069701603 shutdown_connections 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 --2- 172.21.15.137:0/4069701603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4107f70 0x7f81f410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 --2- 172.21.15.137:0/4069701603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 --2- 172.21.15.137:0/4069701603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4105640 0x7f81f4107a30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 -- 172.21.15.137:0/4069701603 >> 172.21.15.137:0/4069701603 conn(0x7f81f40fc720 msgr2=0x7f81f40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.936+0000 7f81fa400700 1 -- 172.21.15.137:0/4069701603 shutdown_connections 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.937+0000 7f81fa400700 1 -- 172.21.15.137:0/4069701603 wait complete. 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 Processor -- start 2024-04-25T02:06:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 -- start start 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 0x7f81f4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 0x7f81f419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410dfe0 con 0x7f81f4102d10 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410de60 con 0x7f81f4107f70 2024-04-25T02:06:21.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81fa400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410e160 con 0x7f81f4105640 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.938+0000 7f81f3400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f3400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56604/0 (socket says 172.21.15.137:56604) 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f3400700 1 -- 172.21.15.137:0/1515355178 learned_addr learned my addr 172.21.15.137:0/1515355178 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 0x7f81f4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f3e00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 0x7f81f419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 -- 172.21.15.137:0/1515355178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 msgr2=0x7f81f419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 0x7f81f419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 -- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 msgr2=0x7f81f4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 -- 172.21.15.137:0/1515355178 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41a0230 con 0x7f81f4105640 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f3e00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 0x7f81f419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f3400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.939+0000 7f81f2a00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 0x7f81f4198b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009230 tx=0x7f81e0005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.940+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e000fa30 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.940+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41a04c0 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.940+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81e00055f0 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.940+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0017400 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.940+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41a0910 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.941+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f4068f20 con 0x7f81f4105640 2024-04-25T02:06:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.943+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f81e0003680 con 0x7f81f4105640 2024-04-25T02:06:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.944+0000 7f81ebe00700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 0x7f81d80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.944+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f81e00cf690 con 0x7f81f4105640 2024-04-25T02:06:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.944+0000 7f81f3400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 0x7f81d80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:21.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.945+0000 7f81f3400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 0x7f81d80a50e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81e4005950 tx=0x7f81e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:21.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:21.947+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f81e0013030 con 0x7f81f4105640 2024-04-25T02:06:22.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.169+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f81f4062e40 con 0x7f81f4105640 2024-04-25T02:06:22.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.170+0000 7f81ebe00700 1 -- 172.21.15.137:0/1515355178 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f81e009ca80 con 0x7f81f4105640 2024-04-25T02:06:22.177 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.173+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 msgr2=0x7f81d80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.173+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 0x7f81d80a50e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81e4005950 tx=0x7f81e4009310 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.173+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 msgr2=0x7f81f4198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.173+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 0x7f81f4198b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009230 tx=0x7f81e0005270 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 shutdown_connections 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f81d80a2c20 0x7f81d80a50e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f81f4107f70 0x7f81f419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f4102d10 0x7f81f4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 --2- 172.21.15.137:0/1515355178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4105640 0x7f81f4198b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 >> 172.21.15.137:0/1515355178 conn(0x7f81f40fc720 msgr2=0x7f81f4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 shutdown_connections 2024-04-25T02:06:22.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:22.174+0000 7f81fa400700 1 -- 172.21.15.137:0/1515355178 wait complete. 2024-04-25T02:06:22.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:22 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1515355178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:22.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:22 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1515355178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:22 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1515355178' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T02:06:23.021 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1714010777,"num_in_osds":12,"osd_in_since":1714010756,"num_remapped_pgs":0} 2024-04-25T02:06:23.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:06:23.459 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:06:23.624 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:23 smithi137 ceph-mon[28303]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:23.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:23 smithi163 ceph-mon[32577]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:23.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:23 smithi174 ceph-mon[33171]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:25.495 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:25 smithi137 ceph-mon[28303]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:25.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:25 smithi163 ceph-mon[32577]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 -- 172.21.15.137:0/768654385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104430 msgr2=0x7f17fc1048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 --2- 172.21.15.137:0/768654385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104430 0x7f17fc1048b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009990 tx=0x7f17e8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 -- 172.21.15.137:0/768654385 shutdown_connections 2024-04-25T02:06:25.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 --2- 172.21.15.137:0/768654385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc10a4c0 0x7f17fc10a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 --2- 172.21.15.137:0/768654385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc104df0 0x7f17fc111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 --2- 172.21.15.137:0/768654385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104430 0x7f17fc1048b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 -- 172.21.15.137:0/768654385 >> 172.21.15.137:0/768654385 conn(0x7f17fc0fff40 msgr2=0x7f17fc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 -- 172.21.15.137:0/768654385 shutdown_connections 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.655+0000 7f1802600700 1 -- 172.21.15.137:0/768654385 wait complete. 2024-04-25T02:06:25.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.656+0000 7f1802600700 1 Processor -- start 2024-04-25T02:06:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 -- start start 2024-04-25T02:06:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc104430 0x7f17fc1a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:25.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc10a4c0 0x7f17fc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc1148e0 con 0x7f17fc104df0 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc114760 con 0x7f17fc104430 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f1802600700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc114a60 con 0x7f17fc10a4c0 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f17faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f17faa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56632/0 (socket says 172.21.15.137:56632) 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f17faa00700 1 -- 172.21.15.137:0/1553359687 learned_addr learned my addr 172.21.15.137:0/1553359687 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f17fbe00700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc10a4c0 0x7f17fc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.657+0000 7f17fb400700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc104430 0x7f17fc1a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 -- 172.21.15.137:0/1553359687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc10a4c0 msgr2=0x7f17fc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc10a4c0 0x7f17fc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 -- 172.21.15.137:0/1553359687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc104430 msgr2=0x7f17fc1a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc104430 0x7f17fc1a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 -- 172.21.15.137:0/1553359687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc19b400 con 0x7f17fc104df0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17faa00700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.658+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8027070 con 0x7f17fc104df0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.659+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e800fdc0 con 0x7f17fc104df0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.659+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc19b690 con 0x7f17fc104df0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.659+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80173f0 con 0x7f17fc104df0 2024-04-25T02:06:25.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.659+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc1a79d0 con 0x7f17fc104df0 2024-04-25T02:06:25.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.660+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc19b9f0 con 0x7f17fc104df0 2024-04-25T02:06:25.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.662+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f17e802a070 con 0x7f17fc104df0 2024-04-25T02:06:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.663+0000 7f17f3e00700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 0x7f17e00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.663+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f17e80cf800 con 0x7f17fc104df0 2024-04-25T02:06:25.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.663+0000 7f17fb400700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 0x7f17e00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:25.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.664+0000 7f17fb400700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 0x7f17e00a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009be0 tx=0x7f17ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:25.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.668+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f17e8013070 con 0x7f17fc104df0 2024-04-25T02:06:25.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:25 smithi174 ceph-mon[33171]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:25.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.895+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17fc19bfe0 con 0x7f17fc104df0 2024-04-25T02:06:25.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.896+0000 7f17f3e00700 1 -- 172.21.15.137:0/1553359687 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18539 (secure 0 0 0) 0x7f17e809cbf0 con 0x7f17fc104df0 2024-04-25T02:06:25.903 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:25.903 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:06:19.116617+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 msgr2=0x7f17e00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 0x7f17e00a5160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009be0 tx=0x7f17ec009260 comp rx=0 tx=0).stop 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 msgr2=0x7f17fc1a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17e8000c00 tx=0x7f17e8005590 comp rx=0 tx=0).stop 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 shutdown_connections 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f17e00a2ca0 0x7f17e00a5160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17fc104430 0x7f17fc1a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17fc10a4c0 0x7f17fc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 --2- 172.21.15.137:0/1553359687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17fc104df0 0x7f17fc1a0f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 >> 172.21.15.137:0/1553359687 conn(0x7f17fc0fff40 msgr2=0x7f17fc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 shutdown_connections 2024-04-25T02:06:25.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:25.900+0000 7f1802600700 1 -- 172.21.15.137:0/1553359687 wait complete. 2024-04-25T02:06:26.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:26 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1553359687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:26.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:26 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1553359687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:26.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:26 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1553359687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:26.691 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:06:26.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T02:06:27.141 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:06:27.549 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:27 smithi137 ceph-mon[28303]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:27 smithi163 ceph-mon[32577]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:27.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:27 smithi174 ceph-mon[33171]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 -- 172.21.15.137:0/4117625706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8102e90 msgr2=0x7f7dd8106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 --2- 172.21.15.137:0/4117625706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8102e90 0x7f7dd8106e90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009990 tx=0x7f7dc4009ca0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 -- 172.21.15.137:0/4117625706 shutdown_connections 2024-04-25T02:06:29.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 --2- 172.21.15.137:0/4117625706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8107570 0x7f7dd810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 --2- 172.21.15.137:0/4117625706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd81028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 --2- 172.21.15.137:0/4117625706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8102e90 0x7f7dd8106e90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 -- 172.21.15.137:0/4117625706 >> 172.21.15.137:0/4117625706 conn(0x7f7dd8079390 msgr2=0x7f7dd80797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 -- 172.21.15.137:0/4117625706 shutdown_connections 2024-04-25T02:06:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.205+0000 7f7de0000700 1 -- 172.21.15.137:0/4117625706 wait complete. 2024-04-25T02:06:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.206+0000 7f7de0000700 1 Processor -- start 2024-04-25T02:06:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.206+0000 7f7de0000700 1 -- start start 2024-04-25T02:06:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8102e90 0x7f7dd8074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8107570 0x7f7dd8074fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8112700 con 0x7f7dd8102e90 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8112580 con 0x7f7dd8107570 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7de0000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8112880 con 0x7f7dd81024e0 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddcc00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8102e90 0x7f7dd8074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:60756/0 (socket says 172.21.15.137:60756) 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 -- 172.21.15.137:0/367211138 learned_addr learned my addr 172.21.15.137:0/367211138 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7dde000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8107570 0x7f7dd8074fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 -- 172.21.15.137:0/367211138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8107570 msgr2=0x7f7dd8074fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8107570 0x7f7dd8074fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 -- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8102e90 msgr2=0x7f7dd8074a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8102e90 0x7f7dd8074a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.207+0000 7f7ddd600700 1 -- 172.21.15.137:0/367211138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd81a7070 con 0x7f7dd81024e0 2024-04-25T02:06:29.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7ddd600700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e9c0 tx=0x7f7dcc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00cbd0 con 0x7f7dd81024e0 2024-04-25T02:06:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd81a7360 con 0x7f7dd81024e0 2024-04-25T02:06:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7dcc00ee60 con 0x7f7dd81024e0 2024-04-25T02:06:29.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc010430 con 0x7f7dd81024e0 2024-04-25T02:06:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.208+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd81a7870 con 0x7f7dd81024e0 2024-04-25T02:06:29.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.209+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd810a790 con 0x7f7dd81024e0 2024-04-25T02:06:29.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.211+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7dcc044b30 con 0x7f7dd81024e0 2024-04-25T02:06:29.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.213+0000 7f7dd6000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 0x7f7dc00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:29.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.213+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7dcc0ceec0 con 0x7f7dd81024e0 2024-04-25T02:06:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.213+0000 7f7ddcc00700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 0x7f7dc00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.214+0000 7f7ddcc00700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 0x7f7dc00a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8075f70 tx=0x7f7dc400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:29.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.215+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7dcc044e20 con 0x7f7dd81024e0 2024-04-25T02:06:29.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.441+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7dd8068f20 con 0x7f7dd81024e0 2024-04-25T02:06:29.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.442+0000 7f7dd6000700 1 -- 172.21.15.137:0/367211138 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f7dcc09c220 con 0x7f7dd81024e0 2024-04-25T02:06:29.448 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 msgr2=0x7f7dc00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 0x7f7dc00a50e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8075f70 tx=0x7f7dc400b260 comp rx=0 tx=0).stop 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 msgr2=0x7f7dd8074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e9c0 tx=0x7f7dcc00ecd0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 shutdown_connections 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7dc00a2c20 0x7f7dc00a50e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7dd8107570 0x7f7dd8074fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7dd81024e0 0x7f7dd8074530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 --2- 172.21.15.137:0/367211138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dd8102e90 0x7f7dd8074a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:29.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 >> 172.21.15.137:0/367211138 conn(0x7f7dd8079390 msgr2=0x7f7dd81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:29.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 shutdown_connections 2024-04-25T02:06:29.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:29.445+0000 7f7de0000700 1 -- 172.21.15.137:0/367211138 wait complete. 2024-04-25T02:06:29.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:29 smithi174 ceph-mon[33171]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:29.778 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:29 smithi137 ceph-mon[28303]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:29.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:29 smithi163 ceph-mon[32577]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:30.175 INFO:tasks.cephadm:Adding mds.a on smithi137 2024-04-25T02:06:30.175 INFO:tasks.cephadm:Adding mds.d on smithi137 2024-04-25T02:06:30.175 INFO:tasks.cephadm:Adding mds.g on smithi137 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.j on smithi137 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.b on smithi163 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.e on smithi163 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.h on smithi163 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.k on smithi163 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.c on smithi174 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.f on smithi174 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.i on smithi174 2024-04-25T02:06:30.176 INFO:tasks.cephadm:Adding mds.l on smithi174 2024-04-25T02:06:30.176 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l' 2024-04-25T02:06:30.426 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:06:30.548 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:30 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/367211138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:30.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:30 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/367211138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:30.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:30 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/367211138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:31.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:31 smithi174 ceph-mon[33171]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:31.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:31 smithi137 ceph-mon[28303]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:31.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:31 smithi163 ceph-mon[32577]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:32.067 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3447459711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41011a0 msgr2=0x7f5ac41015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.067 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3447459711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41011a0 0x7f5ac41015c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009990 tx=0x7f5ab8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3447459711 shutdown_connections 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3447459711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac4102d40 0x7f5ac41095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3447459711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac41011a0 0x7f5ac41015c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3447459711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac41023a0 0x7f5ac4102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3447459711 >> 172.21.15.174:0/3447459711 conn(0x7f5ac40fc760 msgr2=0x7f5ac40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3447459711 shutdown_connections 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.059+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3447459711 wait complete. 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 Processor -- start 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 -- start start 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac41011a0 0x7f5ac4105130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 0x7f5ac4103780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:32.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410cfa0 con 0x7f5ac41011a0 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410ce20 con 0x7f5ac41023a0 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5acaf8d700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410d120 con 0x7f5ac4102d40 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:39914/0 (socket says 172.21.15.174:39914) 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 -- 172.21.15.174:0/3044563101 learned_addr learned my addr 172.21.15.174:0/3044563101 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac3fff700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 0x7f5ac4103780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 -- 172.21.15.174:0/3044563101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 msgr2=0x7f5ac4103780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 0x7f5ac4103780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 -- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac41011a0 msgr2=0x7f5ac4105130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac41011a0 0x7f5ac4105130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac952a700 1 -- 172.21.15.174:0/3044563101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4104570 con 0x7f5ac4102d40 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.060+0000 7f5ac3fff700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 0x7f5ac4103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:32.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5ac952a700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00b970 tx=0x7f5abc00bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc019070 con 0x7f5ac4102d40 2024-04-25T02:06:32.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5abc014440 con 0x7f5ac4102d40 2024-04-25T02:06:32.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac41a27e0 con 0x7f5ac4102d40 2024-04-25T02:06:32.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0075d0 con 0x7f5ac4102d40 2024-04-25T02:06:32.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.061+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41a2d70 con 0x7f5ac4102d40 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.062+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4068f20 con 0x7f5ac4102d40 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.063+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5abc01c070 con 0x7f5ac4102d40 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.063+0000 7f5ac1ffb700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 0x7f5ab40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.064+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5abc0cdfd0 con 0x7f5ac4102d40 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.064+0000 7f5ac8d29700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 0x7f5ab40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:32.071 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.065+0000 7f5ac8d29700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 0x7f5ab40a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005f50 tx=0x7f5ab8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:32.074 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.068+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5abc09b3d0 con 0x7f5ac4102d40 2024-04-25T02:06:32.281 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.275+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}) -- 0x7f5ac40fe870 con 0x7f5ab40a2c20 2024-04-25T02:06:32.298 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.291+0000 7f5ac1ffb700 1 -- 172.21.15.174:0/3044563101 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5ac40fe870 con 0x7f5ab40a2c20 2024-04-25T02:06:32.298 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mds.all update... 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 msgr2=0x7f5ab40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 0x7f5ab40a50e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005f50 tx=0x7f5ab8005e80 comp rx=0 tx=0).stop 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 msgr2=0x7f5ac4103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00b970 tx=0x7f5abc00bd30 comp rx=0 tx=0).stop 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 shutdown_connections 2024-04-25T02:06:32.300 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5ab40a2c20 0x7f5ab40a50e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ac4102d40 0x7f5ac4103cc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ac41011a0 0x7f5ac4105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 --2- 172.21.15.174:0/3044563101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ac41023a0 0x7f5ac4103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 >> 172.21.15.174:0/3044563101 conn(0x7f5ac40fc760 msgr2=0x7f5ac40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 shutdown_connections 2024-04-25T02:06:32.301 INFO:teuthology.orchestra.run.smithi174.stderr:2024-04-25T02:06:32.294+0000 7f5acaf8d700 1 -- 172.21.15.174:0/3044563101 wait complete. 2024-04-25T02:06:33.004 DEBUG:teuthology.orchestra.run.smithi137:mds.a> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.a.service 2024-04-25T02:06:33.010 DEBUG:teuthology.orchestra.run.smithi137:mds.d> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.d.service 2024-04-25T02:06:33.055 DEBUG:teuthology.orchestra.run.smithi137:mds.g> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.g.service 2024-04-25T02:06:33.103 DEBUG:teuthology.orchestra.run.smithi137:mds.j> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.j.service 2024-04-25T02:06:33.147 DEBUG:teuthology.orchestra.run.smithi163:mds.b> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.b.service 2024-04-25T02:06:33.150 DEBUG:teuthology.orchestra.run.smithi163:mds.e> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.e.service 2024-04-25T02:06:33.194 DEBUG:teuthology.orchestra.run.smithi163:mds.h> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.h.service 2024-04-25T02:06:33.237 DEBUG:teuthology.orchestra.run.smithi163:mds.k> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.k.service 2024-04-25T02:06:33.280 DEBUG:teuthology.orchestra.run.smithi174:mds.c> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.c.service 2024-04-25T02:06:33.282 DEBUG:teuthology.orchestra.run.smithi174:mds.f> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.f.service 2024-04-25T02:06:33.325 DEBUG:teuthology.orchestra.run.smithi174:mds.i> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.i.service 2024-04-25T02:06:33.368 DEBUG:teuthology.orchestra.run.smithi174:mds.l> sudo journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.l.service 2024-04-25T02:06:33.411 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-25T02:06:33.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:06:33.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:33 smithi137 ceph-mon[28303]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:33.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:33 smithi137 ceph-mon[28303]: Saving service mds.all spec with placement smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-04-25T02:06:33.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:33.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:33 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:33.484 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:33 smithi137 ceph-mon[28303]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:33.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:33 smithi174 ceph-mon[33171]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:33.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:33 smithi174 ceph-mon[33171]: Saving service mds.all spec with placement smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-04-25T02:06:33.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:33.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:33 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:33.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:33 smithi174 ceph-mon[33171]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.620+0000 7f887e200640 1 -- 172.21.15.137:0/4122959043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8878109670 msgr2=0x7f887810bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.620+0000 7f887e200640 1 --2- 172.21.15.137:0/4122959043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8878109670 0x7f887810bb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8870009be0 tx=0x7f887002a6c0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 -- 172.21.15.137:0/4122959043 shutdown_connections 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 --2- 172.21.15.137:0/4122959043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8878109670 0x7f887810bb00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 --2- 172.21.15.137:0/4122959043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88780741a0 0x7f8878074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 --2- 172.21.15.137:0/4122959043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 0x7f8878073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 -- 172.21.15.137:0/4122959043 >> 172.21.15.137:0/4122959043 conn(0x7f88780fcd20 msgr2=0x7f88780ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 -- 172.21.15.137:0/4122959043 shutdown_connections 2024-04-25T02:06:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.621+0000 7f887e200640 1 -- 172.21.15.137:0/4122959043 wait complete. 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.622+0000 7f887e200640 1 Processor -- start 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.622+0000 7f887e200640 1 -- start start 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.622+0000 7f887e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 0x7f8878199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.622+0000 7f887e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 0x7f887819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f887e200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f887e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f887810f750 con 0x7f8878075780 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f887e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f887810f5d0 con 0x7f88780741a0 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f887e200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f887810f8d0 con 0x7f8878109670 2024-04-25T02:06:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f886fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 0x7f887819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 0x7f8878199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:53484/0 (socket says 172.21.15.137:53484) 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 -- 172.21.15.137:0/4280484028 learned_addr learned my addr 172.21.15.137:0/4280484028 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 -- 172.21.15.137:0/4280484028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 msgr2=0x7f8878199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 0x7f8878199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 -- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 msgr2=0x7f887819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 0x7f887819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877e00640 1 -- 172.21.15.137:0/4280484028 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88781a1940 con 0x7f8878109670 2024-04-25T02:06:33.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.623+0000 7f8877400640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 0x7f8878199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f8877e00640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8870004af0 tx=0x7f88700305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870041020 con 0x7f8878109670 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88781a1bd0 con 0x7f8878109670 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8870031440 con 0x7f8878109670 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870036040 con 0x7f8878109670 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.624+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88781a20c0 con 0x7f8878109670 2024-04-25T02:06:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.625+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88781083a0 con 0x7f8878109670 2024-04-25T02:06:33.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.627+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8870044020 con 0x7f8878109670 2024-04-25T02:06:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.628+0000 7f8874c00640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 0x7f885c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.628+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f88700ef8c0 con 0x7f8878109670 2024-04-25T02:06:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.628+0000 7f8877400640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 0x7f885c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.629+0000 7f8877400640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 0x7f885c0a5050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f887819b200 tx=0x7f8868009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:33.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.632+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f887004b020 con 0x7f8878109670 2024-04-25T02:06:33.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:33 smithi163 ceph-mon[32577]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:06:33.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:33 smithi163 ceph-mon[32577]: Saving service mds.all spec with placement smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-04-25T02:06:33.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:33 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:33.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:33 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:06:33.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:33 smithi163 ceph-mon[32577]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:33.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.825+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8878062340 con 0x7f8878109670 2024-04-25T02:06:33.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.826+0000 7f8874c00640 1 -- 172.21.15.137:0/4280484028 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18539 (secure 0 0 0) 0x7f88700bcc20 con 0x7f8878109670 2024-04-25T02:06:33.833 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:33.833 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:06:19.116617+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:06:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 msgr2=0x7f885c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 0x7f885c0a5050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f887819b200 tx=0x7f8868009260 comp rx=0 tx=0).stop 2024-04-25T02:06:33.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 msgr2=0x7f88781a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8870004af0 tx=0x7f88700305d0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 shutdown_connections 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f885c0a2b90 0x7f885c0a5050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8878109670 0x7f88781a12a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8878075780 0x7f887819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 --2- 172.21.15.137:0/4280484028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88780741a0 0x7f8878199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.829+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 >> 172.21.15.137:0/4280484028 conn(0x7f88780fcd20 msgr2=0x7f8878105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.830+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 shutdown_connections 2024-04-25T02:06:33.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:33.830+0000 7f887e200640 1 -- 172.21.15.137:0/4280484028 wait complete. 2024-04-25T02:06:33.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:06:33.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.041+0000 7feb31400640 1 -- 172.21.15.137:0/1638033039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c101670 msgr2=0x7feb2c101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.041+0000 7feb31400640 1 --2- 172.21.15.137:0/1638033039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c101670 0x7feb2c101a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009900 tx=0x7feb1c02a410 comp rx=0 tx=0).stop 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 -- 172.21.15.137:0/1638033039 shutdown_connections 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 --2- 172.21.15.137:0/1638033039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c103220 0x7feb2c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 --2- 172.21.15.137:0/1638033039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 0x7feb2c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 --2- 172.21.15.137:0/1638033039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c101670 0x7feb2c101a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 -- 172.21.15.137:0/1638033039 >> 172.21.15.137:0/1638033039 conn(0x7feb2c0fcbe0 msgr2=0x7feb2c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 -- 172.21.15.137:0/1638033039 shutdown_connections 2024-04-25T02:06:34.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.042+0000 7feb31400640 1 -- 172.21.15.137:0/1638033039 wait complete. 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 Processor -- start 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 -- start start 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 0x7feb2c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 0x7feb2c074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c10d420 con 0x7feb2c102860 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c10d2a0 con 0x7feb2c103220 2024-04-25T02:06:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb31400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c10d5a0 con 0x7feb2c101670 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb2be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb2be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:53500/0 (socket says 172.21.15.137:53500) 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.043+0000 7feb2be00640 1 -- 172.21.15.137:0/4102697026 learned_addr learned my addr 172.21.15.137:0/4102697026 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2b400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 0x7feb2c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb30a00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 0x7feb2c074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 -- 172.21.15.137:0/4102697026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 msgr2=0x7feb2c074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 0x7feb2c074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 -- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 msgr2=0x7feb2c073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 0x7feb2c073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 -- 172.21.15.137:0/4102697026 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c074900 con 0x7feb2c101670 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb30a00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 0x7feb2c074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb2be00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb1c006010 tx=0x7feb1c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c03f030 con 0x7feb2c101670 2024-04-25T02:06:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb1c003d00 con 0x7feb2c101670 2024-04-25T02:06:34.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c035070 con 0x7feb2c101670 2024-04-25T02:06:34.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.044+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c1a1b80 con 0x7feb2c101670 2024-04-25T02:06:34.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.045+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1a2080 con 0x7feb2c101670 2024-04-25T02:06:34.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.046+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c108930 con 0x7feb2c101670 2024-04-25T02:06:34.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.048+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feb1c042030 con 0x7feb2c101670 2024-04-25T02:06:34.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.049+0000 7feb28c00640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 0x7feb100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.049+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feb1c0ef190 con 0x7feb2c101670 2024-04-25T02:06:34.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.050+0000 7feb2b400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 0x7feb100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.051+0000 7feb2b400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 0x7feb100a50d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb2c075260 tx=0x7feb18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.053+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7feb1c0bc4f0 con 0x7feb2c101670 2024-04-25T02:06:34.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.251+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feb2c062340 con 0x7feb2c101670 2024-04-25T02:06:34.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.252+0000 7feb28c00640 1 -- 172.21.15.137:0/4102697026 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7feb1c0bbdf0 con 0x7feb2c101670 2024-04-25T02:06:34.258 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:06:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 msgr2=0x7feb100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 0x7feb100a50d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb2c075260 tx=0x7feb18005f90 comp rx=0 tx=0).stop 2024-04-25T02:06:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 msgr2=0x7feb2c0754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb1c006010 tx=0x7feb1c0042f0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 shutdown_connections 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feb100a2c10 0x7feb100a50d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb2c103220 0x7feb2c074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feb2c102860 0x7feb2c073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 --2- 172.21.15.137:0/4102697026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feb2c101670 0x7feb2c0754f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 >> 172.21.15.137:0/4102697026 conn(0x7feb2c0fcbe0 msgr2=0x7feb2c105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 shutdown_connections 2024-04-25T02:06:34.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.255+0000 7feb31400640 1 -- 172.21.15.137:0/4102697026 wait complete. 2024-04-25T02:06:34.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:34.353 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: Deploying daemon mds.l on smithi174 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4280484028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:34.354 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4102697026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:34.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 -- 172.21.15.137:0/1887936382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8108f90 msgr2=0x7f20f8109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 --2- 172.21.15.137:0/1887936382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8108f90 0x7f20f8109410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009900 tx=0x7f20e402a410 comp rx=0 tx=0).stop 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 -- 172.21.15.137:0/1887936382 shutdown_connections 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 --2- 172.21.15.137:0/1887936382 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 0x7f20f81101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 --2- 172.21.15.137:0/1887936382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8108f90 0x7f20f8109410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 --2- 172.21.15.137:0/1887936382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8107da0 0x7f20f81081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 -- 172.21.15.137:0/1887936382 >> 172.21.15.137:0/1887936382 conn(0x7f20f8076d60 msgr2=0x7f20f8079180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 -- 172.21.15.137:0/1887936382 shutdown_connections 2024-04-25T02:06:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.454+0000 7f20fda00640 1 -- 172.21.15.137:0/1887936382 wait complete. 2024-04-25T02:06:34.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.455+0000 7f20fda00640 1 Processor -- start 2024-04-25T02:06:34.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.455+0000 7f20fda00640 1 -- start start 2024-04-25T02:06:34.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8108f90 0x7f20f819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 0x7f20f81a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8113b90 con 0x7f20f8107da0 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8113a10 con 0x7f20f8109950 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20fda00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8113d10 con 0x7f20f8108f90 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39874/0 (socket says 172.21.15.137:39874) 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 -- 172.21.15.137:0/820266055 learned_addr learned my addr 172.21.15.137:0/820266055 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f7400640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 0x7f20f81a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6000640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8108f90 0x7f20f819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 -- 172.21.15.137:0/820266055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8108f90 msgr2=0x7f20f819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8108f90 0x7f20f819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 -- 172.21.15.137:0/820266055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 msgr2=0x7f20f81a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 0x7f20f81a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.456+0000 7f20f6a00640 1 -- 172.21.15.137:0/820266055 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f81a5da0 con 0x7f20f8107da0 2024-04-25T02:06:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20f6a00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20e800e9c0 tx=0x7f20e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e800cd80 con 0x7f20f8107da0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f81a6090 con 0x7f20f8107da0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20e80035f0 con 0x7f20f8107da0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8010690 con 0x7f20f8107da0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.457+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a65b0 con 0x7f20f8107da0 2024-04-25T02:06:34.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.458+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f810f060 con 0x7f20f8107da0 2024-04-25T02:06:34.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.460+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20e80037a0 con 0x7f20f8107da0 2024-04-25T02:06:34.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.461+0000 7f20ef400640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 0x7f20dc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:34.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.461+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f20e80ceff0 con 0x7f20f8107da0 2024-04-25T02:06:34.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.462+0000 7f20f6000640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 0x7f20dc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.462+0000 7f20f6000640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 0x7f20dc0a5050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20e4005ab0 tx=0x7f20e4005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:34.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.466+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f20e809c390 con 0x7f20f8107da0 2024-04-25T02:06:34.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: Deploying daemon mds.l on smithi174 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4280484028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:34.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4102697026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: Deploying daemon mds.l on smithi174 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4280484028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:06:34.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4102697026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:06:34.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.699+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f802d170 con 0x7f20f8107da0 2024-04-25T02:06:34.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.700+0000 7f20ef400640 1 -- 172.21.15.137:0/820266055 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f20e809bc90 con 0x7f20f8107da0 2024-04-25T02:06:34.706 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:34.706 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T02:06:34.706 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 1 2024-04-25T02:06:34.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 msgr2=0x7f20dc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 0x7f20dc0a5050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20e4005ab0 tx=0x7f20e4005a20 comp rx=0 tx=0).stop 2024-04-25T02:06:34.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 msgr2=0x7f20f819e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:34.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20e800e9c0 tx=0x7f20e800ee80 comp rx=0 tx=0).stop 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 shutdown_connections 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f20dc0a2b90 0x7f20dc0a5050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20f8109950 0x7f20f81a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f20f8108f90 0x7f20f819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 --2- 172.21.15.137:0/820266055 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f8107da0 0x7f20f819e180 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 >> 172.21.15.137:0/820266055 conn(0x7f20f8076d60 msgr2=0x7f20f810c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.702+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 shutdown_connections 2024-04-25T02:06:34.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:34.703+0000 7f20fda00640 1 -- 172.21.15.137:0/820266055 wait complete. 2024-04-25T02:06:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:35 smithi163 ceph-mon[32577]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:35.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:35 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/820266055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:35.670 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:35 smithi174 ceph-mon[33171]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:35.671 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:35 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/820266055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:35.671 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:35 smithi174 systemd[1]: Starting Ceph mds.l for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:35.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:35 smithi137 ceph-mon[28303]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:35.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:35 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/820266055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:35.925 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:35 smithi174 podman[63048]: 2024-04-25 02:06:35.567925033 +0000 UTC m=+0.018067454 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:35.926 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:35 smithi174 podman[63048]: 2024-04-25 02:06:35.702032513 +0000 UTC m=+0.152174965 container create e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, ceph=True) 2024-04-25T02:06:36.427 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 podman[63048]: 2024-04-25 02:06:36.004432397 +0000 UTC m=+0.454574803 container init e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T02:06:36.427 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 podman[63048]: 2024-04-25 02:06:36.006893459 +0000 UTC m=+0.457035869 container start e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T02:06:36.427 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 ceph-mds[63067]: -- 172.21.15.174:0/2427466723 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b66b7ba40 con 0x560b66b4f000 2024-04-25T02:06:36.428 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l[63063]: starting mds.l at 2024-04-25T02:06:36.428 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 bash[63048]: e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a 2024-04-25T02:06:36.428 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:06:36 smithi174 systemd[1]: Started Ceph mds.l for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:36.732 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:36.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 -- 172.21.15.137:0/2957963743 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c102200 msgr2=0x7f9d4c1045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 --2- 172.21.15.137:0/2957963743 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c102200 0x7f9d4c1045f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009900 tx=0x7f9d3c02a410 comp rx=0 tx=0).stop 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 -- 172.21.15.137:0/2957963743 shutdown_connections 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 --2- 172.21.15.137:0/2957963743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c107460 0x7f9d4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 --2- 172.21.15.137:0/2957963743 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c104b30 0x7f9d4c106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 --2- 172.21.15.137:0/2957963743 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c102200 0x7f9d4c1045f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 -- 172.21.15.137:0/2957963743 >> 172.21.15.137:0/2957963743 conn(0x7f9d4c0fbbf0 msgr2=0x7f9d4c0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 -- 172.21.15.137:0/2957963743 shutdown_connections 2024-04-25T02:06:36.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.952+0000 7f9d50e00640 1 -- 172.21.15.137:0/2957963743 wait complete. 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.953+0000 7f9d50e00640 1 Processor -- start 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 -- start start 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 0x7f9d4c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c107460 0x7f9d4c1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:36.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10d530 con 0x7f9d4c102200 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10d3b0 con 0x7f9d4c107460 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d50e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c10d6b0 con 0x7f9d4c104b30 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d41400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d41400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:53542/0 (socket says 172.21.15.137:53542) 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d41400640 1 -- 172.21.15.137:0/1678267511 learned_addr learned my addr 172.21.15.137:0/1678267511 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d4a800640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c107460 0x7f9d4c1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.954+0000 7f9d49e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 0x7f9d4c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 -- 172.21.15.137:0/1678267511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c107460 msgr2=0x7f9d4c1a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c107460 0x7f9d4c1a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 -- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 msgr2=0x7f9d4c199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 0x7f9d4c199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 -- 172.21.15.137:0/1678267511 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c1a19b0 con 0x7f9d4c104b30 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d49e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 0x7f9d4c199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:36.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d41400640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400e9c0 tx=0x7f9d3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400cd80 con 0x7f9d4c104b30 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d34005520 con 0x7f9d4c104b30 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c1a1ca0 con 0x7f9d4c104b30 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34010690 con 0x7f9d4c104b30 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.955+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c1a2190 con 0x7f9d4c104b30 2024-04-25T02:06:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.956+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c108fb0 con 0x7f9d4c104b30 2024-04-25T02:06:36.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.958+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9d340046c0 con 0x7f9d4c104b30 2024-04-25T02:06:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.959+0000 7f9d43400640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 0x7f9d300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.960+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9d340cf0a0 con 0x7f9d4c104b30 2024-04-25T02:06:36.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.960+0000 7f9d49e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 0x7f9d300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:36.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.960+0000 7f9d49e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 0x7f9d300a50d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006010 tx=0x7f9d3c031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:36.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:36.964+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9d3409c400 con 0x7f9d4c104b30 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6832/82630736,v1:172.21.15.174:6833/82630736] up:boot 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: fsmap 1 up:standby 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:37.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: Deploying daemon mds.k on smithi163 2024-04-25T02:06:37.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:37 smithi163 ceph-mon[32577]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:37.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.204+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d4c062410 con 0x7f9d4c104b30 2024-04-25T02:06:37.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.205+0000 7f9d43400640 1 -- 172.21.15.137:0/1678267511 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1390 (secure 0 0 0) 0x7f9d3409bd00 con 0x7f9d4c104b30 2024-04-25T02:06:37.211 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:37.211 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:37.212 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 2 2024-04-25T02:06:37.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 msgr2=0x7f9d300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 0x7f9d300a50d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006010 tx=0x7f9d3c031640 comp rx=0 tx=0).stop 2024-04-25T02:06:37.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 msgr2=0x7f9d4c19a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:37.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400e9c0 tx=0x7f9d3400ee80 comp rx=0 tx=0).stop 2024-04-25T02:06:37.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 shutdown_connections 2024-04-25T02:06:37.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9d300a2c10 0x7f9d300a50d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d4c107460 0x7f9d4c1a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d4c104b30 0x7f9d4c19a2e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 --2- 172.21.15.137:0/1678267511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d4c102200 0x7f9d4c199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:37.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 >> 172.21.15.137:0/1678267511 conn(0x7f9d4c0fbbf0 msgr2=0x7f9d4c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:37.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 shutdown_connections 2024-04-25T02:06:37.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:37.208+0000 7f9d50e00640 1 -- 172.21.15.137:0/1678267511 wait complete. 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6832/82630736,v1:172.21.15.174:6833/82630736] up:boot 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: fsmap 1 up:standby 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.231 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:37.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:37.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:37.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: Deploying daemon mds.k on smithi163 2024-04-25T02:06:37.232 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:37 smithi137 ceph-mon[28303]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6832/82630736,v1:172.21.15.174:6833/82630736] up:boot 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: fsmap 1 up:standby 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:37.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:37.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:37.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:37.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: Deploying daemon mds.k on smithi163 2024-04-25T02:06:37.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:37 smithi174 ceph-mon[33171]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:38.267 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:38 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1678267511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:38.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:38 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1678267511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:38.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:38 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1678267511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:38.641 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 systemd[1]: Starting Ceph mds.k for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:38.922 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 podman[61712]: 2024-04-25 02:06:38.554238813 +0000 UTC m=+0.017760366 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:38.922 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 podman[61712]: 2024-04-25 02:06:38.671374485 +0000 UTC m=+0.134896029 container create f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T02:06:38.922 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 podman[61712]: 2024-04-25 02:06:38.89056872 +0000 UTC m=+0.354090267 container init f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T02:06:38.922 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 podman[61712]: 2024-04-25 02:06:38.893194972 +0000 UTC m=+0.356716517 container start f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-25T02:06:38.923 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 ceph-mds[61731]: -- 172.21.15.163:0/1321034721 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648a345ba40 con 0x5648a342e800 2024-04-25T02:06:39.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:39.328 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:39 smithi174 ceph-mon[33171]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:39.328 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.328 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:39 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:39 smithi163 ceph-mon[32577]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:39.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:39 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.392 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k[61727]: starting mds.k at 2024-04-25T02:06:39.392 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 bash[61712]: f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd 2024-04-25T02:06:39.392 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:06:38 smithi163 systemd[1]: Started Ceph mds.k for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 -- 172.21.15.137:0/516833057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8102980 msgr2=0x7f13c8102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 --2- 172.21.15.137:0/516833057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8102980 0x7f13c8102e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009860 tx=0x7f13b402a340 comp rx=0 tx=0).stop 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 -- 172.21.15.137:0/516833057 shutdown_connections 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 --2- 172.21.15.137:0/516833057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8103340 0x7f13c8109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 --2- 172.21.15.137:0/516833057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8102980 0x7f13c8102e00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 --2- 172.21.15.137:0/516833057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8101790 0x7f13c8101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 -- 172.21.15.137:0/516833057 >> 172.21.15.137:0/516833057 conn(0x7f13c80fcd20 msgr2=0x7f13c80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 -- 172.21.15.137:0/516833057 shutdown_connections 2024-04-25T02:06:39.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.411+0000 7f13cd400640 1 -- 172.21.15.137:0/516833057 wait complete. 2024-04-25T02:06:39.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 Processor -- start 2024-04-25T02:06:39.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 -- start start 2024-04-25T02:06:39.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 0x7f13c819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8103340 0x7f13c81a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13c810d540 con 0x7f13c8102980 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f13c810d3c0 con 0x7f13c8103340 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13cd400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13c810d6c0 con 0x7f13c8101790 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13c5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 0x7f13c819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13c6800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13c6800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:53556/0 (socket says 172.21.15.137:53556) 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13c6800640 1 -- 172.21.15.137:0/2623042061 learned_addr learned my addr 172.21.15.137:0/2623042061 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.412+0000 7f13c5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 0x7f13c819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39916/0 (socket says 172.21.15.137:39916) 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c7200640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8103340 0x7f13c81a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 -- 172.21.15.137:0/2623042061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8103340 msgr2=0x7f13c81a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8103340 0x7f13c81a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 -- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 msgr2=0x7f13c819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 0x7f13c819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 -- 172.21.15.137:0/2623042061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81a1970 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13c6800640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13b800e9f0 tx=0x7f13b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800ccc0 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c81a1c60 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13b80035f0 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.413+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b800ce60 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.414+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c81a2180 con 0x7f13c8101790 2024-04-25T02:06:39.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.415+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c81a2350 con 0x7f13c8101790 2024-04-25T02:06:39.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.417+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f13b80037a0 con 0x7f13c8101790 2024-04-25T02:06:39.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.418+0000 7f13bf400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 0x7f13ac0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:39.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.418+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f13b80cee90 con 0x7f13c8101790 2024-04-25T02:06:39.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.418+0000 7f13c5e00640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 0x7f13ac0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:39.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.419+0000 7f13c5e00640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 0x7f13ac0a5050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13b402a930 tx=0x7f13b40305c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:39.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.422+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f13b809c1f0 con 0x7f13c8101790 2024-04-25T02:06:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:39 smithi137 ceph-mon[28303]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:39 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:39.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.664+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13c81a2520 con 0x7f13c8101790 2024-04-25T02:06:39.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.665+0000 7f13bf400640 1 -- 172.21.15.137:0/2623042061 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f13b809baf0 con 0x7f13c8101790 2024-04-25T02:06:39.671 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:39.671 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:39.671 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 3 2024-04-25T02:06:39.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 msgr2=0x7f13ac0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 0x7f13ac0a5050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13b402a930 tx=0x7f13b40305c0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 msgr2=0x7f13c8199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:39.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f13b800e9f0 tx=0x7f13b800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 shutdown_connections 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13ac0a2b90 0x7f13ac0a5050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13c8103340 0x7f13c81a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13c8102980 0x7f13c819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 --2- 172.21.15.137:0/2623042061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13c8101790 0x7f13c8199d50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 >> 172.21.15.137:0/2623042061 conn(0x7f13c80fcd20 msgr2=0x7f13c8073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 shutdown_connections 2024-04-25T02:06:39.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:39.668+0000 7f13cd400640 1 -- 172.21.15.137:0/2623042061 wait complete. 2024-04-25T02:06:40.296 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6832/1032553485,v1:172.21.15.163:6833/1032553485] up:boot 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: fsmap 2 up:standby 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: Deploying daemon mds.j on smithi137 2024-04-25T02:06:40.297 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:40 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2623042061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6832/1032553485,v1:172.21.15.163:6833/1032553485] up:boot 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: fsmap 2 up:standby 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: Deploying daemon mds.j on smithi137 2024-04-25T02:06:40.340 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:40 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2623042061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:40.372 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6832/1032553485,v1:172.21.15.163:6833/1032553485] up:boot 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: fsmap 2 up:standby 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: Deploying daemon mds.j on smithi137 2024-04-25T02:06:40.373 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:40 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2623042061' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:41.199 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:41 smithi137 ceph-mon[28303]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:41.391 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:41 smithi163 ceph-mon[32577]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:41.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:41 smithi174 ceph-mon[33171]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:41.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:42.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.092+0000 7fcb24600640 1 -- 172.21.15.137:0/2577768796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c104b40 msgr2=0x7fcb1c106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.092+0000 7fcb24600640 1 --2- 172.21.15.137:0/2577768796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c104b40 0x7fcb1c106f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009900 tx=0x7fcb0802a410 comp rx=0 tx=0).stop 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 -- 172.21.15.137:0/2577768796 shutdown_connections 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 --2- 172.21.15.137:0/2577768796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c107470 0x7fcb1c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 --2- 172.21.15.137:0/2577768796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c104b40 0x7fcb1c106f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 --2- 172.21.15.137:0/2577768796 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c102210 0x7fcb1c104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 -- 172.21.15.137:0/2577768796 >> 172.21.15.137:0/2577768796 conn(0x7fcb1c0fbc20 msgr2=0x7fcb1c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 -- 172.21.15.137:0/2577768796 shutdown_connections 2024-04-25T02:06:42.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.093+0000 7fcb24600640 1 -- 172.21.15.137:0/2577768796 wait complete. 2024-04-25T02:06:42.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.094+0000 7fcb24600640 1 Processor -- start 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.094+0000 7fcb24600640 1 -- start start 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 0x7fcb1c199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c104b40 0x7fcb1c19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 0x7fcb1c1a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10d590 con 0x7fcb1c107470 2024-04-25T02:06:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10d410 con 0x7fcb1c104b40 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb24600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c10d710 con 0x7fcb1c102210 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb22600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 0x7fcb1c1a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb22600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 0x7fcb1c1a12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35398/0 (socket says 172.21.15.137:35398) 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 0x7fcb1c199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb22600640 1 -- 172.21.15.137:0/2340391381 learned_addr learned my addr 172.21.15.137:0/2340391381 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21200640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c104b40 0x7fcb1c19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:42.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 -- 172.21.15.137:0/2340391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c104b40 msgr2=0x7fcb1c19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c104b40 0x7fcb1c19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 -- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 msgr2=0x7fcb1c1a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 0x7fcb1c1a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.095+0000 7fcb21c00640 1 -- 172.21.15.137:0/2340391381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c1a1960 con 0x7fcb1c102210 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb21c00640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 0x7fcb1c199d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000e9f0 tx=0x7fcb1000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000ccc0 con 0x7fcb1c102210 2024-04-25T02:06:42.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb10010930 con 0x7fcb1c102210 2024-04-25T02:06:42.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb100189f0 con 0x7fcb1c102210 2024-04-25T02:06:42.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c1a1c50 con 0x7fcb1c102210 2024-04-25T02:06:42.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.096+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1a2170 con 0x7fcb1c102210 2024-04-25T02:06:42.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.097+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c0689b0 con 0x7fcb1c102210 2024-04-25T02:06:42.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.100+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcb10010ae0 con 0x7fcb1c102210 2024-04-25T02:06:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.102+0000 7fcb1a000640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 0x7fcb040a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.102+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fcb100cf3a0 con 0x7fcb1c102210 2024-04-25T02:06:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.102+0000 7fcb21200640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 0x7fcb040a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.103+0000 7fcb21200640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 0x7fcb040a5050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802aa00 tx=0x7fcb08005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.103+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fcb1009c0b0 con 0x7fcb1c102210 2024-04-25T02:06:42.283 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:41 smithi137 systemd[1]: Starting Ceph mds.j for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:42.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.367+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb1c02d210 con 0x7fcb1c102210 2024-04-25T02:06:42.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.367+0000 7fcb1a000640 1 -- 172.21.15.137:0/2340391381 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7fcb1c02d210 con 0x7fcb1c102210 2024-04-25T02:06:42.374 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:42.374 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:42.375 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 3 2024-04-25T02:06:42.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 msgr2=0x7fcb040a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 0x7fcb040a5050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb0802aa00 tx=0x7fcb08005a20 comp rx=0 tx=0).stop 2024-04-25T02:06:42.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 msgr2=0x7fcb1c199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:42.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 0x7fcb1c199d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000e9f0 tx=0x7fcb1000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 shutdown_connections 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcb040a2b90 0x7fcb040a5050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb1c107470 0x7fcb1c1a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.370+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb1c104b40 0x7fcb1c19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.371+0000 7fcb24600640 1 --2- 172.21.15.137:0/2340391381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb1c102210 0x7fcb1c199d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.371+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 >> 172.21.15.137:0/2340391381 conn(0x7fcb1c0fbc20 msgr2=0x7fcb1c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:42.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.371+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 shutdown_connections 2024-04-25T02:06:42.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:42.371+0000 7fcb24600640 1 -- 172.21.15.137:0/2340391381 wait complete. 2024-04-25T02:06:42.638 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:42 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2340391381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:42.639 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 podman[65572]: 2024-04-25 02:06:42.272172691 +0000 UTC m=+0.033319336 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:42.639 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 podman[65572]: 2024-04-25 02:06:42.378107019 +0000 UTC m=+0.139253674 container create 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:06:42.639 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 podman[65572]: 2024-04-25 02:06:42.63213264 +0000 UTC m=+0.393279328 container init 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD) 2024-04-25T02:06:42.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:42 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2340391381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:42.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:42 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2340391381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:43.032 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 podman[65572]: 2024-04-25 02:06:42.641879343 +0000 UTC m=+0.403026018 container start 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5) 2024-04-25T02:06:43.033 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 ceph-mds[65593]: -- 172.21.15.137:0/1763870919 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55faf2e33a40 con 0x55faf2e06c00 2024-04-25T02:06:43.033 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j[65589]: starting mds.j at 2024-04-25T02:06:43.033 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 bash[65572]: 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f 2024-04-25T02:06:43.033 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:06:42 smithi137 systemd[1]: Started Ceph mds.j for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:43.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:43 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:43.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:43 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:43 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:44.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 -- 172.21.15.137:0/1670205353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac105370 msgr2=0x7f12ac10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 --2- 172.21.15.137:0/1670205353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac105370 0x7f12ac10bc00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009be0 tx=0x7f12a402a6c0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 -- 172.21.15.137:0/1670205353 shutdown_connections 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 --2- 172.21.15.137:0/1670205353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac105370 0x7f12ac10bc00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 --2- 172.21.15.137:0/1670205353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 --2- 172.21.15.137:0/1670205353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac1037c0 0x7f12ac103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 -- 172.21.15.137:0/1670205353 >> 172.21.15.137:0/1670205353 conn(0x7f12ac0fed50 msgr2=0x7f12ac101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 -- 172.21.15.137:0/1670205353 shutdown_connections 2024-04-25T02:06:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.611+0000 7f12abe00640 1 -- 172.21.15.137:0/1670205353 wait complete. 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.612+0000 7f12abe00640 1 Processor -- start 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.612+0000 7f12abe00640 1 -- start start 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac1037c0 0x7f12ac199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac105370 0x7f12ac1a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10f570 con 0x7f12ac1049b0 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10f3f0 con 0x7f12ac1037c0 2024-04-25T02:06:44.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12abe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12ac10f6f0 con 0x7f12ac105370 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35436/0 (socket says 172.21.15.137:35436) 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 -- 172.21.15.137:0/278805415 learned_addr learned my addr 172.21.15.137:0/278805415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aaa00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac1037c0 0x7f12ac199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12ab400640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac105370 0x7f12ac1a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 -- 172.21.15.137:0/278805415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac105370 msgr2=0x7f12ac1a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac105370 0x7f12ac1a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 -- 172.21.15.137:0/278805415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac1037c0 msgr2=0x7f12ac199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac1037c0 0x7f12ac199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.613+0000 7f12aa000640 1 -- 172.21.15.137:0/278805415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12ac1a1800 con 0x7f12ac1049b0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12aa000640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9c0 tx=0x7f129800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129800cde0 con 0x7f12ac1049b0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12ac1a1af0 con 0x7f12ac1049b0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12980035f0 con 0x7f12ac1049b0 2024-04-25T02:06:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298010670 con 0x7f12ac1049b0 2024-04-25T02:06:44.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.614+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12ac1a2040 con 0x7f12ac1049b0 2024-04-25T02:06:44.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.615+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12ac10aa10 con 0x7f12ac1049b0 2024-04-25T02:06:44.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.618+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f12980037a0 con 0x7f12ac1049b0 2024-04-25T02:06:44.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.619+0000 7f12a3400640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 0x7f12900a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:44.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.620+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f12980cee70 con 0x7f12ac1049b0 2024-04-25T02:06:44.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.620+0000 7f12aaa00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 0x7f12900a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:44.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.620+0000 7f12aaa00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 0x7f12900a5050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12ac104810 tx=0x7f129c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:44.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.624+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f129809c1d0 con 0x7f12ac1049b0 2024-04-25T02:06:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:44 smithi137 ceph-mon[28303]: Deploying daemon mds.d on smithi137 2024-04-25T02:06:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:44 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.137:6834/3709487068,v1:172.21.15.137:6835/3709487068] up:boot 2024-04-25T02:06:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:44 smithi137 ceph-mon[28303]: fsmap 3 up:standby 2024-04-25T02:06:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:06:44.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.866+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12ac0623e0 con 0x7f12ac1049b0 2024-04-25T02:06:44.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.867+0000 7f12a3400640 1 -- 172.21.15.137:0/278805415 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f129809bad0 con 0x7f12ac1049b0 2024-04-25T02:06:44.873 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:44.874 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:44.874 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 4 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 msgr2=0x7f12900a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 0x7f12900a5050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12ac104810 tx=0x7f129c005f90 comp rx=0 tx=0).stop 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 msgr2=0x7f12ac19a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f129800e9c0 tx=0x7f129800ee80 comp rx=0 tx=0).stop 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 shutdown_connections 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f12900a2b90 0x7f12900a5050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12ac105370 0x7f12ac1a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12ac1049b0 0x7f12ac19a120 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 --2- 172.21.15.137:0/278805415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12ac1037c0 0x7f12ac199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:44.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 >> 172.21.15.137:0/278805415 conn(0x7f12ac0fed50 msgr2=0x7f12ac107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:44.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 shutdown_connections 2024-04-25T02:06:44.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:44.870+0000 7f12abe00640 1 -- 172.21.15.137:0/278805415 wait complete. 2024-04-25T02:06:44.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:44 smithi163 ceph-mon[32577]: Deploying daemon mds.d on smithi137 2024-04-25T02:06:44.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:44 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.137:6834/3709487068,v1:172.21.15.137:6835/3709487068] up:boot 2024-04-25T02:06:44.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:44 smithi163 ceph-mon[32577]: fsmap 3 up:standby 2024-04-25T02:06:44.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:06:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:44 smithi174 ceph-mon[33171]: Deploying daemon mds.d on smithi137 2024-04-25T02:06:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:44 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.137:6834/3709487068,v1:172.21.15.137:6835/3709487068] up:boot 2024-04-25T02:06:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:44 smithi174 ceph-mon[33171]: fsmap 3 up:standby 2024-04-25T02:06:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:06:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:45 smithi137 ceph-mon[28303]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:45 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/278805415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:45.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:45 smithi163 ceph-mon[32577]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:45 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/278805415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:45 smithi174 ceph-mon[33171]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:45 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/278805415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:46.271 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:45 smithi137 systemd[1]: Starting Ceph mds.d for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:46.533 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 podman[65920]: 2024-04-25 02:06:46.172462549 +0000 UTC m=+0.037613155 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:46.533 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 podman[65920]: 2024-04-25 02:06:46.289730211 +0000 UTC m=+0.154880800 container create 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:06:46.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:46.972 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 podman[65920]: 2024-04-25 02:06:46.560689957 +0000 UTC m=+0.425840625 container init 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T02:06:46.973 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 podman[65920]: 2024-04-25 02:06:46.571361745 +0000 UTC m=+0.436512353 container start 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:06:46.973 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 ceph-mds[65939]: -- 172.21.15.137:0/3467948919 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d681e87a40 con 0x55d681e5ac00 2024-04-25T02:06:46.973 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d[65935]: starting mds.d at 2024-04-25T02:06:46.973 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 bash[65920]: 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 2024-04-25T02:06:46.973 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:06:46 smithi137 systemd[1]: Started Ceph mds.d for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.100+0000 7fe051e00640 1 -- 172.21.15.137:0/2346453136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c104bb0 msgr2=0x7fe04c105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.100+0000 7fe051e00640 1 --2- 172.21.15.137:0/2346453136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c104bb0 0x7fe04c105030 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe034009900 tx=0x7fe03402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 -- 172.21.15.137:0/2346453136 shutdown_connections 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 --2- 172.21.15.137:0/2346453136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c105570 0x7fe04c10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 --2- 172.21.15.137:0/2346453136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c104bb0 0x7fe04c105030 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 --2- 172.21.15.137:0/2346453136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c1039c0 0x7fe04c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 -- 172.21.15.137:0/2346453136 >> 172.21.15.137:0/2346453136 conn(0x7fe04c0fef30 msgr2=0x7fe04c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 -- 172.21.15.137:0/2346453136 shutdown_connections 2024-04-25T02:06:47.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.101+0000 7fe051e00640 1 -- 172.21.15.137:0/2346453136 wait complete. 2024-04-25T02:06:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 Processor -- start 2024-04-25T02:06:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 -- start start 2024-04-25T02:06:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c104bb0 0x7fe04c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:47.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c105570 0x7fe04c1a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10f7c0 con 0x7fe04c1039c0 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10f640 con 0x7fe04c104bb0 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe051e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10f940 con 0x7fe04c105570 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe042000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c104bb0 0x7fe04c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe04b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c105570 0x7fe04c1a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35460/0 (socket says 172.21.15.137:35460) 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.102+0000 7fe04aa00640 1 -- 172.21.15.137:0/567690770 learned_addr learned my addr 172.21.15.137:0/567690770 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 -- 172.21.15.137:0/567690770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c105570 msgr2=0x7fe04c1a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c105570 0x7fe04c1a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 -- 172.21.15.137:0/567690770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c104bb0 msgr2=0x7fe04c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c104bb0 0x7fe04c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 -- 172.21.15.137:0/567690770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c1a19f0 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe04aa00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e9c0 tx=0x7fe03c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00ccc0 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c1a1ce0 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe03c0035f0 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00ce60 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.103+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1a21b0 con 0x7fe04c1039c0 2024-04-25T02:06:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.104+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c10ace0 con 0x7fe04c1039c0 2024-04-25T02:06:47.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.106+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe03c0037a0 con 0x7fe04c1039c0 2024-04-25T02:06:47.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.108+0000 7fe050a00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 0x7fe0300a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:47.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.108+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe03c0cf160 con 0x7fe04c1039c0 2024-04-25T02:06:47.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.108+0000 7fe042000640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 0x7fe0300a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:47.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.109+0000 7fe042000640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 0x7fe0300a5050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe034005ab0 tx=0x7fe034005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:47.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.112+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe03c09c4c0 con 0x7fe04c1039c0 2024-04-25T02:06:47.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.356+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe04c0623e0 con 0x7fe04c1039c0 2024-04-25T02:06:47.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.357+0000 7fe050a00640 1 -- 172.21.15.137:0/567690770 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7fe03c09bdc0 con 0x7fe04c1039c0 2024-04-25T02:06:47.363 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:47.363 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:47.364 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 4 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 msgr2=0x7fe0300a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 0x7fe0300a5050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe034005ab0 tx=0x7fe034005a20 comp rx=0 tx=0).stop 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 msgr2=0x7fe04c199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00e9c0 tx=0x7fe03c00edc0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 shutdown_connections 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0300a2b90 0x7fe0300a5050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c105570 0x7fe04c1a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe04c104bb0 0x7fe04c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 --2- 172.21.15.137:0/567690770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe04c1039c0 0x7fe04c199dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:47.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 >> 172.21.15.137:0/567690770 conn(0x7fe04c0fef30 msgr2=0x7fe04c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:47.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 shutdown_connections 2024-04-25T02:06:47.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:47.360+0000 7fe051e00640 1 -- 172.21.15.137:0/567690770 wait complete. 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/567690770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:47.849 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:47.849 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.849 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.849 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.850 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:47.850 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:47.850 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:47.850 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/567690770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/567690770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:48 smithi163 ceph-mon[32577]: Deploying daemon mds.e on smithi163 2024-04-25T02:06:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:48 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.137:6836/3865493572,v1:172.21.15.137:6837/3865493572] up:boot 2024-04-25T02:06:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:48 smithi163 ceph-mon[32577]: fsmap 4 up:standby 2024-04-25T02:06:48.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:48 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:06:48.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:48 smithi137 ceph-mon[28303]: Deploying daemon mds.e on smithi163 2024-04-25T02:06:48.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:48 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.137:6836/3865493572,v1:172.21.15.137:6837/3865493572] up:boot 2024-04-25T02:06:48.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:48 smithi137 ceph-mon[28303]: fsmap 4 up:standby 2024-04-25T02:06:48.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:48 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:06:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:48 smithi174 ceph-mon[33171]: Deploying daemon mds.e on smithi163 2024-04-25T02:06:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:48 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.137:6836/3865493572,v1:172.21.15.137:6837/3865493572] up:boot 2024-04-25T02:06:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:48 smithi174 ceph-mon[33171]: fsmap 4 up:standby 2024-04-25T02:06:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:48 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:06:49.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:49.392 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 systemd[1]: Starting Ceph mds.e for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.591+0000 7fe136800640 1 -- 172.21.15.137:0/2573272533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130074140 msgr2=0x7fe1300745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.591+0000 7fe136800640 1 --2- 172.21.15.137:0/2573272533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130074140 0x7fe1300745a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009900 tx=0x7fe11c02a480 comp rx=0 tx=0).stop 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 -- 172.21.15.137:0/2573272533 shutdown_connections 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 --2- 172.21.15.137:0/2573272533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130109440 0x7fe13010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 --2- 172.21.15.137:0/2573272533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130074140 0x7fe1300745a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 --2- 172.21.15.137:0/2573272533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130075720 0x7fe130073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 -- 172.21.15.137:0/2573272533 >> 172.21.15.137:0/2573272533 conn(0x7fe1300fcb20 msgr2=0x7fe1300fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:49.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 -- 172.21.15.137:0/2573272533 shutdown_connections 2024-04-25T02:06:49.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.592+0000 7fe136800640 1 -- 172.21.15.137:0/2573272533 wait complete. 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 Processor -- start 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 -- start start 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 0x7fe13019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130109440 0x7fe1301a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe13010f560 con 0x7fe130074140 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe13010f3e0 con 0x7fe130075720 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.593+0000 7fe136800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe13010f6e0 con 0x7fe130109440 2024-04-25T02:06:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35480/0 (socket says 172.21.15.137:35480) 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 -- 172.21.15.137:0/126732558 learned_addr learned my addr 172.21.15.137:0/126732558 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135e00640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130109440 0x7fe1301a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe134a00640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 0x7fe13019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 -- 172.21.15.137:0/126732558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130109440 msgr2=0x7fe1301a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130109440 0x7fe1301a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 -- 172.21.15.137:0/126732558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 msgr2=0x7fe13019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 0x7fe13019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe135400640 1 -- 172.21.15.137:0/126732558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1301a17a0 con 0x7fe130074140 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.594+0000 7fe134a00640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 0x7fe13019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:06:49.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe135400640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe12400eb90 tx=0x7fe12400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124004d20 con 0x7fe130074140 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1301a1a90 con 0x7fe130074140 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe12400ee90 con 0x7fe130074140 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124010850 con 0x7fe130074140 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.595+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1301a1fb0 con 0x7fe130074140 2024-04-25T02:06:49.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.596+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe130108200 con 0x7fe130074140 2024-04-25T02:06:49.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.598+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe124005000 con 0x7fe130074140 2024-04-25T02:06:49.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.599+0000 7fe12e000640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 0x7fe1180a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:49.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.600+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe1240cf450 con 0x7fe130074140 2024-04-25T02:06:49.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.600+0000 7fe134a00640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 0x7fe1180a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:49.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.600+0000 7fe134a00640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 0x7fe1180a5050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe11c000c00 tx=0x7fe11c031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.604+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe12409c7b0 con 0x7fe130074140 2024-04-25T02:06:49.730 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:49 smithi163 ceph-mon[32577]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:49.730 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 podman[62033]: 2024-04-25 02:06:49.37648576 +0000 UTC m=+0.018027494 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:49.730 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 podman[62033]: 2024-04-25 02:06:49.503085743 +0000 UTC m=+0.144627450 container create e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-25T02:06:49.730 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 podman[62033]: 2024-04-25 02:06:49.722013135 +0000 UTC m=+0.363554843 container init e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:06:49.731 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 podman[62033]: 2024-04-25 02:06:49.724777678 +0000 UTC m=+0.366319385 container start e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T02:06:49.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:49 smithi137 ceph-mon[28303]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:49.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.841+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13002d170 con 0x7fe130074140 2024-04-25T02:06:49.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.842+0000 7fe12e000640 1 -- 172.21.15.137:0/126732558 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7fe13002d170 con 0x7fe130074140 2024-04-25T02:06:49.848 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:49.848 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T02:06:49.849 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 5 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.844+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 msgr2=0x7fe1180a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.844+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 0x7fe1180a5050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe11c000c00 tx=0x7fe11c031640 comp rx=0 tx=0).stop 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 msgr2=0x7fe130199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe12400eb90 tx=0x7fe12400c6a0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 shutdown_connections 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe1180a2b90 0x7fe1180a5050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe130109440 0x7fe1301a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe130075720 0x7fe13019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 --2- 172.21.15.137:0/126732558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe130074140 0x7fe130199b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:49.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 >> 172.21.15.137:0/126732558 conn(0x7fe1300fcb20 msgr2=0x7fe1301053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:49.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 shutdown_connections 2024-04-25T02:06:49.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:49.845+0000 7fe136800640 1 -- 172.21.15.137:0/126732558 wait complete. 2024-04-25T02:06:49.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:49 smithi174 ceph-mon[33171]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:50.141 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 ceph-mds[62053]: -- 172.21.15.163:0/4263185749 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ab028ba40 con 0x556ab025ec00 2024-04-25T02:06:50.142 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: starting mds.e at 2024-04-25T02:06:50.142 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 bash[62033]: e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b 2024-04-25T02:06:50.142 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:06:49 smithi163 systemd[1]: Started Ceph mds.e for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/126732558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:50.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:50 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/126732558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:50.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:50 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/126732558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:50 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: Deploying daemon mds.f on smithi174 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6834/2970303147,v1:172.21.15.163:6835/2970303147] up:boot 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: fsmap 5 up:standby 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:51 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:51.807 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: Deploying daemon mds.f on smithi174 2024-04-25T02:06:51.807 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:51.808 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6834/2970303147,v1:172.21.15.163:6835/2970303147] up:boot 2024-04-25T02:06:51.808 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: fsmap 5 up:standby 2024-04-25T02:06:51.808 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:51.808 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:51 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:51.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:51.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: Deploying daemon mds.f on smithi174 2024-04-25T02:06:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6834/2970303147,v1:172.21.15.163:6835/2970303147] up:boot 2024-04-25T02:06:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: fsmap 5 up:standby 2024-04-25T02:06:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:51 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.065+0000 7fc74cc00640 1 -- 172.21.15.137:0/2456224365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc748104bb0 msgr2=0x7fc748105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 --2- 172.21.15.137:0/2456224365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc748104bb0 0x7fc748105030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc730009900 tx=0x7fc73002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 -- 172.21.15.137:0/2456224365 shutdown_connections 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 --2- 172.21.15.137:0/2456224365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc74810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 --2- 172.21.15.137:0/2456224365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc748104bb0 0x7fc748105030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 --2- 172.21.15.137:0/2456224365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7481039c0 0x7fc748103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 -- 172.21.15.137:0/2456224365 >> 172.21.15.137:0/2456224365 conn(0x7fc7480fef30 msgr2=0x7fc748101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 -- 172.21.15.137:0/2456224365 shutdown_connections 2024-04-25T02:06:52.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.066+0000 7fc74cc00640 1 -- 172.21.15.137:0/2456224365 wait complete. 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 Processor -- start 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 -- start start 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc748104bb0 0x7fc74819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc7481a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc74810f770 con 0x7fc748104bb0 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc74810f5f0 con 0x7fc748105570 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.067+0000 7fc74cc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc74810f8f0 con 0x7fc7481039c0 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49662/0 (socket says 172.21.15.137:49662) 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc73d400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc748104bb0 0x7fc74819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 -- 172.21.15.137:0/3318012521 learned_addr learned my addr 172.21.15.137:0/3318012521 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:52.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc746800640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc7481a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 -- 172.21.15.137:0/3318012521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 msgr2=0x7fc7481a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc7481a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 -- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc748104bb0 msgr2=0x7fc74819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc748104bb0 0x7fc74819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 -- 172.21.15.137:0/3318012521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7481a19b0 con 0x7fc7481039c0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc746800640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc7481a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc745e00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e9c0 tx=0x7fc73800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800cd80 con 0x7fc7481039c0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7380035f0 con 0x7fc7481039c0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7481a1ca0 con 0x7fc7481039c0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.068+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738010690 con 0x7fc7481039c0 2024-04-25T02:06:52.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.069+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7481a21a0 con 0x7fc7481039c0 2024-04-25T02:06:52.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.070+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74810ace0 con 0x7fc7481039c0 2024-04-25T02:06:52.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.072+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc7380037a0 con 0x7fc7481039c0 2024-04-25T02:06:52.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.073+0000 7fc73f400640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 0x7fc7280a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:52.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.073+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fc7380cf1e0 con 0x7fc7481039c0 2024-04-25T02:06:52.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.073+0000 7fc73d400640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 0x7fc7280a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:52.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.074+0000 7fc73d400640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 0x7fc7280a5050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc730006010 tx=0x7fc730031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:52.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.081+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc73809c540 con 0x7fc7481039c0 2024-04-25T02:06:52.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.321+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc74802d170 con 0x7fc7481039c0 2024-04-25T02:06:52.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.322+0000 7fc73f400640 1 -- 172.21.15.137:0/3318012521 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7fc74802d170 con 0x7fc7481039c0 2024-04-25T02:06:52.329 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:52.329 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-25T02:06:52.330 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 6 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.324+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 msgr2=0x7fc7280a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.324+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 0x7fc7280a5050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc730006010 tx=0x7fc730031640 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 msgr2=0x7fc748199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc73800e9c0 tx=0x7fc73800ee80 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 shutdown_connections 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc7280a2b90 0x7fc7280a5050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc748105570 0x7fc7481a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc748104bb0 0x7fc74819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 --2- 172.21.15.137:0/3318012521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc7481039c0 0x7fc748199da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:52.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 >> 172.21.15.137:0/3318012521 conn(0x7fc7480fef30 msgr2=0x7fc748107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:52.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 shutdown_connections 2024-04-25T02:06:52.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:52.325+0000 7fc74cc00640 1 -- 172.21.15.137:0/3318012521 wait complete. 2024-04-25T02:06:52.505 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 podman[63356]: 2024-04-25 02:06:52.42135259 +0000 UTC m=+0.141661458 container create 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T02:06:52.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:52 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3318012521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:52.779 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 podman[63356]: 2024-04-25 02:06:52.690574173 +0000 UTC m=+0.410883033 container init 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T02:06:52.780 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 podman[63356]: 2024-04-25 02:06:52.693149072 +0000 UTC m=+0.413457933 container start 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:06:52.780 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 ceph-mds[63376]: -- 172.21.15.174:0/3902468429 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584719bda40 con 0x558471990c00 2024-04-25T02:06:52.780 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: starting mds.f at 2024-04-25T02:06:52.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:52 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3318012521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:52 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3318012521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:53.177 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 bash[63356]: 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 2024-04-25T02:06:53.177 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:06:52 smithi174 systemd[1]: Started Ceph mds.f for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:53.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:53 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:53.799 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:53.800 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:53 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:53 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:54.353 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 -- 172.21.15.137:0/2860930770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770076100 msgr2=0x7f8770076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 --2- 172.21.15.137:0/2860930770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770076100 0x7f8770076520 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8760009900 tx=0x7f876002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 -- 172.21.15.137:0/2860930770 shutdown_connections 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 --2- 172.21.15.137:0/2860930770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770077ce0 0x7f8770078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 --2- 172.21.15.137:0/2860930770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077340 0x7f87700777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 --2- 172.21.15.137:0/2860930770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770076100 0x7f8770076520 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 -- 172.21.15.137:0/2860930770 >> 172.21.15.137:0/2860930770 conn(0x7f87700fef30 msgr2=0x7f8770101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.559+0000 7f8775e00640 1 -- 172.21.15.137:0/2860930770 shutdown_connections 2024-04-25T02:06:54.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.560+0000 7f8775e00640 1 -- 172.21.15.137:0/2860930770 wait complete. 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 Processor -- start 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 -- start start 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770076100 0x7f877019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770077340 0x7f877019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8770113b70 con 0x7f8770077ce0 2024-04-25T02:06:54.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f87701139f0 con 0x7f8770076100 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.561+0000 7f8775e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8770113cf0 con 0x7f8770077340 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44264/0 (socket says 172.21.15.137:44264) 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 -- 172.21.15.137:0/348039216 learned_addr learned my addr 172.21.15.137:0/348039216 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876ea00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770076100 0x7f877019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f8767e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770077340 0x7f877019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 -- 172.21.15.137:0/348039216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770077340 msgr2=0x7f877019e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770077340 0x7f877019e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 -- 172.21.15.137:0/348039216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770076100 msgr2=0x7f877019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770076100 0x7f877019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 -- 172.21.15.137:0/348039216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87701a5db0 con 0x7f8770077ce0 2024-04-25T02:06:54.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.562+0000 7f876f400640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f876800eb10 tx=0x7f876800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.563+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768004b20 con 0x7f8770077ce0 2024-04-25T02:06:54.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.563+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8768004cc0 con 0x7f8770077ce0 2024-04-25T02:06:54.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.563+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87701a60a0 con 0x7f8770077ce0 2024-04-25T02:06:54.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.563+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87680107f0 con 0x7f8770077ce0 2024-04-25T02:06:54.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.563+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87701a65f0 con 0x7f8770077ce0 2024-04-25T02:06:54.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.564+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8770110480 con 0x7f8770077ce0 2024-04-25T02:06:54.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.566+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8768005020 con 0x7f8770077ce0 2024-04-25T02:06:54.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.567+0000 7f8774a00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 0x7f87500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:54.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.568+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f87680cf180 con 0x7f8770077ce0 2024-04-25T02:06:54.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.568+0000 7f876ea00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 0x7f87500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:54.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.569+0000 7f876ea00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 0x7f87500a50d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8760006010 tx=0x7f8760031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:54.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.573+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f876809c4e0 con 0x7f8770077ce0 2024-04-25T02:06:54.661 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: Deploying daemon mds.c on smithi174 2024-04-25T02:06:54.661 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6834/1300618267,v1:172.21.15.174:6835/1300618267] up:boot 2024-04-25T02:06:54.661 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: fsmap 6 up:standby 2024-04-25T02:06:54.661 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.661 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.662 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:54 smithi174 ceph-mon[33171]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: Deploying daemon mds.c on smithi174 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6834/1300618267,v1:172.21.15.174:6835/1300618267] up:boot 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: fsmap 6 up:standby 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:54 smithi137 ceph-mon[28303]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.810+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8770062340 con 0x7f8770077ce0 2024-04-25T02:06:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.812+0000 7f8774a00640 1 -- 172.21.15.137:0/348039216 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7f876809bde0 con 0x7f8770077ce0 2024-04-25T02:06:54.819 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:54.819 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-25T02:06:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-25T02:06:54.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 msgr2=0x7f87500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 0x7f87500a50d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8760006010 tx=0x7f8760031640 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 msgr2=0x7f87701a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f876800eb10 tx=0x7f876800c2d0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 shutdown_connections 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f87500a2c10 0x7f87500a50d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8770077ce0 0x7f87701a5740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8770077340 0x7f877019e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 --2- 172.21.15.137:0/348039216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8770076100 0x7f877019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 >> 172.21.15.137:0/348039216 conn(0x7f87700fef30 msgr2=0x7f87701005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 shutdown_connections 2024-04-25T02:06:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:54.814+0000 7f8775e00640 1 -- 172.21.15.137:0/348039216 wait complete. 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: Deploying daemon mds.c on smithi174 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6834/1300618267,v1:172.21.15.174:6835/1300618267] up:boot 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: fsmap 6 up:standby 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:06:54.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:54 smithi163 ceph-mon[32577]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:55.358 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 systemd[1]: Starting Ceph mds.c for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:55.616 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:55 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/348039216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:55.616 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 podman[63666]: 2024-04-25 02:06:55.25458644 +0000 UTC m=+0.017668605 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:55.617 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 podman[63666]: 2024-04-25 02:06:55.357772769 +0000 UTC m=+0.120854963 container create bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-25T02:06:55.617 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 podman[63666]: 2024-04-25 02:06:55.610327367 +0000 UTC m=+0.373409515 container init bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T02:06:55.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:55 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/348039216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:55.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:55 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/348039216' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:55.927 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 podman[63666]: 2024-04-25 02:06:55.61306033 +0000 UTC m=+0.376142478 container start bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T02:06:55.927 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 ceph-mds[63685]: -- 172.21.15.174:0/2751920980 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c0412ada40 con 0x55c041280c00 2024-04-25T02:06:55.927 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: starting mds.c at 2024-04-25T02:06:55.927 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 bash[63666]: bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 2024-04-25T02:06:55.927 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:06:55 smithi174 systemd[1]: Started Ceph mds.c for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:56.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 -- 172.21.15.137:0/2086689892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 msgr2=0x7fd9d4103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/2086689892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4103be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009900 tx=0x7fd9c402a410 comp rx=0 tx=0).stop 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 -- 172.21.15.137:0/2086689892 shutdown_connections 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/2086689892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d4105370 0x7fd9d410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/2086689892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d41049b0 0x7fd9d4104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/2086689892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4103be0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 -- 172.21.15.137:0/2086689892 >> 172.21.15.137:0/2086689892 conn(0x7fd9d40fed50 msgr2=0x7fd9d4101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 -- 172.21.15.137:0/2086689892 shutdown_connections 2024-04-25T02:06:57.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.046+0000 7fd9d8c00640 1 -- 172.21.15.137:0/2086689892 wait complete. 2024-04-25T02:06:57.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.047+0000 7fd9d8c00640 1 Processor -- start 2024-04-25T02:06:57.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.047+0000 7fd9d8c00640 1 -- start start 2024-04-25T02:06:57.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 0x7fd9d419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 0x7fd9d41a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410f5c0 con 0x7fd9d4105370 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410f440 con 0x7fd9d41037c0 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d8c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d410f740 con 0x7fd9d41049b0 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 0x7fd9d41a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9cbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 0x7fd9d419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9cbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 0x7fd9d419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49714/0 (socket says 172.21.15.137:49714) 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9d3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 0x7fd9d41a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44276/0 (socket says 172.21.15.137:44276) 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.048+0000 7fd9cbe00640 1 -- 172.21.15.137:0/1309376329 learned_addr learned my addr 172.21.15.137:0/1309376329 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 -- 172.21.15.137:0/1309376329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 msgr2=0x7fd9d419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 0x7fd9d419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 -- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 msgr2=0x7fd9d41a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 0x7fd9d41a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 -- 172.21.15.137:0/1309376329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41a17d0 con 0x7fd9d41037c0 2024-04-25T02:06:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d3400640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4199bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009230 tx=0x7fd9c4032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c403f070 con 0x7fd9d41037c0 2024-04-25T02:06:57.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9c403b460 con 0x7fd9d41037c0 2024-04-25T02:06:57.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4035070 con 0x7fd9d41037c0 2024-04-25T02:06:57.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.049+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41a1a60 con 0x7fd9d41037c0 2024-04-25T02:06:57.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.050+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d41a1f70 con 0x7fd9d41037c0 2024-04-25T02:06:57.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.051+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d410aa10 con 0x7fd9d41037c0 2024-04-25T02:06:57.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.052+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd9c403b9d0 con 0x7fd9d41037c0 2024-04-25T02:06:57.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.054+0000 7fd9d0c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 0x7fd9b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:57.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.054+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd9c40eea50 con 0x7fd9d41037c0 2024-04-25T02:06:57.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.054+0000 7fd9cbe00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 0x7fd9b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:57.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.055+0000 7fd9cbe00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 0x7fd9b80a50d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9d419b0c0 tx=0x7fd9bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:57.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.058+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd9c40bb760 con 0x7fd9d41037c0 2024-04-25T02:06:57.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:57.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: Deploying daemon mds.h on smithi163 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:boot 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: fsmap 7 up:standby 2024-04-25T02:06:57.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:56 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:06:57.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: Deploying daemon mds.h on smithi163 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:boot 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: fsmap 7 up:standby 2024-04-25T02:06:57.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:56 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:06:57.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: Deploying daemon mds.h on smithi163 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:boot 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: fsmap 7 up:standby 2024-04-25T02:06:57.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:56 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:06:57.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.300+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9d4062340 con 0x7fd9d41037c0 2024-04-25T02:06:57.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.301+0000 7fd9d0c00640 1 -- 172.21.15.137:0/1309376329 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7fd9c40bfa60 con 0x7fd9d41037c0 2024-04-25T02:06:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:57.308 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-25T02:06:57.309 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 8 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 msgr2=0x7fd9b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 0x7fd9b80a50d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9d419b0c0 tx=0x7fd9bc005f90 comp rx=0 tx=0).stop 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 msgr2=0x7fd9d4199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4199bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009230 tx=0x7fd9c4032d70 comp rx=0 tx=0).stop 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 shutdown_connections 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9b80a2c10 0x7fd9b80a50d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9d4105370 0x7fd9d41a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd9d41049b0 0x7fd9d419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 --2- 172.21.15.137:0/1309376329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9d41037c0 0x7fd9d4199bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:57.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 >> 172.21.15.137:0/1309376329 conn(0x7fd9d40fed50 msgr2=0x7fd9d4107be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:57.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 shutdown_connections 2024-04-25T02:06:57.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:57.305+0000 7fd9d8c00640 1 -- 172.21.15.137:0/1309376329 wait complete. 2024-04-25T02:06:58.127 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:57 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1309376329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:58.127 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:57 smithi163 systemd[1]: Starting Ceph mds.h for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:06:58.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:57 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1309376329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:58.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:57 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1309376329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:06:58.388 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 podman[62348]: 2024-04-25 02:06:58.121591865 +0000 UTC m=+0.113940462 container create 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 podman[62348]: 2024-04-25 02:06:58.025629604 +0000 UTC m=+0.017978211 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 podman[62348]: 2024-04-25 02:06:58.315934072 +0000 UTC m=+0.308282670 container init 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 podman[62348]: 2024-04-25 02:06:58.318736601 +0000 UTC m=+0.311085198 container start 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 ceph-mds[62367]: -- 172.21.15.163:0/4294135004 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56164edafa40 con 0x56164ed83000 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: starting mds.h at 2024-04-25T02:06:58.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 bash[62348]: 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 2024-04-25T02:06:58.642 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:06:58 smithi163 systemd[1]: Started Ceph mds.h for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:06:59.332 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 -- 172.21.15.137:0/693018608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c103160 msgr2=0x7f690c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 --2- 172.21.15.137:0/693018608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c103160 0x7f690c1099f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6904009ca0 tx=0x7f690402a8c0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 -- 172.21.15.137:0/693018608 shutdown_connections 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 --2- 172.21.15.137:0/693018608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c103160 0x7f690c1099f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 --2- 172.21.15.137:0/693018608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1027a0 0x7f690c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 --2- 172.21.15.137:0/693018608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c1015b0 0x7f690c1019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 -- 172.21.15.137:0/693018608 >> 172.21.15.137:0/693018608 conn(0x7f690c0fcb20 msgr2=0x7f690c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.540+0000 7f6910e00640 1 -- 172.21.15.137:0/693018608 shutdown_connections 2024-04-25T02:06:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.541+0000 7f6910e00640 1 -- 172.21.15.137:0/693018608 wait complete. 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 Processor -- start 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 -- start start 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 0x7f690c199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c103160 0x7f690c1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f690c10d3b0 con 0x7f690c1015b0 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f690c10d230 con 0x7f690c1027a0 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f6910e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f690c10d530 con 0x7f690c103160 2024-04-25T02:06:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.542+0000 7f690b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 0x7f690c199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:49654/0 (socket says 172.21.15.137:49654) 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 -- 172.21.15.137:0/158447334 learned_addr learned my addr 172.21.15.137:0/158447334 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f690b400640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 0x7f690c199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44290/0 (socket says 172.21.15.137:44290) 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f690be00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c103160 0x7f690c1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 -- 172.21.15.137:0/158447334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c103160 msgr2=0x7f690c1a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c103160 0x7f690c1a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 -- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 msgr2=0x7f690c199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 0x7f690c199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 -- 172.21.15.137:0/158447334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c1a17b0 con 0x7f690c1027a0 2024-04-25T02:06:59.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.543+0000 7f6903e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68f400e9f0 tx=0x7f68f400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.544+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f400cd80 con 0x7f690c1027a0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.544+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68f4010930 con 0x7f690c1027a0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.544+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4018b00 con 0x7f690c1027a0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.544+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c1a1aa0 con 0x7f690c1027a0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.544+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c1a1fa0 con 0x7f690c1027a0 2024-04-25T02:06:59.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.545+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690c1a21d0 con 0x7f690c1027a0 2024-04-25T02:06:59.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.547+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f68f4018ca0 con 0x7f690c1027a0 2024-04-25T02:06:59.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.548+0000 7f6908c00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 0x7f68f00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:06:59.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.548+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f68f40cefe0 con 0x7f690c1027a0 2024-04-25T02:06:59.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.548+0000 7f690b400640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 0x7f68f00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:06:59.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.549+0000 7f690b400640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 0x7f68f00a5050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f690c102600 tx=0x7f68fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:06:59.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.552+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f68f409bd10 con 0x7f690c1027a0 2024-04-25T02:06:59.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:59.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: Deploying daemon mds.i on smithi174 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6836/432820443,v1:172.21.15.163:6837/432820443] up:boot 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: fsmap 8 up:standby 2024-04-25T02:06:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:06:59 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:59.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: Deploying daemon mds.i on smithi174 2024-04-25T02:06:59.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6836/432820443,v1:172.21.15.163:6837/432820443] up:boot 2024-04-25T02:06:59.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: fsmap 8 up:standby 2024-04-25T02:06:59.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:06:59 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:06:59.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.792+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f690c1a23a0 con 0x7f690c1027a0 2024-04-25T02:06:59.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.793+0000 7f6908c00640 1 -- 172.21.15.137:0/158447334 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7183 (secure 0 0 0) 0x7f68f40a0010 con 0x7f690c1027a0 2024-04-25T02:06:59.801 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:06:59.801 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-25T02:06:59.801 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 9 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.797+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 msgr2=0x7f68f00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.797+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 0x7f68f00a5050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f690c102600 tx=0x7f68fc005f90 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.797+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 msgr2=0x7f690c19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.797+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68f400e9f0 tx=0x7f68f400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 shutdown_connections 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f68f00a2b90 0x7f68f00a5050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f690c103160 0x7f690c1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f690c1027a0 0x7f690c19a0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 --2- 172.21.15.137:0/158447334 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f690c1015b0 0x7f690c199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 >> 172.21.15.137:0/158447334 conn(0x7f690c0fcb20 msgr2=0x7f690c073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 shutdown_connections 2024-04-25T02:06:59.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:06:59.798+0000 7f6910e00640 1 -- 172.21.15.137:0/158447334 wait complete. 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:06:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: Deploying daemon mds.i on smithi174 2024-04-25T02:06:59.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6836/432820443,v1:172.21.15.163:6837/432820443] up:boot 2024-04-25T02:06:59.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: fsmap 8 up:standby 2024-04-25T02:06:59.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:06:59 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:07:00.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:00 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/158447334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:00.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:00 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/158447334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:00.920 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:00 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/158447334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:00.920 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:00 smithi174 systemd[1]: Starting Ceph mds.i for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:07:01.175 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:00 smithi174 podman[63972]: 2024-04-25 02:07:00.816578517 +0000 UTC m=+0.018060404 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:07:01.175 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 podman[63972]: 2024-04-25 02:07:01.019223206 +0000 UTC m=+0.220705083 container create 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS) 2024-04-25T02:07:01.427 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 podman[63972]: 2024-04-25 02:07:01.305175189 +0000 UTC m=+0.506657066 container init 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9) 2024-04-25T02:07:01.427 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 podman[63972]: 2024-04-25 02:07:01.307716918 +0000 UTC m=+0.509198796 container start 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T02:07:01.428 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 ceph-mds[63991]: -- 172.21.15.174:0/1530567751 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5dc7e3a40 con 0x55b5dc7b6800 2024-04-25T02:07:01.428 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: starting mds.i at 2024-04-25T02:07:01.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:01 smithi137 ceph-mon[28303]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:01.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:01.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:01 smithi163 ceph-mon[32577]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:01.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:01 smithi174 ceph-mon[33171]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:01.927 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 bash[63972]: 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 2024-04-25T02:07:01.927 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:07:01 smithi174 systemd[1]: Started Ceph mds.i for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 -- 172.21.15.137:0/2995422895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 msgr2=0x7f19e0100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 --2- 172.21.15.137:0/2995422895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0100250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009ca0 tx=0x7f19d002a8b0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 -- 172.21.15.137:0/2995422895 shutdown_connections 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 --2- 172.21.15.137:0/2995422895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 0x7f19e01015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 --2- 172.21.15.137:0/2995422895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e0100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 --2- 172.21.15.137:0/2995422895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0100250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.021+0000 7f19dfe00640 1 -- 172.21.15.137:0/2995422895 >> 172.21.15.137:0/2995422895 conn(0x7f19e00fba10 msgr2=0x7f19e00fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.022+0000 7f19dfe00640 1 -- 172.21.15.137:0/2995422895 shutdown_connections 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.022+0000 7f19dfe00640 1 -- 172.21.15.137:0/2995422895 wait complete. 2024-04-25T02:07:02.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 Processor -- start 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 -- start start 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 0x7f19e01a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010f5d0 con 0x7f19e0101130 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010f450 con 0x7f19e0100790 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dfe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f19e010f750 con 0x7f19e00ffe30 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:38786/0 (socket says 172.21.15.137:38786) 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19dea00640 1 -- 172.21.15.137:0/3049508862 learned_addr learned my addr 172.21.15.137:0/3049508862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19d6000640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.023+0000 7f19df400640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 0x7f19e01a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 -- 172.21.15.137:0/3049508862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 msgr2=0x7f19e0199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 -- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 msgr2=0x7f19e01a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 0x7f19e01a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 -- 172.21.15.137:0/3049508862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e01a17c0 con 0x7f19e0100790 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19dea00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d6000640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e019a0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19c800e9f0 tx=0x7f19c800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800ccc0 con 0x7f19e0100790 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19c8005020 con 0x7f19e0100790 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e01a1ab0 con 0x7f19e0100790 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.024+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80049c0 con 0x7f19e0100790 2024-04-25T02:07:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.025+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a1fb0 con 0x7f19e0100790 2024-04-25T02:07:02.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.026+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e010ab80 con 0x7f19e0100790 2024-04-25T02:07:02.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.028+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f19c8004c60 con 0x7f19e0100790 2024-04-25T02:07:02.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.029+0000 7f19d7e00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 0x7f19c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:02.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.029+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f19c80cebb0 con 0x7f19e0100790 2024-04-25T02:07:02.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.029+0000 7f19dea00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 0x7f19c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:02.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.030+0000 7f19dea00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 0x7f19c40a5050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f19d0005e30 tx=0x7f19d0030980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:02.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.033+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f19c809bf10 con 0x7f19e0100790 2024-04-25T02:07:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.293+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19e0062340 con 0x7f19e0100790 2024-04-25T02:07:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.294+0000 7f19d7e00640 1 -- 172.21.15.137:0/3049508862 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8010 (secure 0 0 0) 0x7f19c809b810 con 0x7f19e0100790 2024-04-25T02:07:02.301 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:02.301 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T02:07:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 10 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 msgr2=0x7f19c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 0x7f19c40a5050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f19d0005e30 tx=0x7f19d0030980 comp rx=0 tx=0).stop 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 msgr2=0x7f19e019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e019a0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19c800e9f0 tx=0x7f19c800edf0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 shutdown_connections 2024-04-25T02:07:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f19c40a2b90 0x7f19c40a5050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19e0101130 0x7f19e01a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19e0100790 0x7f19e019a0e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 --2- 172.21.15.137:0/3049508862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f19e00ffe30 0x7f19e0199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 >> 172.21.15.137:0/3049508862 conn(0x7f19e00fba10 msgr2=0x7f19e00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 shutdown_connections 2024-04-25T02:07:02.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:02.297+0000 7f19dfe00640 1 -- 172.21.15.137:0/3049508862 wait complete. 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:boot 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: fsmap 9 up:standby 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:02.576 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:02.576 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:02.576 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:02 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3049508862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:02.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:boot 2024-04-25T02:07:02.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: fsmap 9 up:standby 2024-04-25T02:07:02.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:07:02.749 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.749 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.749 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.749 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:02.749 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:02.750 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:02.750 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:02 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3049508862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:boot 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: fsmap 9 up:standby 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:02 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3049508862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:03.586 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:03 smithi137 ceph-mon[28303]: Deploying daemon mds.g on smithi137 2024-04-25T02:07:03.586 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:03 smithi137 ceph-mon[28303]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:03.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:03 smithi163 ceph-mon[32577]: Deploying daemon mds.g on smithi137 2024-04-25T02:07:03.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:03 smithi163 ceph-mon[32577]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:03.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:03 smithi174 ceph-mon[33171]: Deploying daemon mds.g on smithi137 2024-04-25T02:07:03.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:03 smithi174 ceph-mon[33171]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:04.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:04.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 -- 172.21.15.137:0/1764260502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4105320 msgr2=0x7f0cd41057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:04.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1764260502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4105320 0x7f0cd41057a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009ca0 tx=0x7f0ccc02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 -- 172.21.15.137:0/1764260502 shutdown_connections 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1764260502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4105320 0x7f0cd41057a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1764260502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4102970 0x7f0cd4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1764260502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 -- 172.21.15.137:0/1764260502 >> 172.21.15.137:0/1764260502 conn(0x7f0cd40fbc20 msgr2=0x7f0cd40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 -- 172.21.15.137:0/1764260502 shutdown_connections 2024-04-25T02:07:04.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.658+0000 7f0cd9400640 1 -- 172.21.15.137:0/1764260502 wait complete. 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.659+0000 7f0cd9400640 1 Processor -- start 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.659+0000 7f0cd9400640 1 -- start start 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4102970 0x7f0cd419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4105320 0x7f0cd41a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4113b90 con 0x7f0cd4102970 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4113a10 con 0x7f0cd4100000 2024-04-25T02:07:04.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd9400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4113d10 con 0x7f0cd4105320 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4102970 0x7f0cd419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32868/0 (socket says 172.21.15.137:32868) 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd2800640 1 -- 172.21.15.137:0/1536741947 learned_addr learned my addr 172.21.15.137:0/1536741947 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.660+0000 7f0cd3200640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4105320 0x7f0cd41a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 -- 172.21.15.137:0/1536741947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4105320 msgr2=0x7f0cd41a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4105320 0x7f0cd41a56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 -- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4102970 msgr2=0x7f0cd419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:04.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4102970 0x7f0cd419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 -- 172.21.15.137:0/1536741947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd41a5d10 con 0x7f0cd4100000 2024-04-25T02:07:04.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd2800640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400ea60 tx=0x7f0cc400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:04.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400cde0 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0cc40035f0 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4010720 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.661+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd41a5fa0 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.662+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd41a6410 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.663+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd40fd710 con 0x7f0cd4100000 2024-04-25T02:07:04.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.665+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0cc40037a0 con 0x7f0cd4100000 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.666+0000 7f0ccb400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 0x7f0cb80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.666+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0cc40cef60 con 0x7f0cd4100000 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.666+0000 7f0cd1e00640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 0x7f0cb80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:04.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.667+0000 7f0cd1e00640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 0x7f0cb80a50d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0cd419f600 tx=0x7f0cc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:04.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.670+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f0cc409c2c0 con 0x7f0cd4100000 2024-04-25T02:07:04.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.930+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd4062440 con 0x7f0cd4100000 2024-04-25T02:07:04.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.931+0000 7f0ccb400640 1 -- 172.21.15.137:0/1536741947 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8010 (secure 0 0 0) 0x7f0cc409bbc0 con 0x7f0cd4100000 2024-04-25T02:07:04.938 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:04.938 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T02:07:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 10 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.933+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 msgr2=0x7f0cb80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 0x7f0cb80a50d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0cd419f600 tx=0x7f0cc0005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 msgr2=0x7f0cd419e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400ea60 tx=0x7f0cc400ef20 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 shutdown_connections 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f0cb80a2c10 0x7f0cb80a50d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0cd4105320 0x7f0cd41a56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cd4102970 0x7f0cd419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 --2- 172.21.15.137:0/1536741947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0cd4100000 0x7f0cd419e0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 >> 172.21.15.137:0/1536741947 conn(0x7f0cd40fbc20 msgr2=0x7f0cd4100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:04.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 shutdown_connections 2024-04-25T02:07:04.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:04.934+0000 7f0cd9400640 1 -- 172.21.15.137:0/1536741947 wait complete. 2024-04-25T02:07:05.213 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 podman[66544]: 2024-04-25 02:07:05.026766459 +0000 UTC m=+0.227772935 container create 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:05 smithi137 ceph-mon[28303]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:05 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1536741947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 podman[66544]: 2024-04-25 02:07:05.288295368 +0000 UTC m=+0.489301867 container init 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 podman[66544]: 2024-04-25 02:07:05.300068133 +0000 UTC m=+0.501074622 container start 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 ceph-mds[66571]: -- 172.21.15.137:0/1604008407 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7a5763a40 con 0x55a7a5736800 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g[66565]: starting mds.g at 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 bash[66544]: 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 2024-04-25T02:07:05.783 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:07:05 smithi137 systemd[1]: Started Ceph mds.g for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:07:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:05 smithi163 ceph-mon[32577]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:05 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1536741947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:05.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:05 smithi174 ceph-mon[33171]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:05.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:05 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1536741947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.137:6838/4129277647,v1:172.21.15.137:6839/4129277647] up:boot 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: fsmap 10 up:standby 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:06.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:06 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.137:6838/4129277647,v1:172.21.15.137:6839/4129277647] up:boot 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: fsmap 10 up:standby 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:06.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:06 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:06.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.137:6838/4129277647,v1:172.21.15.137:6839/4129277647] up:boot 2024-04-25T02:07:06.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: fsmap 10 up:standby 2024-04-25T02:07:06.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:07:06.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:06.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:06.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:06.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:06 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:06.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2105709768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc10e280 msgr2=0x7f5cdc110740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2105709768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc10e280 0x7f5cdc110740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009860 tx=0x7f5cd402a340 comp rx=0 tx=0).stop 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2105709768 shutdown_connections 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2105709768 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc10e280 0x7f5cdc110740 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2105709768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 0x7f5cdc10dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2105709768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc06a590 0x7f5cdc10b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2105709768 >> 172.21.15.137:0/2105709768 conn(0x7f5cdc06e980 msgr2=0x7f5cdc070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2105709768 shutdown_connections 2024-04-25T02:07:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.172+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2105709768 wait complete. 2024-04-25T02:07:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.173+0000 7f5ce0e00640 1 Processor -- start 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 -- start start 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 0x7f5cdc1a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc115d50 con 0x7f5cdc10b820 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc115bd0 con 0x7f5cdc10e280 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5ce0e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc115ed0 con 0x7f5cdc06a590 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cd1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 0x7f5cdc1a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cd9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cda800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cda800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32910/0 (socket says 172.21.15.137:32910) 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cda800640 1 -- 172.21.15.137:0/2502326846 learned_addr learned my addr 172.21.15.137:0/2502326846 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.174+0000 7f5cd9e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:38842/0 (socket says 172.21.15.137:38842) 2024-04-25T02:07:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 -- 172.21.15.137:0/2502326846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 msgr2=0x7f5cdc1a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 -- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 msgr2=0x7f5cdc1a2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 0x7f5cdc1a2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 -- 172.21.15.137:0/2502326846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc1aa160 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cd9e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cda800640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40057c0 tx=0x7f5cd40326f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4037050 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc1aa3f0 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc1aa930 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cd4043070 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.175+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4003bb0 con 0x7f5cdc10e280 2024-04-25T02:07:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.176+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb8005290 con 0x7f5cdc10e280 2024-04-25T02:07:07.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.179+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5cd40035f0 con 0x7f5cdc10e280 2024-04-25T02:07:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.180+0000 7f5cd3400640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 0x7f5cc00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.180+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5cd40eef60 con 0x7f5cdc10e280 2024-04-25T02:07:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.180+0000 7f5cd9e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 0x7f5cc00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:07.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.181+0000 7f5cd9e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 0x7f5cc00a5050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc06a9b0 tx=0x7f5ccc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:07.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.182+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5cd40bc350 con 0x7f5cdc10e280 2024-04-25T02:07:07.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.431+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cb8005580 con 0x7f5cdc10e280 2024-04-25T02:07:07.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.432+0000 7f5cd3400640 1 -- 172.21.15.137:0/2502326846 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8839 (secure 0 0 0) 0x7f5cd40bbc50 con 0x7f5cdc10e280 2024-04-25T02:07:07.439 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:07.440 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T02:07:07.440 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 11 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.434+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 msgr2=0x7f5cc00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 0x7f5cc00a5050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc06a9b0 tx=0x7f5ccc009500 comp rx=0 tx=0).stop 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 msgr2=0x7f5cdc1a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40057c0 tx=0x7f5cd40326f0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 shutdown_connections 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5cc00a2b90 0x7f5cc00a5050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cdc10e280 0x7f5cdc1a9af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cdc10b820 0x7f5cdc1a2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 --2- 172.21.15.137:0/2502326846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cdc06a590 0x7f5cdc1a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 >> 172.21.15.137:0/2502326846 conn(0x7f5cdc06e980 msgr2=0x7f5cdc1139f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 shutdown_connections 2024-04-25T02:07:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:07.435+0000 7f5ce0e00640 1 -- 172.21.15.137:0/2502326846 wait complete. 2024-04-25T02:07:07.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:07 smithi137 ceph-mon[28303]: Deploying daemon mds.a on smithi137 2024-04-25T02:07:07.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:07 smithi137 ceph-mon[28303]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:07.539 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:07 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2502326846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:07 smithi163 ceph-mon[32577]: Deploying daemon mds.a on smithi137 2024-04-25T02:07:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:07 smithi163 ceph-mon[32577]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:07 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2502326846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:07 smithi174 ceph-mon[33171]: Deploying daemon mds.a on smithi137 2024-04-25T02:07:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:07 smithi174 ceph-mon[33171]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:07 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2502326846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:08.784 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:08 smithi137 systemd[1]: Starting Ceph mds.a for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:07:09.067 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:08 smithi137 podman[66893]: 2024-04-25 02:07:08.705551323 +0000 UTC m=+0.033660724 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:07:09.067 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:08 smithi137 podman[66893]: 2024-04-25 02:07:08.813812092 +0000 UTC m=+0.141921530 container create 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-25T02:07:09.067 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 podman[66893]: 2024-04-25 02:07:09.060006348 +0000 UTC m=+0.388115792 container init 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T02:07:09.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:09.502 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 podman[66893]: 2024-04-25 02:07:09.071378712 +0000 UTC m=+0.399488137 container start 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:07:09.502 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mds[66912]: -- 172.21.15.137:0/1479544298 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b42df9a40 con 0x559b42dccc00 2024-04-25T02:07:09.502 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a[66908]: starting mds.a at 2024-04-25T02:07:09.502 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 bash[66893]: 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 2024-04-25T02:07:09.502 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:07:09 smithi137 systemd[1]: Started Ceph mds.a for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.667+0000 7f02ed600640 1 -- 172.21.15.137:0/2469633782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8107bc0 msgr2=0x7f02e8107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.667+0000 7f02ed600640 1 --2- 172.21.15.137:0/2469633782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8107bc0 0x7f02e8107fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009ca0 tx=0x7f02d802a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 -- 172.21.15.137:0/2469633782 shutdown_connections 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 --2- 172.21.15.137:0/2469633782 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 0x7f02e8110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 --2- 172.21.15.137:0/2469633782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8108db0 0x7f02e8109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 --2- 172.21.15.137:0/2469633782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8107bc0 0x7f02e8107fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 -- 172.21.15.137:0/2469633782 >> 172.21.15.137:0/2469633782 conn(0x7f02e8076b80 msgr2=0x7f02e8078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 -- 172.21.15.137:0/2469633782 shutdown_connections 2024-04-25T02:07:09.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.668+0000 7f02ed600640 1 -- 172.21.15.137:0/2469633782 wait complete. 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 Processor -- start 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 -- start start 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8107bc0 0x7f02e819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 0x7f02e81a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f02e81139c0 con 0x7f02e8107bc0 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8113840 con 0x7f02e8108db0 2024-04-25T02:07:09.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.669+0000 7f02ed600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02e8113b40 con 0x7f02e8109770 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02e7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8107bc0 0x7f02e819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32938/0 (socket says 172.21.15.137:32938) 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 -- 172.21.15.137:0/2663287557 learned_addr learned my addr 172.21.15.137:0/2663287557 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02ecc00640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 0x7f02e81a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 -- 172.21.15.137:0/2663287557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 msgr2=0x7f02e81a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 0x7f02e81a55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 -- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8107bc0 msgr2=0x7f02e819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8107bc0 0x7f02e819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 -- 172.21.15.137:0/2663287557 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81a5c10 con 0x7f02e8108db0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02df400640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e9f0 tx=0x7f02d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.670+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d000cd80 con 0x7f02e8108db0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.671+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f02d0010930 con 0x7f02e8108db0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.671+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e81a5f00 con 0x7f02e8108db0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.671+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0018b00 con 0x7f02e8108db0 2024-04-25T02:07:09.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.671+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e81a6410 con 0x7f02e8108db0 2024-04-25T02:07:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.672+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e810ee80 con 0x7f02e8108db0 2024-04-25T02:07:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.674+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f02d0018ca0 con 0x7f02e8108db0 2024-04-25T02:07:09.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.676+0000 7f02e5600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 0x7f02cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:09.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.676+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f02d00cefd0 con 0x7f02e8108db0 2024-04-25T02:07:09.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.676+0000 7f02e7e00640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 0x7f02cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:09.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.677+0000 7f02e7e00640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 0x7f02cc0a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000f80 tx=0x7f02d8005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:09.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.679+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f02d009c330 con 0x7f02e8108db0 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:09 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:09 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:09.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.919+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02e80623e0 con 0x7f02e8108db0 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T02:07:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:09 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:09.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.921+0000 7f02e5600640 1 -- 172.21.15.137:0/2663287557 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f02d009bc30 con 0x7f02e8108db0 2024-04-25T02:07:09.928 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:09.928 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T02:07:09.928 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 12 2024-04-25T02:07:09.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 msgr2=0x7f02cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:09.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 0x7f02cc0a50d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02d8000f80 tx=0x7f02d8005f30 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 msgr2=0x7f02e819e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02d000e9f0 tx=0x7f02d000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 shutdown_connections 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02cc0a2c10 0x7f02cc0a50d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02e8109770 0x7f02e81a55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02e8108db0 0x7f02e819e580 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 --2- 172.21.15.137:0/2663287557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02e8107bc0 0x7f02e819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 >> 172.21.15.137:0/2663287557 conn(0x7f02e8076b80 msgr2=0x7f02e810c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.924+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 shutdown_connections 2024-04-25T02:07:09.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:09.925+0000 7f02ed600640 1 -- 172.21.15.137:0/2663287557 wait complete. 2024-04-25T02:07:10.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:10 smithi163 ceph-mon[32577]: Deploying daemon mds.b on smithi163 2024-04-25T02:07:10.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:10 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.137:6840/3132066952,v1:172.21.15.137:6841/3132066952] up:boot 2024-04-25T02:07:10.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:10 smithi163 ceph-mon[32577]: fsmap 11 up:standby 2024-04-25T02:07:10.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:10 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:07:10.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:10 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2663287557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:10.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:10 smithi137 ceph-mon[28303]: Deploying daemon mds.b on smithi163 2024-04-25T02:07:10.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:10 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.137:6840/3132066952,v1:172.21.15.137:6841/3132066952] up:boot 2024-04-25T02:07:10.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:10 smithi137 ceph-mon[28303]: fsmap 11 up:standby 2024-04-25T02:07:10.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:10 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:07:10.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:10 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2663287557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:10.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:10 smithi174 ceph-mon[33171]: Deploying daemon mds.b on smithi163 2024-04-25T02:07:10.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:10 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.137:6840/3132066952,v1:172.21.15.137:6841/3132066952] up:boot 2024-04-25T02:07:10.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:10 smithi174 ceph-mon[33171]: fsmap 11 up:standby 2024-04-25T02:07:10.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:10 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:07:10.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:10 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2663287557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:11.392 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 systemd[1]: Starting Ceph mds.b for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:07:11.781 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:11 smithi163 ceph-mon[32577]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:11.781 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 podman[62658]: 2024-04-25 02:07:11.430251354 +0000 UTC m=+0.018164567 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:07:11.781 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 podman[62658]: 2024-04-25 02:07:11.531157398 +0000 UTC m=+0.119070595 container create 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T02:07:11.781 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 podman[62658]: 2024-04-25 02:07:11.775442912 +0000 UTC m=+0.363356108 container init 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T02:07:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:11 smithi137 ceph-mon[28303]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:11.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:11 smithi174 ceph-mon[33171]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:11.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:12.142 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 podman[62658]: 2024-04-25 02:07:11.77843986 +0000 UTC m=+0.366353067 container start 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-25T02:07:12.142 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 ceph-mds[62677]: -- 172.21.15.163:0/513375812 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55896c91da40 con 0x55896c8f0c00 2024-04-25T02:07:12.142 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: starting mds.b at 2024-04-25T02:07:12.142 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 bash[62658]: 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 2024-04-25T02:07:12.142 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:11 smithi163 systemd[1]: Started Ceph mds.b for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.154+0000 7efe7aa00640 1 -- 172.21.15.137:0/823725514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74105570 msgr2=0x7efe7410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.154+0000 7efe7aa00640 1 --2- 172.21.15.137:0/823725514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74105570 0x7efe7410be00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009ca0 tx=0x7efe6c02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 -- 172.21.15.137:0/823725514 shutdown_connections 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 --2- 172.21.15.137:0/823725514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74105570 0x7efe7410be00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 --2- 172.21.15.137:0/823725514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe74104bb0 0x7efe74105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 --2- 172.21.15.137:0/823725514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe741039c0 0x7efe74103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 -- 172.21.15.137:0/823725514 >> 172.21.15.137:0/823725514 conn(0x7efe740fef30 msgr2=0x7efe74101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 -- 172.21.15.137:0/823725514 shutdown_connections 2024-04-25T02:07:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.155+0000 7efe7aa00640 1 -- 172.21.15.137:0/823725514 wait complete. 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 Processor -- start 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 -- start start 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 0x7efe741a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe7410f7b0 con 0x7efe741039c0 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efe7410f630 con 0x7efe74104bb0 2024-04-25T02:07:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe7aa00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe7410f930 con 0x7efe74105570 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe73e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe6b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe73e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49680/0 (socket says 172.21.15.137:49680) 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe6b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43460/0 (socket says 172.21.15.137:43460) 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe73e00640 1 -- 172.21.15.137:0/3925095114 learned_addr learned my addr 172.21.15.137:0/3925095114 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.156+0000 7efe78a00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 0x7efe741a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 -- 172.21.15.137:0/3925095114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 msgr2=0x7efe741a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 0x7efe741a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 -- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 msgr2=0x7efe74199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 -- 172.21.15.137:0/3925095114 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe741a1960 con 0x7efe74104bb0 2024-04-25T02:07:12.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe78a00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 0x7efe741a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe73e00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe6b400640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00e9f0 tx=0x7efe5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00ccc0 con 0x7efe74104bb0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe741a1c50 con 0x7efe74104bb0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efe5c010930 con 0x7efe74104bb0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c0189f0 con 0x7efe74104bb0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.157+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe741a21a0 con 0x7efe74104bb0 2024-04-25T02:07:12.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.159+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7410ac10 con 0x7efe74104bb0 2024-04-25T02:07:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.160+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7efe5c010ae0 con 0x7efe74104bb0 2024-04-25T02:07:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.162+0000 7efe71600640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 0x7efe580a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.162+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7efe5c0cefb0 con 0x7efe74104bb0 2024-04-25T02:07:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.162+0000 7efe73e00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 0x7efe580a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:12.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.162+0000 7efe73e00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 0x7efe580a5050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe640058c0 tx=0x7efe64005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:12.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.166+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7efe5c09c310 con 0x7efe74104bb0 2024-04-25T02:07:12.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.414+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe7402d170 con 0x7efe74104bb0 2024-04-25T02:07:12.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.415+0000 7efe71600640 1 -- 172.21.15.137:0/3925095114 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7efe5c09bc10 con 0x7efe74104bb0 2024-04-25T02:07:12.422 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:12.423 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-25T02:07:12.423 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 12 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 msgr2=0x7efe580a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 0x7efe580a5050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe640058c0 tx=0x7efe64005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 msgr2=0x7efe7419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00e9f0 tx=0x7efe5c00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 shutdown_connections 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efe580a2b90 0x7efe580a5050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe74105570 0x7efe741a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe74104bb0 0x7efe7419a280 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 --2- 172.21.15.137:0/3925095114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe741039c0 0x7efe74199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 >> 172.21.15.137:0/3925095114 conn(0x7efe740fef30 msgr2=0x7efe74107de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 shutdown_connections 2024-04-25T02:07:12.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:12.418+0000 7efe7aa00640 1 -- 172.21.15.137:0/3925095114 wait complete. 2024-04-25T02:07:13.233 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3925095114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:boot 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: fsmap 12 up:standby 2024-04-25T02:07:13.234 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:12 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:07:13.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3925095114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:boot 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: fsmap 12 up:standby 2024-04-25T02:07:13.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:12 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3925095114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:boot 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: fsmap 12 up:standby 2024-04-25T02:07:13.338 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:12 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:07:14.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:14.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.638+0000 7f045be00640 1 -- 172.21.15.137:0/1908465453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04541039a0 msgr2=0x7f0454103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:14.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.638+0000 7f045be00640 1 --2- 172.21.15.137:0/1908465453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04541039a0 0x7f0454103dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0448009900 tx=0x7f044802a410 comp rx=0 tx=0).stop 2024-04-25T02:07:14.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 -- 172.21.15.137:0/1908465453 shutdown_connections 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 --2- 172.21.15.137:0/1908465453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 0x7f045410bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 --2- 172.21.15.137:0/1908465453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0454104b90 0x7f0454105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 --2- 172.21.15.137:0/1908465453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04541039a0 0x7f0454103dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 -- 172.21.15.137:0/1908465453 >> 172.21.15.137:0/1908465453 conn(0x7f04540fef30 msgr2=0x7f0454101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 -- 172.21.15.137:0/1908465453 shutdown_connections 2024-04-25T02:07:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.639+0000 7f045be00640 1 -- 172.21.15.137:0/1908465453 wait complete. 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 Processor -- start 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 -- start start 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 0x7f045419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 0x7f04541a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f045410f750 con 0x7f0454104b90 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f045410f5d0 con 0x7f04541039a0 2024-04-25T02:07:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f045be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f045410f8d0 con 0x7f0454105550 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f0459400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f0458a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 0x7f045419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f0459400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43486/0 (socket says 172.21.15.137:43486) 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f0459e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 0x7f04541a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.640+0000 7f0459400640 1 -- 172.21.15.137:0/2643411654 learned_addr learned my addr 172.21.15.137:0/2643411654 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 -- 172.21.15.137:0/2643411654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 msgr2=0x7f04541a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 0x7f04541a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 -- 172.21.15.137:0/2643411654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 msgr2=0x7f0454199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 -- 172.21.15.137:0/2643411654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04541a19c0 con 0x7f0454104b90 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0459400640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0458a00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 0x7f045419a2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f044000e9f0 tx=0x7f044000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:14.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.641+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044000cd80 con 0x7f0454104b90 2024-04-25T02:07:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.642+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04400035f0 con 0x7f0454104b90 2024-04-25T02:07:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.642+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440010690 con 0x7f0454104b90 2024-04-25T02:07:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.642+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04541a1cb0 con 0x7f0454104b90 2024-04-25T02:07:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.642+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541a21b0 con 0x7f0454104b90 2024-04-25T02:07:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.643+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045410ac60 con 0x7f0454104b90 2024-04-25T02:07:14.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.647+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f04400037a0 con 0x7f0454104b90 2024-04-25T02:07:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.649+0000 7f0452000640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.649+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f04400ceeb0 con 0x7f0454104b90 2024-04-25T02:07:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.649+0000 7f0459400640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.650+0000 7f0459400640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 0x7f043c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04480096c0 tx=0x7f0448031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.653+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f044009c210 con 0x7f0454104b90 2024-04-25T02:07:14.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.962+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f045402d170 con 0x7f0454104b90 2024-04-25T02:07:14.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.963+0000 7f0452000640 1 -- 172.21.15.137:0/2643411654 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7f044009bb10 con 0x7f0454104b90 2024-04-25T02:07:14.970 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:14.971 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24488,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24512,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24526,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24559,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-25T02:07:14.971 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 13 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 msgr2=0x7f043c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 0x7f043c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04480096c0 tx=0x7f0448031640 comp rx=0 tx=0).stop 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 msgr2=0x7f045419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 0x7f045419a2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f044000e9f0 tx=0x7f044000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 shutdown_connections 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f043c0a2c10 0x7f043c0a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0454105550 0x7f04541a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0454104b90 0x7f045419a2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 --2- 172.21.15.137:0/2643411654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04541039a0 0x7f0454199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 >> 172.21.15.137:0/2643411654 conn(0x7f04540fef30 msgr2=0x7f0454107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 shutdown_connections 2024-04-25T02:07:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:14.966+0000 7f045be00640 1 -- 172.21.15.137:0/2643411654 wait complete. 2024-04-25T02:07:14.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:15.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:14 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:14 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:14 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:14 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:14 smithi163 ceph-mon[32577]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.152+0000 7ff135600640 1 -- 172.21.15.137:0/1146912392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1301015b0 msgr2=0x7ff1301019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.152+0000 7ff135600640 1 --2- 172.21.15.137:0/1146912392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1301015b0 0x7ff1301019d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff120009900 tx=0x7ff12002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.152+0000 7ff135600640 1 -- 172.21.15.137:0/1146912392 shutdown_connections 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.152+0000 7ff135600640 1 --2- 172.21.15.137:0/1146912392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff130103160 0x7ff1301099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.153+0000 7ff135600640 1 --2- 172.21.15.137:0/1146912392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff130102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.153+0000 7ff135600640 1 --2- 172.21.15.137:0/1146912392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1301015b0 0x7ff1301019d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.153+0000 7ff135600640 1 -- 172.21.15.137:0/1146912392 >> 172.21.15.137:0/1146912392 conn(0x7ff1300fcb20 msgr2=0x7ff1300fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:15.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.153+0000 7ff135600640 1 -- 172.21.15.137:0/1146912392 shutdown_connections 2024-04-25T02:07:15.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.153+0000 7ff135600640 1 -- 172.21.15.137:0/1146912392 wait complete. 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 Processor -- start 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 -- start start 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff13019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 0x7ff1301a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d3a0 con 0x7ff1301015b0 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d220 con 0x7ff1301027a0 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff135600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff13010d520 con 0x7ff130103160 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff12fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff12fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49694/0 (socket says 172.21.15.137:49694) 2024-04-25T02:07:15.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff12fe00640 1 -- 172.21.15.137:0/423911118 learned_addr learned my addr 172.21.15.137:0/423911118 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff12f400640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff13019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.154+0000 7ff134c00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 0x7ff1301a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 -- 172.21.15.137:0/423911118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 msgr2=0x7ff1301a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 0x7ff1301a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 -- 172.21.15.137:0/423911118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 msgr2=0x7ff13019a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff13019a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 -- 172.21.15.137:0/423911118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1301a1890 con 0x7ff1301015b0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12f400640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff13019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff134c00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 0x7ff1301a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12fe00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1200316a0 tx=0x7ff120032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12003f030 con 0x7ff1301015b0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1301a1b20 con 0x7ff1301015b0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.155+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff120003d00 con 0x7ff1301015b0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.156+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1301a2060 con 0x7ff1301015b0 2024-04-25T02:07:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.156+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120049060 con 0x7ff1301015b0 2024-04-25T02:07:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.157+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1301a2230 con 0x7ff1301015b0 2024-04-25T02:07:15.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.159+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff120042030 con 0x7ff1301015b0 2024-04-25T02:07:15.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.160+0000 7ff12cc00640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 0x7ff1140a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.160+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff1200ef450 con 0x7ff1301015b0 2024-04-25T02:07:15.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.161+0000 7ff12f400640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 0x7ff1140a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.161+0000 7ff12f400640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 0x7ff1140a5050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:15.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.165+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff1200bc200 con 0x7ff1301015b0 2024-04-25T02:07:15.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:14 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:14 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:14 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:14 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:14 smithi174 ceph-mon[33171]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:15.256 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:14 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.256 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:14 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.256 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:14 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.256 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:14 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:15.256 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:14 smithi137 ceph-mon[28303]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:15.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.388+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1301a2520 con 0x7ff1301015b0 2024-04-25T02:07:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.389+0000 7ff12cc00640 1 -- 172.21.15.137:0/423911118 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18539 (secure 0 0 0) 0x7ff1200c0500 con 0x7ff1301015b0 2024-04-25T02:07:15.397 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:15.397 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:06:19.116617+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 msgr2=0x7ff1140a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 0x7ff1140a5050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00b410 comp rx=0 tx=0).stop 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 msgr2=0x7ff130199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1200316a0 tx=0x7ff120032d70 comp rx=0 tx=0).stop 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 shutdown_connections 2024-04-25T02:07:15.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff1140a2b90 0x7ff1140a5050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff130103160 0x7ff1301a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1301027a0 0x7ff13019a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 --2- 172.21.15.137:0/423911118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1301015b0 0x7ff130199cd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 >> 172.21.15.137:0/423911118 conn(0x7ff1300fcb20 msgr2=0x7ff130073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 shutdown_connections 2024-04-25T02:07:15.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.392+0000 7ff135600640 1 -- 172.21.15.137:0/423911118 wait complete. 2024-04-25T02:07:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:07:15.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:07:15.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 -- 172.21.15.137:0/912314450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c1039c0 msgr2=0x7f7d0c103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 --2- 172.21.15.137:0/912314450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c103de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009900 tx=0x7f7cfc02a400 comp rx=0 tx=0).stop 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 -- 172.21.15.137:0/912314450 shutdown_connections 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 --2- 172.21.15.137:0/912314450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c105570 0x7f7d0c10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 --2- 172.21.15.137:0/912314450 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 0x7f7d0c105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 --2- 172.21.15.137:0/912314450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c103de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 -- 172.21.15.137:0/912314450 >> 172.21.15.137:0/912314450 conn(0x7f7d0c0fef30 msgr2=0x7f7d0c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 -- 172.21.15.137:0/912314450 shutdown_connections 2024-04-25T02:07:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.584+0000 7f7d11600640 1 -- 172.21.15.137:0/912314450 wait complete. 2024-04-25T02:07:15.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 Processor -- start 2024-04-25T02:07:15.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 -- start start 2024-04-25T02:07:15.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 0x7f7d0c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c105570 0x7f7d0c1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10f770 con 0x7f7d0c1039c0 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10f5f0 con 0x7f7d0c105570 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d11600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c10f8f0 con 0x7f7d0c104bb0 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d0aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.585+0000 7f7d0a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 0x7f7d0c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49710/0 (socket says 172.21.15.137:49710) 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 -- 172.21.15.137:0/3487032390 learned_addr learned my addr 172.21.15.137:0/3487032390 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0b400640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c105570 0x7f7d0c1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 -- 172.21.15.137:0/3487032390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 msgr2=0x7f7d0c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 0x7f7d0c19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 -- 172.21.15.137:0/3487032390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c105570 msgr2=0x7f7d0c1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c105570 0x7f7d0c1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 -- 172.21.15.137:0/3487032390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c1a19e0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d0aa00640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009230 tx=0x7f7cfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.586+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc03f030 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.587+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c1a1c70 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.587+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7cfc003d00 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.587+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc035070 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.587+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c1a2160 con 0x7f7d0c1039c0 2024-04-25T02:07:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.588+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0c10ace0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.590+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7cfc042030 con 0x7f7d0c1039c0 2024-04-25T02:07:15.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.591+0000 7f7d03400640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 0x7f7cf00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:15.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.592+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7cfc0ef3f0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.592+0000 7f7d0a000640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 0x7f7cf00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:15.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.592+0000 7f7d0a000640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 0x7f7cf00a5050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c19b2d0 tx=0x7f7cf8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.594+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7cfc0bc1a0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.794+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7d0c02d3c0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.795+0000 7f7d03400640 1 -- 172.21.15.137:0/3487032390 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f7cfc0c04a0 con 0x7f7d0c1039c0 2024-04-25T02:07:15.802 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.797+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 msgr2=0x7f7cf00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.797+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 0x7f7cf00a5050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c19b2d0 tx=0x7f7cf8005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.797+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 msgr2=0x7f7d0c199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.797+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009230 tx=0x7f7cfc0042f0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 shutdown_connections 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7cf00a2b90 0x7f7cf00a5050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d0c105570 0x7f7d0c1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d0c104bb0 0x7f7d0c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 --2- 172.21.15.137:0/3487032390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d0c1039c0 0x7f7d0c199dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 >> 172.21.15.137:0/3487032390 conn(0x7f7d0c0fef30 msgr2=0x7f7d0c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 shutdown_connections 2024-04-25T02:07:15.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:15.798+0000 7f7d11600640 1 -- 172.21.15.137:0/3487032390 wait complete. 2024-04-25T02:07:15.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:07:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 -- 172.21.15.137:0/2342524734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64100690 msgr2=0x7f5a64100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2342524734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64100690 0x7f5a64100ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009900 tx=0x7f5a5402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 -- 172.21.15.137:0/2342524734 shutdown_connections 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2342524734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64102240 0x7f5a64108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2342524734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64101880 0x7f5a64101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2342524734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64100690 0x7f5a64100ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 -- 172.21.15.137:0/2342524734 >> 172.21.15.137:0/2342524734 conn(0x7f5a640fbc20 msgr2=0x7f5a640fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 -- 172.21.15.137:0/2342524734 shutdown_connections 2024-04-25T02:07:16.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.002+0000 7f5a6b000640 1 -- 172.21.15.137:0/2342524734 wait complete. 2024-04-25T02:07:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 Processor -- start 2024-04-25T02:07:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 -- start start 2024-04-25T02:07:16.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 0x7f5a64104620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64102240 0x7f5a641031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6410c490 con 0x7f5a64102240 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6410c310 con 0x7f5a64101880 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.003+0000 7f5a6b000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6410c610 con 0x7f5a64100690 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43540/0 (socket says 172.21.15.137:43540) 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 -- 172.21.15.137:0/2302630676 learned_addr learned my addr 172.21.15.137:0/2302630676 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63e00640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 0x7f5a64104620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a69000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64102240 0x7f5a641031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 -- 172.21.15.137:0/2302630676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 msgr2=0x7f5a64104620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 0x7f5a64104620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 -- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64102240 msgr2=0x7f5a641031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64102240 0x7f5a641031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 -- 172.21.15.137:0/2302630676 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a64103a30 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63e00640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 0x7f5a64104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a63400640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000e9f0 tx=0x7f5a5000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000cd80 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5a50005520 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.004+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a641a1cd0 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.005+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50010690 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.005+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a641a21d0 con 0x7f5a64101880 2024-04-25T02:07:16.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.006+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a641a2400 con 0x7f5a64101880 2024-04-25T02:07:16.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.008+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5a500046c0 con 0x7f5a64101880 2024-04-25T02:07:16.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.009+0000 7f5a60c00640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 0x7f5a480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.010+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5a500cf1e0 con 0x7f5a64101880 2024-04-25T02:07:16.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.010+0000 7f5a63e00640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 0x7f5a480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.011+0000 7f5a63e00640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 0x7f5a480a5050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402a9e0 tx=0x7f5a54031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.014+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5a5009c540 con 0x7f5a64101880 2024-04-25T02:07:16.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:16.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:16.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2643411654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/423911118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:15 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3487032390' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:07:16.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.216+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5a641a2b60 con 0x7f5a64101880 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.217+0000 7f5a60c00640 1 -- 172.21.15.137:0/2302630676 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f5a5009be40 con 0x7f5a64101880 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-25T02:07:16.224 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-25T02:07:16.225 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:07:16.225 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 msgr2=0x7f5a480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 0x7f5a480a5050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a5402a9e0 tx=0x7f5a54031640 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 msgr2=0x7f5a64102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000e9f0 tx=0x7f5a5000edf0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 shutdown_connections 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5a480a2b90 0x7f5a480a5050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a64102240 0x7f5a641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a64101880 0x7f5a64102c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 --2- 172.21.15.137:0/2302630676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a64100690 0x7f5a64104620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.219+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 >> 172.21.15.137:0/2302630676 conn(0x7f5a640fbc20 msgr2=0x7f5a640fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.220+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 shutdown_connections 2024-04-25T02:07:16.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.220+0000 7f5a6b000640 1 -- 172.21.15.137:0/2302630676 wait complete. 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2643411654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/423911118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.242 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:15 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3487032390' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:07:16.244 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:07:16.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2643411654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/423911118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:16.251 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:15 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3487032390' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.427+0000 7f2226600640 1 -- 172.21.15.137:0/2111809389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22201020d0 msgr2=0x7f22201044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.427+0000 7f2226600640 1 --2- 172.21.15.137:0/2111809389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22201020d0 0x7f22201044c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2218009ca0 tx=0x7f221802a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 -- 172.21.15.137:0/2111809389 shutdown_connections 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 --2- 172.21.15.137:0/2111809389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220107330 0x7f2220109780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 --2- 172.21.15.137:0/2111809389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2220104a00 0x7f2220106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 --2- 172.21.15.137:0/2111809389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22201020d0 0x7f22201044c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 -- 172.21.15.137:0/2111809389 >> 172.21.15.137:0/2111809389 conn(0x7f22200fbae0 msgr2=0x7f22200fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:16.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 -- 172.21.15.137:0/2111809389 shutdown_connections 2024-04-25T02:07:16.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.428+0000 7f2226600640 1 -- 172.21.15.137:0/2111809389 wait complete. 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 Processor -- start 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 -- start start 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 0x7f2220199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 0x7f222019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2220107330 0x7f22201a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f222010d420 con 0x7f22201020d0 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f222010d2a0 con 0x7f2220107330 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2226600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f222010d5a0 con 0x7f2220104a00 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.429+0000 7f2225200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 0x7f2220199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f2225c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2220107330 0x7f22201a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 0x7f222019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f2225200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 0x7f2220199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49744/0 (socket says 172.21.15.137:49744) 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f2225200640 1 -- 172.21.15.137:0/2697688998 learned_addr learned my addr 172.21.15.137:0/2697688998 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 -- 172.21.15.137:0/2697688998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2220107330 msgr2=0x7f22201a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2220107330 0x7f22201a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 -- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 msgr2=0x7f2220199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 0x7f2220199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 -- 172.21.15.137:0/2697688998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22201a1880 con 0x7f2220104a00 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221fe00640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 0x7f222019a1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f220800e9c0 tx=0x7f220800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220800cd80 con 0x7f2220104a00 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22080035f0 con 0x7f2220104a00 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22201a1b70 con 0x7f2220104a00 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.430+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208010670 con 0x7f2220104a00 2024-04-25T02:07:16.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.431+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22201a2110 con 0x7f2220104a00 2024-04-25T02:07:16.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.432+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2220108e80 con 0x7f2220104a00 2024-04-25T02:07:16.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.433+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2208004020 con 0x7f2220104a00 2024-04-25T02:07:16.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.434+0000 7f221d600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 0x7f22040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:16.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.435+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f22080cef30 con 0x7f2220104a00 2024-04-25T02:07:16.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.435+0000 7f2225200640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 0x7f22040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:16.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.435+0000 7f2225200640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 0x7f22040a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2218031c10 tx=0x7f2218009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:16.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.439+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f220809c290 con 0x7f2220104a00 2024-04-25T02:07:16.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:16.640+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2220062340 con 0x7f2220104a00 2024-04-25T02:07:17.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.392+0000 7f221d600640 1 -- 172.21.15.137:0/2697688998 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f220809bb90 con 0x7f2220104a00 2024-04-25T02:07:17.402 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-25T02:07:17.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 msgr2=0x7f22040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 0x7f22040a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2218031c10 tx=0x7f2218009360 comp rx=0 tx=0).stop 2024-04-25T02:07:17.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 msgr2=0x7f222019a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 0x7f222019a1b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f220800e9c0 tx=0x7f220800ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 shutdown_connections 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22040a2c10 0x7f22040a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2220107330 0x7f22201a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2220104a00 0x7f222019a1b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 --2- 172.21.15.137:0/2697688998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22201020d0 0x7f2220199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.401+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 >> 172.21.15.137:0/2697688998 conn(0x7f22200fbae0 msgr2=0x7f2220101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:17.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.402+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 shutdown_connections 2024-04-25T02:07:17.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.402+0000 7f2226600640 1 -- 172.21.15.137:0/2697688998 wait complete. 2024-04-25T02:07:17.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:07:17.480 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:17 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2302630676' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T02:07:17.480 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:17 smithi137 ceph-mon[28303]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:17.480 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:17 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:17.543 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:17 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2302630676' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T02:07:17.543 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:17 smithi163 ceph-mon[32577]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:17.543 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:17 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:17.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 -- 172.21.15.137:0/3875369720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 msgr2=0x7fabb0101af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 --2- 172.21.15.137:0/3875369720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0101af0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faba0009900 tx=0x7faba002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 -- 172.21.15.137:0/3875369720 shutdown_connections 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 --2- 172.21.15.137:0/3875369720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 0x7fabb0109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 --2- 172.21.15.137:0/3875369720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb0102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 --2- 172.21.15.137:0/3875369720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0101af0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 -- 172.21.15.137:0/3875369720 >> 172.21.15.137:0/3875369720 conn(0x7fabb00fcc40 msgr2=0x7fabb00ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 -- 172.21.15.137:0/3875369720 shutdown_connections 2024-04-25T02:07:17.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.598+0000 7fabb5c00640 1 -- 172.21.15.137:0/3875369720 wait complete. 2024-04-25T02:07:17.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.599+0000 7fabb5c00640 1 Processor -- start 2024-04-25T02:07:17.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.599+0000 7fabb5c00640 1 -- start start 2024-04-25T02:07:17.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:17.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 0x7fabb01a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d410 con 0x7fabb01016d0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d290 con 0x7fabb0103280 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d590 con 0x7fabb01028c0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49764/0 (socket says 172.21.15.137:49764) 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 -- 172.21.15.137:0/1896344928 learned_addr learned my addr 172.21.15.137:0/1896344928 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabaf400640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabb5200640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 0x7fabb01a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 -- 172.21.15.137:0/1896344928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 msgr2=0x7fabb019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 -- 172.21.15.137:0/1896344928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 msgr2=0x7fabb01a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 0x7fabb01a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabafe00640 1 -- 172.21.15.137:0/1896344928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01a18c0 con 0x7fabb01016d0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.600+0000 7fabaf400640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabafe00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faba0009230 tx=0x7faba00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:17.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba003f030 con 0x7fabb01016d0 2024-04-25T02:07:17.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faba0003d00 con 0x7fabb01016d0 2024-04-25T02:07:17.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01a1b50 con 0x7fabb01016d0 2024-04-25T02:07:17.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0035070 con 0x7fabb01016d0 2024-04-25T02:07:17.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.601+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01a2040 con 0x7fabb01016d0 2024-04-25T02:07:17.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.602+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb01a2210 con 0x7fabb01016d0 2024-04-25T02:07:17.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.604+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7faba0042030 con 0x7fabb01016d0 2024-04-25T02:07:17.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.606+0000 7fabacc00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 0x7fab940a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:17.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.607+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7faba00ef1f0 con 0x7fabb01016d0 2024-04-25T02:07:17.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.607+0000 7fabaf400640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 0x7fab940a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:17.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.607+0000 7fabaf400640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 0x7fab940a5050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0095f0 tx=0x7fab9c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:17.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.611+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7faba00bbd90 con 0x7fabb01016d0 2024-04-25T02:07:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:17 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2302630676' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-25T02:07:17.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:17 smithi174 ceph-mon[33171]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:17.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:17 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:17.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:17.821+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fabb01a23e0 con 0x7fabb01016d0 2024-04-25T02:07:18.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.390+0000 7fabacc00640 1 -- 172.21.15.137:0/1896344928 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7faba00c0090 con 0x7fabb01016d0 2024-04-25T02:07:18.398 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 msgr2=0x7fab940a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 0x7fab940a5050 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0095f0 tx=0x7fab9c005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 msgr2=0x7fabb0199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faba0009230 tx=0x7faba00042f0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 shutdown_connections 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab940a2b90 0x7fab940a5050 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fabb0103280 0x7fabb01a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabb01028c0 0x7fabb019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 --2- 172.21.15.137:0/1896344928 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabb01016d0 0x7fabb0199c80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.395+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 >> 172.21.15.137:0/1896344928 conn(0x7fabb00fcc40 msgr2=0x7fabb0073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:18.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.397+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 shutdown_connections 2024-04-25T02:07:18.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.397+0000 7fabb5c00640 1 -- 172.21.15.137:0/1896344928 wait complete. 2024-04-25T02:07:18.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 -- 172.21.15.137:0/4165890293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38107330 msgr2=0x7fab38109780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 --2- 172.21.15.137:0/4165890293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38107330 0x7fab38109780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab30009860 tx=0x7fab3002a340 comp rx=0 tx=0).stop 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 -- 172.21.15.137:0/4165890293 shutdown_connections 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 --2- 172.21.15.137:0/4165890293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38107330 0x7fab38109780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 --2- 172.21.15.137:0/4165890293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38104a00 0x7fab38106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 --2- 172.21.15.137:0/4165890293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 -- 172.21.15.137:0/4165890293 >> 172.21.15.137:0/4165890293 conn(0x7fab380fbae0 msgr2=0x7fab380fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 -- 172.21.15.137:0/4165890293 shutdown_connections 2024-04-25T02:07:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.600+0000 7fab37200640 1 -- 172.21.15.137:0/4165890293 wait complete. 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.601+0000 7fab37200640 1 Processor -- start 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.601+0000 7fab37200640 1 -- start start 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38104a00 0x7fab38197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 0x7fab3819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab3810d400 con 0x7fab38104a00 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fab3810d280 con 0x7fab38107330 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab37200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fab3810d580 con 0x7fab381020d0 2024-04-25T02:07:18.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:40414/0 (socket says 172.21.15.137:40414) 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 -- 172.21.15.137:0/57088269 learned_addr learned my addr 172.21.15.137:0/57088269 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab2d400640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38104a00 0x7fab38197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab36800640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 0x7fab3819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 -- 172.21.15.137:0/57088269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 msgr2=0x7fab3819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 0x7fab3819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 -- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38104a00 msgr2=0x7fab38197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38104a00 0x7fab38197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab35e00640 1 -- 172.21.15.137:0/57088269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3819f5e0 con 0x7fab381020d0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.602+0000 7fab36800640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 0x7fab3819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab35e00640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab2800c420 tx=0x7fab28009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28003970 con 0x7fab381020d0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab28004520 con 0x7fab381020d0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3819f8d0 con 0x7fab381020d0 2024-04-25T02:07:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2800bb70 con 0x7fab381020d0 2024-04-25T02:07:18.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.603+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3819fe20 con 0x7fab381020d0 2024-04-25T02:07:18.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.604+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab380fd5d0 con 0x7fab381020d0 2024-04-25T02:07:18.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.606+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fab2801d020 con 0x7fab381020d0 2024-04-25T02:07:18.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.607+0000 7fab2f400640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 0x7fab1c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:18.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.608+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7fab280cf3e0 con 0x7fab381020d0 2024-04-25T02:07:18.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.608+0000 7fab2d400640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 0x7fab1c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:18.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.608+0000 7fab2d400640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 0x7fab1c0a5050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab38198ed0 tx=0x7fab2000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:18.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.610+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fab2809c4d0 con 0x7fab381020d0 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2697688998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T02:07:18.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T02:07:18.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:18.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:18 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:18.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2697688998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:18.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:18 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:18.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2697688998' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: osdmap e82: 12 total, 12 up, 12 in 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:07:18.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:18 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:07:18.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:18.848+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab38062340 con 0x7fab381020d0 2024-04-25T02:07:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.398+0000 7fab2f400640 1 -- 172.21.15.137:0/57088269 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fab2809bdd0 con 0x7fab381020d0 2024-04-25T02:07:19.406 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T02:07:19.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 msgr2=0x7fab1c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 0x7fab1c0a5050 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab38198ed0 tx=0x7fab2000b410 comp rx=0 tx=0).stop 2024-04-25T02:07:19.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 msgr2=0x7fab381979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab2800c420 tx=0x7fab28009f90 comp rx=0 tx=0).stop 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 shutdown_connections 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab1c0a2b90 0x7fab1c0a5050 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab38107330 0x7fab3819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab38104a00 0x7fab38197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 --2- 172.21.15.137:0/57088269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab381020d0 0x7fab381979c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 >> 172.21.15.137:0/57088269 conn(0x7fab380fbae0 msgr2=0x7fab38102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.404+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 shutdown_connections 2024-04-25T02:07:19.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.405+0000 7fab37200640 1 -- 172.21.15.137:0/57088269 wait complete. 2024-04-25T02:07:19.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:19.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 -- 172.21.15.137:0/3423492886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 msgr2=0x7f2754104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 --2- 172.21.15.137:0/3423492886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f2754104e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f273c009900 tx=0x7f273c02a410 comp rx=0 tx=0).stop 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 -- 172.21.15.137:0/3423492886 shutdown_connections 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 --2- 172.21.15.137:0/3423492886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2754105370 0x7f275410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 --2- 172.21.15.137:0/3423492886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f2754104e30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 --2- 172.21.15.137:0/3423492886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f27541037c0 0x7f2754103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 -- 172.21.15.137:0/3423492886 >> 172.21.15.137:0/3423492886 conn(0x7f27540fed50 msgr2=0x7f2754101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 -- 172.21.15.137:0/3423492886 shutdown_connections 2024-04-25T02:07:19.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.594+0000 7f2753e00640 1 -- 172.21.15.137:0/3423492886 wait complete. 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.595+0000 7f2753e00640 1 Processor -- start 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.595+0000 7f2753e00640 1 -- start start 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.595+0000 7f2753e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27541037c0 0x7f2754199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754105370 0x7f27541a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:19.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f275410f5c0 con 0x7f27541049b0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f275410f440 con 0x7f27541037c0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f275410f740 con 0x7f2754105370 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2752a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27541037c0 0x7f2754199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49814/0 (socket says 172.21.15.137:49814) 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 -- 172.21.15.137:0/3103250707 learned_addr learned my addr 172.21.15.137:0/3103250707 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f2753400640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754105370 0x7f27541a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 -- 172.21.15.137:0/3103250707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754105370 msgr2=0x7f27541a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754105370 0x7f27541a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 -- 172.21.15.137:0/3103250707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27541037c0 msgr2=0x7f2754199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27541037c0 0x7f2754199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.596+0000 7f274a000640 1 -- 172.21.15.137:0/3103250707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541a1790 con 0x7f27541049b0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f274a000640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f273c0316a0 tx=0x7f273c032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c03f030 con 0x7f27541049b0 2024-04-25T02:07:19.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f273c003d00 con 0x7f27541049b0 2024-04-25T02:07:19.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27541a1a20 con 0x7f27541049b0 2024-04-25T02:07:19.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c035070 con 0x7f27541049b0 2024-04-25T02:07:19.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.597+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541a1f60 con 0x7f27541049b0 2024-04-25T02:07:19.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.598+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275410aae0 con 0x7f27541049b0 2024-04-25T02:07:19.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.600+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f273c042030 con 0x7f27541049b0 2024-04-25T02:07:19.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.601+0000 7f274be00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 0x7f27380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:19.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.601+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f273c0ef760 con 0x7f27541049b0 2024-04-25T02:07:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.602+0000 7f2752a00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 0x7f27380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:19.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.602+0000 7f2752a00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 0x7f27380a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2754104810 tx=0x7f2744005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:19.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.604+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f273c0bc120 con 0x7f27541049b0 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: pgmap v308: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T02:07:19.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/57088269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:19 smithi163 ceph-mon[32577]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: pgmap v308: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T02:07:19.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/57088269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:19 smithi174 ceph-mon[33171]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: pgmap v308: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1896344928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: osdmap e83: 12 total, 12 up, 12 in 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/57088269' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-25T02:07:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:19 smithi137 ceph-mon[28303]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-25T02:07:19.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.796+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f275402d370 con 0x7f27541049b0 2024-04-25T02:07:19.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.797+0000 7f274be00640 1 -- 172.21.15.137:0/3103250707 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22315 (secure 0 0 0) 0x7f273c0c0420 con 0x7f27541049b0 2024-04-25T02:07:19.805 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:19.805 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":84,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:18.851713+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 msgr2=0x7f27380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 0x7f27380a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2754104810 tx=0x7f2744005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 msgr2=0x7f275419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f273c0316a0 tx=0x7f273c032d70 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 shutdown_connections 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f27380a2c10 0x7f27380a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754105370 0x7f27541a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27541049b0 0x7f275419a0b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 --2- 172.21.15.137:0/3103250707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27541037c0 0x7f2754199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 >> 172.21.15.137:0/3103250707 conn(0x7f27540fed50 msgr2=0x7f2754107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.800+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 shutdown_connections 2024-04-25T02:07:19.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:19.801+0000 7f2753e00640 1 -- 172.21.15.137:0/3103250707 wait complete. 2024-04-25T02:07:19.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:20.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 -- 172.21.15.137:0/3797287416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e381049d0 msgr2=0x7f6e38104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 --2- 172.21.15.137:0/3797287416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e381049d0 0x7f6e38104e50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009900 tx=0x7f6e2002a410 comp rx=0 tx=0).stop 2024-04-25T02:07:20.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 -- 172.21.15.137:0/3797287416 shutdown_connections 2024-04-25T02:07:20.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 --2- 172.21.15.137:0/3797287416 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e38105390 0x7f6e3810bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 --2- 172.21.15.137:0/3797287416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e381049d0 0x7f6e38104e50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 --2- 172.21.15.137:0/3797287416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381037e0 0x7f6e38103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 -- 172.21.15.137:0/3797287416 >> 172.21.15.137:0/3797287416 conn(0x7f6e380fed70 msgr2=0x7f6e38101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 -- 172.21.15.137:0/3797287416 shutdown_connections 2024-04-25T02:07:20.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.016+0000 7f6e37200640 1 -- 172.21.15.137:0/3797287416 wait complete. 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 Processor -- start 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 -- start start 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 0x7f6e38199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381049d0 0x7f6e3819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3810f5e0 con 0x7f6e38105390 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3810f460 con 0x7f6e381037e0 2024-04-25T02:07:20.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e37200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3810f760 con 0x7f6e381049d0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.017+0000 7f6e36800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 0x7f6e38199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e36800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49828/0 (socket says 172.21.15.137:49828) 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e36800640 1 -- 172.21.15.137:0/1744842090 learned_addr learned my addr 172.21.15.137:0/1744842090 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e2d400640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381049d0 0x7f6e3819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 -- 172.21.15.137:0/1744842090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381049d0 msgr2=0x7f6e3819a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381049d0 0x7f6e3819a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 -- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 msgr2=0x7f6e381a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 -- 172.21.15.137:0/1744842090 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e381a17e0 con 0x7f6e381037e0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e36800640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e35e00640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 0x7f6e38199bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9c0 tx=0x7f6e2800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:20.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.018+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800ccc0 con 0x7f6e381037e0 2024-04-25T02:07:20.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.019+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e381a1ad0 con 0x7f6e381037e0 2024-04-25T02:07:20.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.019+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e280035f0 con 0x7f6e381037e0 2024-04-25T02:07:20.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.019+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800ce60 con 0x7f6e381037e0 2024-04-25T02:07:20.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.019+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a1ff0 con 0x7f6e381037e0 2024-04-25T02:07:20.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.020+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3810aaa0 con 0x7f6e381037e0 2024-04-25T02:07:20.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.022+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6e280037a0 con 0x7f6e381037e0 2024-04-25T02:07:20.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.023+0000 7f6e2f400640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 0x7f6e1c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.023+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f6e280cf3a0 con 0x7f6e381037e0 2024-04-25T02:07:20.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.023+0000 7f6e2d400640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 0x7f6e1c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.024+0000 7f6e2d400640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 0x7f6e1c0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e20005ab0 tx=0x7f6e20005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:20.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.026+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6e2809c3b0 con 0x7f6e381037e0 2024-04-25T02:07:20.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.226+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e3802d3d0 con 0x7f6e381037e0 2024-04-25T02:07:20.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.228+0000 7f6e2f400640 1 -- 172.21.15.137:0/1744842090 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22315 (secure 0 0 0) 0x7f6e2809bcb0 con 0x7f6e381037e0 2024-04-25T02:07:20.236 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:20.236 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":84,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:18.851713+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:20.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 msgr2=0x7f6e1c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 0x7f6e1c0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e20005ab0 tx=0x7f6e20005a20 comp rx=0 tx=0).stop 2024-04-25T02:07:20.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 msgr2=0x7f6e38199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 0x7f6e38199bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9c0 tx=0x7f6e2800ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 shutdown_connections 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6e1c0a2c10 0x7f6e1c0a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e38105390 0x7f6e381a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e381049d0 0x7f6e3819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 --2- 172.21.15.137:0/1744842090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6e381037e0 0x7f6e38199bc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 >> 172.21.15.137:0/1744842090 conn(0x7f6e380fed70 msgr2=0x7f6e38107c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 shutdown_connections 2024-04-25T02:07:20.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.232+0000 7f6e37200640 1 -- 172.21.15.137:0/1744842090 wait complete. 2024-04-25T02:07:20.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 -- 172.21.15.137:0/2684035038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 msgr2=0x7f1568103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 --2- 172.21.15.137:0/2684035038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568103dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1558009900 tx=0x7f155802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 -- 172.21.15.137:0/2684035038 shutdown_connections 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 --2- 172.21.15.137:0/2684035038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568105550 0x7f156810bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 --2- 172.21.15.137:0/2684035038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568104b90 0x7f1568105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 --2- 172.21.15.137:0/2684035038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568103dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 -- 172.21.15.137:0/2684035038 >> 172.21.15.137:0/2684035038 conn(0x7f15680fef30 msgr2=0x7f1568101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 -- 172.21.15.137:0/2684035038 shutdown_connections 2024-04-25T02:07:20.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.461+0000 7f156de00640 1 -- 172.21.15.137:0/2684035038 wait complete. 2024-04-25T02:07:20.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.462+0000 7f156de00640 1 Processor -- start 2024-04-25T02:07:20.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.462+0000 7f156de00640 1 -- start start 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.462+0000 7f156de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f156de00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568104b90 0x7f156819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f156de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f156de00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f156810f7a0 con 0x7f1568105550 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f156de00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f156810f620 con 0x7f1568104b90 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f156de00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f156810f920 con 0x7f15681039a0 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49852/0 (socket says 172.21.15.137:49852) 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 -- 172.21.15.137:0/2870473580 learned_addr learned my addr 172.21.15.137:0/2870473580 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1566a00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f155fe00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568104b90 0x7f156819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 -- 172.21.15.137:0/2870473580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 msgr2=0x7f1568199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 -- 172.21.15.137:0/2870473580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568104b90 msgr2=0x7f156819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568104b90 0x7f156819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.463+0000 7f1567400640 1 -- 172.21.15.137:0/2870473580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15681a19e0 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f1567400640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f156000eb10 tx=0x7f156000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560004b20 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15681a1cd0 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1560004cc0 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15600107f0 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.464+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15681a21d0 con 0x7f1568105550 2024-04-25T02:07:20.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.465+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156810acc0 con 0x7f1568105550 2024-04-25T02:07:20.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.467+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f1560005020 con 0x7f1568105550 2024-04-25T02:07:20.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.469+0000 7f156ca00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 0x7f15480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:20.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.469+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f15600cf430 con 0x7f1568105550 2024-04-25T02:07:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.470+0000 7f1566a00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 0x7f15480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:20.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.470+0000 7f1566a00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 0x7f15480a5050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f155802a9e0 tx=0x7f1558005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:20.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.474+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f156009c4e0 con 0x7f1568105550 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3103250707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:20 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1744842090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3103250707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:20 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1744842090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T02:07:20.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: osdmap e84: 12 total, 12 up, 12 in 2024-04-25T02:07:20.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-25T02:07:20.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-25T02:07:20.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-25T02:07:20.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3103250707' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:20 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1744842090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:20.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:20.719+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f156802d370 con 0x7f1568105550 2024-04-25T02:07:21.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.411+0000 7f156ca00640 1 -- 172.21.15.137:0/2870473580 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f156009bde0 con 0x7f1568105550 2024-04-25T02:07:21.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.415+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 msgr2=0x7f15480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:21.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 0x7f15480a5050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f155802a9e0 tx=0x7f1558005a20 comp rx=0 tx=0).stop 2024-04-25T02:07:21.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 msgr2=0x7f15681a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:21.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f156000eb10 tx=0x7f156000c2d0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 shutdown_connections 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f15480a2b90 0x7f15480a5050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1568105550 0x7f15681a1370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1568104b90 0x7f156819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 --2- 172.21.15.137:0/2870473580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15681039a0 0x7f1568199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 >> 172.21.15.137:0/2870473580 conn(0x7f15680fef30 msgr2=0x7f1568107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 shutdown_connections 2024-04-25T02:07:21.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.416+0000 7f156de00640 1 -- 172.21.15.137:0/2870473580 wait complete. 2024-04-25T02:07:21.446 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-25T02:07:21.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: pgmap v311: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:active 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T02:07:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:21 smithi163 ceph-mon[32577]: Cluster is now healthy 2024-04-25T02:07:21.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 -- 172.21.15.137:0/3157256853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d010dd50 msgr2=0x7f78d0110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:21.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 --2- 172.21.15.137:0/3157256853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d010dd50 0x7f78d0110140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009cd0 tx=0x7f78c802a8e0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 -- 172.21.15.137:0/3157256853 shutdown_connections 2024-04-25T02:07:21.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 --2- 172.21.15.137:0/3157256853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d010dd50 0x7f78d0110140 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 --2- 172.21.15.137:0/3157256853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d00741a0 0x7f78d0074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 --2- 172.21.15.137:0/3157256853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d0075780 0x7f78d0073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 -- 172.21.15.137:0/3157256853 >> 172.21.15.137:0/3157256853 conn(0x7f78d00fccf0 msgr2=0x7f78d00ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:21.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 -- 172.21.15.137:0/3157256853 shutdown_connections 2024-04-25T02:07:21.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.652+0000 7f78d5a00640 1 -- 172.21.15.137:0/3157256853 wait complete. 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 Processor -- start 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 -- start start 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d0075780 0x7f78d019e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d010dd50 0x7f78d01a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0113b30 con 0x7f78d00741a0 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01139b0 con 0x7f78d010dd50 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78d5a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0113cb0 con 0x7f78d0075780 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.653+0000 7f78cea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78ce000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d0075780 0x7f78d019e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:21.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39824/0 (socket says 172.21.15.137:39824) 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 -- 172.21.15.137:0/2426462669 learned_addr learned my addr 172.21.15.137:0/2426462669 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cf400640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d010dd50 0x7f78d01a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 -- 172.21.15.137:0/2426462669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d0075780 msgr2=0x7f78d019e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d0075780 0x7f78d019e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 -- 172.21.15.137:0/2426462669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d010dd50 msgr2=0x7f78d01a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d010dd50 0x7f78d01a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 -- 172.21.15.137:0/2426462669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d01a5d80 con 0x7f78d00741a0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78cea00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78c000e9f0 tx=0x7f78c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.654+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c000cd80 con 0x7f78d00741a0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.655+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78c0010930 con 0x7f78d00741a0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.655+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d01a6070 con 0x7f78d00741a0 2024-04-25T02:07:21.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.655+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0018b00 con 0x7f78d00741a0 2024-04-25T02:07:21.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.655+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d01a65c0 con 0x7f78d00741a0 2024-04-25T02:07:21.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.656+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d0103f20 con 0x7f78d00741a0 2024-04-25T02:07:21.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.658+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f78c0018ca0 con 0x7f78d00741a0 2024-04-25T02:07:21.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.659+0000 7f78c7400640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 0x7f78b40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:21.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.659+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f78c00cf350 con 0x7f78d00741a0 2024-04-25T02:07:21.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.659+0000 7f78ce000640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 0x7f78b40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:21.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.660+0000 7f78ce000640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 0x7f78b40a5050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78d019f670 tx=0x7f78bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:21.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.664+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f78c009bd10 con 0x7f78d00741a0 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: pgmap v311: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:active 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T02:07:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T02:07:21.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:21 smithi174 ceph-mon[33171]: Cluster is now healthy 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: pgmap v311: 97 pgs: 13 creating+peering, 57 unknown, 27 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 1 op/s 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: osdmap e85: 12 total, 12 up, 12 in 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] up:active 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:21.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-25T02:07:21.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-25T02:07:21.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:21 smithi137 ceph-mon[28303]: Cluster is now healthy 2024-04-25T02:07:21.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:21.906+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f78d0062340 con 0x7f78d00741a0 2024-04-25T02:07:22.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.370+0000 7f78c7400640 1 -- 172.21.15.137:0/2426462669 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f78c00a0010 con 0x7f78d00741a0 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.374+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 msgr2=0x7f78b40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.374+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 0x7f78b40a5050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78d019f670 tx=0x7f78bc005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.374+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 msgr2=0x7f78d019e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.374+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78c000e9f0 tx=0x7f78c000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 shutdown_connections 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f78b40a2b90 0x7f78b40a5050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f78d010dd50 0x7f78d01a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f78d0075780 0x7f78d019e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 --2- 172.21.15.137:0/2426462669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f78d00741a0 0x7f78d019e160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 >> 172.21.15.137:0/2426462669 conn(0x7f78d00fccf0 msgr2=0x7f78d01010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 shutdown_connections 2024-04-25T02:07:22.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.375+0000 7f78d5a00640 1 -- 172.21.15.137:0/2426462669 wait complete. 2024-04-25T02:07:22.410 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.599+0000 7f26c8200640 1 -- 172.21.15.137:0/3516117521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0102240 msgr2=0x7f26c0108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.599+0000 7f26c8200640 1 --2- 172.21.15.137:0/3516117521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0102240 0x7f26c0108ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009ca0 tx=0x7f26b802a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 -- 172.21.15.137:0/3516117521 shutdown_connections 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 --2- 172.21.15.137:0/3516117521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0102240 0x7f26c0108ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 --2- 172.21.15.137:0/3516117521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0101880 0x7f26c0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 --2- 172.21.15.137:0/3516117521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0100690 0x7f26c0100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 -- 172.21.15.137:0/3516117521 >> 172.21.15.137:0/3516117521 conn(0x7f26c00fbc00 msgr2=0x7f26c00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:22.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 -- 172.21.15.137:0/3516117521 shutdown_connections 2024-04-25T02:07:22.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.600+0000 7f26c8200640 1 -- 172.21.15.137:0/3516117521 wait complete. 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 Processor -- start 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 -- start start 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0101880 0x7f26c0102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0102240 0x7f26c01031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26c010c490 con 0x7f26c0100690 2024-04-25T02:07:22.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f26c010c310 con 0x7f26c0101880 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.601+0000 7f26c8200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26c010c610 con 0x7f26c0102240 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c6200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0102240 0x7f26c01031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39844/0 (socket says 172.21.15.137:39844) 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 -- 172.21.15.137:0/2284902301 learned_addr learned my addr 172.21.15.137:0/2284902301 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c4e00640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0101880 0x7f26c0102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 -- 172.21.15.137:0/2284902301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0102240 msgr2=0x7f26c01031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0102240 0x7f26c01031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 -- 172.21.15.137:0/2284902301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0101880 msgr2=0x7f26c0102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0101880 0x7f26c0102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 -- 172.21.15.137:0/2284902301 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c0103a30 con 0x7f26c0100690 2024-04-25T02:07:22.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.602+0000 7f26c5800640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9c0 tx=0x7f26b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.603+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b400cd80 con 0x7f26c0100690 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.603+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c01a1c60 con 0x7f26c0100690 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.603+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26b40035f0 con 0x7f26c0100690 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.603+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4010670 con 0x7f26c0100690 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.603+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c01a2160 con 0x7f26c0100690 2024-04-25T02:07:22.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.604+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c01a2390 con 0x7f26c0100690 2024-04-25T02:07:22.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.606+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f26b40037a0 con 0x7f26c0100690 2024-04-25T02:07:22.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.607+0000 7f26be000640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 0x7f26a80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:22.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.608+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f26b40cf400 con 0x7f26c0100690 2024-04-25T02:07:22.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.608+0000 7f26c4e00640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 0x7f26a80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:22.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.608+0000 7f26c4e00640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 0x7f26a80a5050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f26c0104390 tx=0x7f26ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:22.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.610+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f26b409c410 con 0x7f26c0100690 2024-04-25T02:07:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T02:07:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T02:07:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T02:07:22.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T02:07:22.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T02:07:22.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T02:07:22.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:22 smithi174 ceph-mon[33171]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T02:07:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:22 smithi137 ceph-mon[28303]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T02:07:22.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:22.851+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f26c01a2560 con 0x7f26c0100690 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2870473580' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2426462669' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-04-25T02:07:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:22 smithi163 ceph-mon[32577]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-04-25T02:07:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.373+0000 7f26be000640 1 -- 172.21.15.137:0/2284902301 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f26b409bd10 con 0x7f26c0100690 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 msgr2=0x7f26a80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 0x7f26a80a5050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f26c0104390 tx=0x7f26ac005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 msgr2=0x7f26c0104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9c0 tx=0x7f26b400ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 shutdown_connections 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f26a80a2b90 0x7f26a80a5050 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26c0102240 0x7f26c01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26c0101880 0x7f26c0102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 --2- 172.21.15.137:0/2284902301 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26c0100690 0x7f26c0104620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.377+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 >> 172.21.15.137:0/2284902301 conn(0x7f26c00fbc00 msgr2=0x7f26c00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.378+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 shutdown_connections 2024-04-25T02:07:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.378+0000 7f26c8200640 1 -- 172.21.15.137:0/2284902301 wait complete. 2024-04-25T02:07:23.410 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T02:07:23.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 -- 172.21.15.137:0/137155475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077ce0 msgr2=0x7fee74078580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 --2- 172.21.15.137:0/137155475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077ce0 0x7fee74078580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009900 tx=0x7fee6c02a400 comp rx=0 tx=0).stop 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 -- 172.21.15.137:0/137155475 shutdown_connections 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 --2- 172.21.15.137:0/137155475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077ce0 0x7fee74078580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 --2- 172.21.15.137:0/137155475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077340 0x7fee740777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 --2- 172.21.15.137:0/137155475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee74076520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 -- 172.21.15.137:0/137155475 >> 172.21.15.137:0/137155475 conn(0x7fee740fef30 msgr2=0x7fee74101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 -- 172.21.15.137:0/137155475 shutdown_connections 2024-04-25T02:07:23.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.596+0000 7fee79400640 1 -- 172.21.15.137:0/137155475 wait complete. 2024-04-25T02:07:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.597+0000 7fee79400640 1 Processor -- start 2024-04-25T02:07:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.597+0000 7fee79400640 1 -- start start 2024-04-25T02:07:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:23.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 0x7fee7419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 0x7fee741a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee74113b90 con 0x7fee74076100 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee74113a10 con 0x7fee74077340 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee79400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee74113d10 con 0x7fee74077ce0 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee69e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 0x7fee7419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39862/0 (socket says 172.21.15.137:39862) 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 -- 172.21.15.137:0/2410727569 learned_addr learned my addr 172.21.15.137:0/2410727569 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee73200640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 0x7fee741a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 -- 172.21.15.137:0/2410727569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 msgr2=0x7fee741a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 0x7fee741a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 -- 172.21.15.137:0/2410727569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 msgr2=0x7fee7419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:23.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 0x7fee7419e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee72800640 1 -- 172.21.15.137:0/2410727569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee741a5d60 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee73200640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 0x7fee741a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.598+0000 7fee69e00640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 0x7fee7419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee72800640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee6400e9f0 tx=0x7fee6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6400cd80 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee64010930 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee741a5ff0 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64018b00 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.599+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee741a6500 con 0x7fee74076100 2024-04-25T02:07:23.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.600+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee74110310 con 0x7fee74076100 2024-04-25T02:07:23.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.602+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fee64018ca0 con 0x7fee74076100 2024-04-25T02:07:23.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.605+0000 7fee6be00640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 0x7fee580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:23.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.605+0000 7fee69e00640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 0x7fee580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:23.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.605+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fee640cf360 con 0x7fee74076100 2024-04-25T02:07:23.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.606+0000 7fee69e00640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 0x7fee580a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009fd0 tx=0x7fee5c009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:23.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.608+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fee6409c370 con 0x7fee74076100 2024-04-25T02:07:23.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: pgmap v313: 97 pgs: 13 creating+peering, 15 unknown, 69 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-04-25T02:07:23.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T02:07:23.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T02:07:23.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: Cluster is now healthy 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-25T02:07:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:23 smithi174 ceph-mon[33171]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: pgmap v313: 97 pgs: 13 creating+peering, 15 unknown, 69 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: Cluster is now healthy 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-25T02:07:23.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:23 smithi137 ceph-mon[28303]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-25T02:07:23.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:23.846+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fee7402d170 con 0x7fee74076100 2024-04-25T02:07:23.892 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: 2024-04-25T02:07:23.517+0000 7f31f2aaf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:07:23.892 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: 2024-04-25T02:07:23.517+0000 7f31f2aaf700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T02:07:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: pgmap v313: 97 pgs: 13 creating+peering, 15 unknown, 69 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 4 op/s 2024-04-25T02:07:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T02:07:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2284902301' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: Cluster is now healthy 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-04-25T02:07:23.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:23 smithi163 ceph-mon[32577]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-25T02:07:24.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.386+0000 7fee6be00640 1 -- 172.21.15.137:0/2410727569 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fee6409bc70 con 0x7fee74076100 2024-04-25T02:07:24.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 msgr2=0x7fee580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 0x7fee580a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009fd0 tx=0x7fee5c009680 comp rx=0 tx=0).stop 2024-04-25T02:07:24.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 msgr2=0x7fee7419e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee6400e9f0 tx=0x7fee6400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 shutdown_connections 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fee580a2c90 0x7fee580a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee74077ce0 0x7fee741a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee74077340 0x7fee7419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 --2- 172.21.15.137:0/2410727569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee74076100 0x7fee7419e190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 >> 172.21.15.137:0/2410727569 conn(0x7fee740fef30 msgr2=0x7fee74100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 shutdown_connections 2024-04-25T02:07:24.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.389+0000 7fee79400640 1 -- 172.21.15.137:0/2410727569 wait complete. 2024-04-25T02:07:24.419 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-25T02:07:24.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-25T02:07:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 -- 172.21.15.137:0/2504151323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda14104b90 msgr2=0x7fda14105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 --2- 172.21.15.137:0/2504151323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda14104b90 0x7fda14105010 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009900 tx=0x7fd9fc02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 -- 172.21.15.137:0/2504151323 shutdown_connections 2024-04-25T02:07:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 --2- 172.21.15.137:0/2504151323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 0x7fda1410bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 --2- 172.21.15.137:0/2504151323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda14104b90 0x7fda14105010 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 --2- 172.21.15.137:0/2504151323 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda141039a0 0x7fda14103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 -- 172.21.15.137:0/2504151323 >> 172.21.15.137:0/2504151323 conn(0x7fda140feef0 msgr2=0x7fda14101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:24.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 -- 172.21.15.137:0/2504151323 shutdown_connections 2024-04-25T02:07:24.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.616+0000 7fda18e00640 1 -- 172.21.15.137:0/2504151323 wait complete. 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 Processor -- start 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 -- start start 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 0x7fda14199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 0x7fda1419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 0x7fda141a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410f7a0 con 0x7fda14104b90 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410f620 con 0x7fda141039a0 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda18e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda1410f920 con 0x7fda14105550 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda09400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 0x7fda1419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda11e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 0x7fda14199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda09400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 0x7fda1419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39884/0 (socket says 172.21.15.137:39884) 2024-04-25T02:07:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.617+0000 7fda09400640 1 -- 172.21.15.137:0/4142227900 learned_addr learned my addr 172.21.15.137:0/4142227900 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda12800640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 0x7fda141a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 -- 172.21.15.137:0/4142227900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 msgr2=0x7fda141a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 0x7fda141a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 -- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 msgr2=0x7fda1419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 0x7fda1419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 -- 172.21.15.137:0/4142227900 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda141a19b0 con 0x7fda141039a0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda11e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 0x7fda14199da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e9c0 tx=0x7fda0400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0400cd80 con 0x7fda141039a0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda04010930 con 0x7fda141039a0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04018a30 con 0x7fda141039a0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.618+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda141a1ca0 con 0x7fda141039a0 2024-04-25T02:07:24.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.619+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda141a2190 con 0x7fda141039a0 2024-04-25T02:07:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.619+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1410abf0 con 0x7fda141039a0 2024-04-25T02:07:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.621+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fda0401f020 con 0x7fda141039a0 2024-04-25T02:07:24.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.622+0000 7fda0b400640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 0x7fd9f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:24.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.623+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fda040ceff0 con 0x7fda141039a0 2024-04-25T02:07:24.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.623+0000 7fda09400640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 0x7fd9f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:24.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.623+0000 7fda09400640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 0x7fd9f80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000c00 tx=0x7fd9fc005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:24.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.627+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fda0409c040 con 0x7fda141039a0 2024-04-25T02:07:24.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T02:07:24.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T02:07:24.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:07:24.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-25T02:07:24.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:07:24.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.840+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fda14061b80 con 0x7fd9f80a2c10 2024-04-25T02:07:24.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.870+0000 7fda0b400640 1 -- 172.21.15.137:0/4142227900 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fda14061b80 con 0x7fd9f80a2c10 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.872+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 msgr2=0x7fd9f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.872+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 0x7fd9f80a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000c00 tx=0x7fd9fc005a20 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.872+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 msgr2=0x7fda14199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.872+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 0x7fda14199da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e9c0 tx=0x7fda0400ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 shutdown_connections 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd9f80a2c10 0x7fd9f80a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda14105550 0x7fda141a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda14104b90 0x7fda1419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 --2- 172.21.15.137:0/4142227900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda141039a0 0x7fda14199da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:24.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 >> 172.21.15.137:0/4142227900 conn(0x7fda140feef0 msgr2=0x7fda14107dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:24.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 shutdown_connections 2024-04-25T02:07:24.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:24.873+0000 7fda18e00640 1 -- 172.21.15.137:0/4142227900 wait complete. 2024-04-25T02:07:24.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:24 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T02:07:24.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:24 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T02:07:24.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:24 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:07:24.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:24 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-25T02:07:24.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:24 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:07:24.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-25T02:07:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:24 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-25T02:07:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:24 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2410727569' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-25T02:07:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:24 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:07:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:24 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-04-25T02:07:24.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:24 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 -- 172.21.15.137:0/3824651397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68102980 msgr2=0x7fdf68102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 --2- 172.21.15.137:0/3824651397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68102980 0x7fdf68102e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009ca0 tx=0x7fdf5002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 -- 172.21.15.137:0/3824651397 shutdown_connections 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 --2- 172.21.15.137:0/3824651397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68103340 0x7fdf68109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 --2- 172.21.15.137:0/3824651397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68102980 0x7fdf68102e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 --2- 172.21.15.137:0/3824651397 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68101790 0x7fdf68101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 -- 172.21.15.137:0/3824651397 >> 172.21.15.137:0/3824651397 conn(0x7fdf680fcd20 msgr2=0x7fdf680ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 -- 172.21.15.137:0/3824651397 shutdown_connections 2024-04-25T02:07:25.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.080+0000 7fdf6e200640 1 -- 172.21.15.137:0/3824651397 wait complete. 2024-04-25T02:07:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.081+0000 7fdf6e200640 1 Processor -- start 2024-04-25T02:07:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 -- start start 2024-04-25T02:07:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68102980 0x7fdf681980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68103340 0x7fdf6819f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6810d540 con 0x7fdf68103340 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6810d3c0 con 0x7fdf68101790 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf6e200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6810d6c0 con 0x7fdf68102980 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf67400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf67400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:42732/0 (socket says 172.21.15.137:42732) 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf67400640 1 -- 172.21.15.137:0/51934293 learned_addr learned my addr 172.21.15.137:0/51934293 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:25.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf67e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68103340 0x7fdf6819f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.082+0000 7fdf66a00640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68102980 0x7fdf681980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 -- 172.21.15.137:0/51934293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68102980 msgr2=0x7fdf681980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68102980 0x7fdf681980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 -- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68103340 msgr2=0x7fdf6819f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68103340 0x7fdf6819f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 -- 172.21.15.137:0/51934293 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6819f780 con 0x7fdf68101790 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf67400640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800e9c0 tx=0x7fdf5800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800cd80 con 0x7fdf68101790 2024-04-25T02:07:25.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf580035f0 con 0x7fdf68101790 2024-04-25T02:07:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6819fa70 con 0x7fdf68101790 2024-04-25T02:07:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58010690 con 0x7fdf68101790 2024-04-25T02:07:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.083+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6819ffe0 con 0x7fdf68101790 2024-04-25T02:07:25.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.085+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf68108ab0 con 0x7fdf68101790 2024-04-25T02:07:25.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.086+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdf580037a0 con 0x7fdf68101790 2024-04-25T02:07:25.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.088+0000 7fdf5fe00640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 0x7fdf480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.088+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fdf580cf330 con 0x7fdf68101790 2024-04-25T02:07:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.088+0000 7fdf66a00640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 0x7fdf480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.089+0000 7fdf66a00640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 0x7fdf480a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf50006010 tx=0x7fdf50009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:25.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.091+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fdf5809c340 con 0x7fdf68101790 2024-04-25T02:07:25.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:07:24.847+0000 7f597a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:07:25.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:07:24.847+0000 7f597a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:07:25.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:07:24.847+0000 7f597a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:07:25.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:07:24.847+0000 7f597a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:07:25.284 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:07:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:07:24.847+0000 7f597a400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:07:25.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.321+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdf68061b80 con 0x7fdf480a2c10 2024-04-25T02:07:25.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.361+0000 7fdf5fe00640 1 -- 172.21.15.137:0/51934293 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdf68061b80 con 0x7fdf480a2c10 2024-04-25T02:07:25.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 msgr2=0x7fdf480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 0x7fdf480a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf50006010 tx=0x7fdf50009360 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 msgr2=0x7fdf68197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800e9c0 tx=0x7fdf5800ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 shutdown_connections 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdf480a2c10 0x7fdf480a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdf68103340 0x7fdf6819f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf68102980 0x7fdf681980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 --2- 172.21.15.137:0/51934293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf68101790 0x7fdf68197b60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 >> 172.21.15.137:0/51934293 conn(0x7fdf680fcd20 msgr2=0x7fdf68105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 shutdown_connections 2024-04-25T02:07:25.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.364+0000 7fdf6e200640 1 -- 172.21.15.137:0/51934293 wait complete. 2024-04-25T02:07:25.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 -- 172.21.15.137:0/3001017169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 msgr2=0x7fca10105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 --2- 172.21.15.137:0/3001017169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca10105010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009900 tx=0x7fc9fc02a410 comp rx=0 tx=0).stop 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 -- 172.21.15.137:0/3001017169 shutdown_connections 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 --2- 172.21.15.137:0/3001017169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca1010bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 --2- 172.21.15.137:0/3001017169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca10105010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.587+0000 7fca17000640 1 --2- 172.21.15.137:0/3001017169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 0x7fca10103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.588+0000 7fca17000640 1 -- 172.21.15.137:0/3001017169 >> 172.21.15.137:0/3001017169 conn(0x7fca100fef30 msgr2=0x7fca10101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:25.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.588+0000 7fca17000640 1 -- 172.21.15.137:0/3001017169 shutdown_connections 2024-04-25T02:07:25.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.588+0000 7fca17000640 1 -- 172.21.15.137:0/3001017169 wait complete. 2024-04-25T02:07:25.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 Processor -- start 2024-04-25T02:07:25.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 -- start start 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 0x7fca10199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca1019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010f7a0 con 0x7fca10105550 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010f620 con 0x7fca10104b90 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca17000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010f920 con 0x7fca101039a0 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca15000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca0f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca1019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 0x7fca10199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca15000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39946/0 (socket says 172.21.15.137:39946) 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.589+0000 7fca15000640 1 -- 172.21.15.137:0/768832519 learned_addr learned my addr 172.21.15.137:0/768832519 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 -- 172.21.15.137:0/768832519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 msgr2=0x7fca10199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 0x7fca10199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 -- 172.21.15.137:0/768832519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 msgr2=0x7fca1019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca1019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 -- 172.21.15.137:0/768832519 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca101a19c0 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca0f400640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca1019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca15000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca0800eb10 tx=0x7fca0800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08004b20 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca08004cc0 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca101a1cb0 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080107f0 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.590+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca101a21b0 con 0x7fca10105550 2024-04-25T02:07:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.591+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1010acc0 con 0x7fca10105550 2024-04-25T02:07:25.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.594+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fca08005020 con 0x7fca10105550 2024-04-25T02:07:25.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.596+0000 7fca0cc00640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 0x7fc9f40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.597+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7fca080cf5c0 con 0x7fca10105550 2024-04-25T02:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.597+0000 7fca0fe00640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 0x7fc9f40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:25.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.597+0000 7fca0fe00640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 0x7fc9f40a5050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca1019b280 tx=0x7fca00005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:25.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.601+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fca0809c5d0 con 0x7fca10105550 2024-04-25T02:07:25.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:25 smithi137 ceph-mon[28303]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 11 op/s 2024-04-25T02:07:25.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.830+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fca10061b80 con 0x7fc9f40a2b90 2024-04-25T02:07:25.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.844+0000 7fca0cc00640 1 -- 172.21.15.137:0/768832519 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fca10061b80 con 0x7fc9f40a2b90 2024-04-25T02:07:25.850 INFO:teuthology.orchestra.run.smithi137.stdout:/volumes/qa/sv_0/eb5f566a-11db-4d9a-b2e2-836748bf9158 2024-04-25T02:07:25.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 msgr2=0x7fc9f40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 0x7fc9f40a5050 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca1019b280 tx=0x7fca00005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 msgr2=0x7fca101a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fca0800eb10 tx=0x7fca0800c2d0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 shutdown_connections 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc9f40a2b90 0x7fc9f40a5050 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca10105550 0x7fca101a1320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca10104b90 0x7fca1019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 --2- 172.21.15.137:0/768832519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca101039a0 0x7fca10199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 >> 172.21.15.137:0/768832519 conn(0x7fca100fef30 msgr2=0x7fca10107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.846+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 shutdown_connections 2024-04-25T02:07:25.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:25.847+0000 7fca17000640 1 -- 172.21.15.137:0/768832519 wait complete. 2024-04-25T02:07:25.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-25T02:07:25.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:25 smithi163 ceph-mon[32577]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 11 op/s 2024-04-25T02:07:25.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:25 smithi174 ceph-mon[33171]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 11 op/s 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.062+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3740064532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 msgr2=0x7f4cb41092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.062+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3740064532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb41092f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009900 tx=0x7f4c9c02a410 comp rx=0 tx=0).stop 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3740064532 shutdown_connections 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3740064532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4109830 0x7f4cb41100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3740064532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb41092f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3740064532 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4107c80 0x7f4cb41080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3740064532 >> 172.21.15.137:0/3740064532 conn(0x7f4cb4076c10 msgr2=0x7f4cb4079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:26.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3740064532 shutdown_connections 2024-04-25T02:07:26.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.063+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3740064532 wait complete. 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 Processor -- start 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 -- start start 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4107c80 0x7f4cb419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 0x7f4cb41a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4113a80 con 0x7f4cb4108e70 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4113900 con 0x7f4cb4109830 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4113c00 con 0x7f4cb4107c80 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39970/0 (socket says 172.21.15.137:39970) 2024-04-25T02:07:26.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb2000640 1 -- 172.21.15.137:0/3050323617 learned_addr learned my addr 172.21.15.137:0/3050323617 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.064+0000 7f4cb3400640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 0x7f4cb41a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2a00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4107c80 0x7f4cb419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 -- 172.21.15.137:0/3050323617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4107c80 msgr2=0x7f4cb419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4107c80 0x7f4cb419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 -- 172.21.15.137:0/3050323617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 msgr2=0x7f4cb41a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 0x7f4cb41a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 -- 172.21.15.137:0/3050323617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb41a5c20 con 0x7f4cb4108e70 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb3400640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 0x7f4cb41a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cb2000640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0316a0 tx=0x7f4c9c032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c03f030 con 0x7f4cb4108e70 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4c9c003d00 con 0x7f4cb4108e70 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.065+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c035070 con 0x7f4cb4108e70 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.066+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb41a5eb0 con 0x7f4cb4108e70 2024-04-25T02:07:26.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.066+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb41a6320 con 0x7f4cb4108e70 2024-04-25T02:07:26.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.067+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb410eed0 con 0x7f4cb4108e70 2024-04-25T02:07:26.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.069+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4c9c042030 con 0x7f4cb4108e70 2024-04-25T02:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.070+0000 7f4cab400640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 0x7f4c940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.070+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f4c9c0eef80 con 0x7f4cb4108e70 2024-04-25T02:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.071+0000 7f4cb2a00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 0x7f4c940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.071+0000 7f4cb2a00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 0x7f4c940a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4108cd0 tx=0x7f4ca4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.075+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4c9c0bb940 con 0x7f4cb4108e70 2024-04-25T02:07:26.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.305+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4cb4061c10 con 0x7f4c940a2c10 2024-04-25T02:07:26.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.355+0000 7f4cab400640 1 -- 172.21.15.137:0/3050323617 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4cb4061c10 con 0x7f4c940a2c10 2024-04-25T02:07:26.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 msgr2=0x7f4c940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 0x7f4c940a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4108cd0 tx=0x7f4ca4005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 msgr2=0x7f4cb419e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0316a0 tx=0x7f4c9c032d70 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 shutdown_connections 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4c940a2c10 0x7f4c940a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4cb4109830 0x7f4cb41a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cb4108e70 0x7f4cb419e540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 --2- 172.21.15.137:0/3050323617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4cb4107c80 0x7f4cb419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 >> 172.21.15.137:0/3050323617 conn(0x7f4cb4076c10 msgr2=0x7f4cb410c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.358+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 shutdown_connections 2024-04-25T02:07:26.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.359+0000 7f4cb3e00640 1 -- 172.21.15.137:0/3050323617 wait complete. 2024-04-25T02:07:26.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-25T02:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.583+0000 7fa4f7200640 1 -- 172.21.15.137:0/1873375579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00741a0 msgr2=0x7fa4f0074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.583+0000 7fa4f7200640 1 --2- 172.21.15.137:0/1873375579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00741a0 0x7fa4f0074620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009900 tx=0x7fa4d802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 -- 172.21.15.137:0/1873375579 shutdown_connections 2024-04-25T02:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 --2- 172.21.15.137:0/1873375579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f010dd50 0x7fa4f0110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 --2- 172.21.15.137:0/1873375579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f00741a0 0x7fa4f0074620 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 --2- 172.21.15.137:0/1873375579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f0075780 0x7fa4f0073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 -- 172.21.15.137:0/1873375579 >> 172.21.15.137:0/1873375579 conn(0x7fa4f00fccf0 msgr2=0x7fa4f00ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 -- 172.21.15.137:0/1873375579 shutdown_connections 2024-04-25T02:07:26.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.584+0000 7fa4f7200640 1 -- 172.21.15.137:0/1873375579 wait complete. 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 Processor -- start 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 -- start start 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f00741a0 0x7fa4f019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0075780 0x7fa4f019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0113b80 con 0x7fa4f010dd50 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0113a00 con 0x7fa4f00741a0 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.585+0000 7fa4f7200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0113d00 con 0x7fa4f0075780 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39988/0 (socket says 172.21.15.137:39988) 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 -- 172.21.15.137:0/824907343 learned_addr learned my addr 172.21.15.137:0/824907343 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:26.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4e7400640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0075780 0x7fa4f019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4efe00640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f00741a0 0x7fa4f019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 -- 172.21.15.137:0/824907343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0075780 msgr2=0x7fa4f019e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0075780 0x7fa4f019e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 -- 172.21.15.137:0/824907343 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f00741a0 msgr2=0x7fa4f019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f00741a0 0x7fa4f019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 -- 172.21.15.137:0/824907343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f01a5db0 con 0x7fa4f010dd50 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.586+0000 7fa4f5200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800eb10 tx=0x7fa4e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.587+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8004b20 con 0x7fa4f010dd50 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.587+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f01a60a0 con 0x7fa4f010dd50 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.587+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e8004cc0 con 0x7fa4f010dd50 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.587+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80107f0 con 0x7fa4f010dd50 2024-04-25T02:07:26.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.587+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f01a6610 con 0x7fa4f010dd50 2024-04-25T02:07:26.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.588+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0103e10 con 0x7fa4f010dd50 2024-04-25T02:07:26.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.590+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa4e8005020 con 0x7fa4f010dd50 2024-04-25T02:07:26.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.591+0000 7fa4ed600640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 0x7fa4d40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:26.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.591+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7fa4e80cf5d0 con 0x7fa4f010dd50 2024-04-25T02:07:26.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.592+0000 7fa4efe00640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 0x7fa4d40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:26.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.592+0000 7fa4efe00640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 0x7fa4d40a5050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009bd0 tx=0x7fa4e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:26.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.596+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa4e809c4e0 con 0x7fa4f010dd50 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-04-25T02:07:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-04-25T02:07:26.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:26 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-04-25T02:07:26.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.828+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa4f0061b80 con 0x7fa4d40a2b90 2024-04-25T02:07:26.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.840+0000 7fa4ed600640 1 -- 172.21.15.137:0/824907343 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa4f0061b80 con 0x7fa4d40a2b90 2024-04-25T02:07:26.846 INFO:teuthology.orchestra.run.smithi137.stdout:/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.842+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 msgr2=0x7fa4d40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.842+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 0x7fa4d40a5050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009bd0 tx=0x7fa4e0005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.842+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 msgr2=0x7fa4f01a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.842+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800eb10 tx=0x7fa4e800c2d0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 shutdown_connections 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa4d40a2b90 0x7fa4d40a5050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f010dd50 0x7fa4f01a5740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4f0075780 0x7fa4f019e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 --2- 172.21.15.137:0/824907343 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4f00741a0 0x7fa4f019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 >> 172.21.15.137:0/824907343 conn(0x7fa4f00fccf0 msgr2=0x7fa4f0100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 shutdown_connections 2024-04-25T02:07:26.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:26.843+0000 7fa4f7200640 1 -- 172.21.15.137:0/824907343 wait complete. 2024-04-25T02:07:26.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-04-25T02:07:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-04-25T02:07:26.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:26 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-04-25T02:07:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='client.24650 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='client.24662 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-04-25T02:07:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:26 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 -- 172.21.15.137:0/1421496356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01017b0 msgr2=0x7f48d0101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 --2- 172.21.15.137:0/1421496356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01017b0 0x7f48d0101bd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009ca0 tx=0x7f48c002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 -- 172.21.15.137:0/1421496356 shutdown_connections 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 --2- 172.21.15.137:0/1421496356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 0x7f48d0109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 --2- 172.21.15.137:0/1421496356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01029a0 0x7f48d0102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 --2- 172.21.15.137:0/1421496356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01017b0 0x7f48d0101bd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 -- 172.21.15.137:0/1421496356 >> 172.21.15.137:0/1421496356 conn(0x7f48d00fcd20 msgr2=0x7f48d00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 -- 172.21.15.137:0/1421496356 shutdown_connections 2024-04-25T02:07:27.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.057+0000 7f48d7200640 1 -- 172.21.15.137:0/1421496356 wait complete. 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.058+0000 7f48d7200640 1 Processor -- start 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 -- start start 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01029a0 0x7f48d0073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 0x7f48d0074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010d560 con 0x7f48d01017b0 2024-04-25T02:07:27.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010d3e0 con 0x7f48d0103360 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d7200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010d6e0 con 0x7f48d01029a0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48cfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48cfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40008/0 (socket says 172.21.15.137:40008) 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48cfe00640 1 -- 172.21.15.137:0/3785556503 learned_addr learned my addr 172.21.15.137:0/3785556503 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48cf400640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01029a0 0x7f48d0073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.059+0000 7f48d5200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 0x7f48d0074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 -- 172.21.15.137:0/3785556503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01029a0 msgr2=0x7f48d0073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01029a0 0x7f48d0073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 -- 172.21.15.137:0/3785556503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 msgr2=0x7f48d0074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 0x7f48d0074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 -- 172.21.15.137:0/3785556503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d0074900 con 0x7f48d01017b0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48cfe00640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f80 tx=0x7f48c0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c002faa0 con 0x7f48d01017b0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.060+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f48c002fc40 con 0x7f48d01017b0 2024-04-25T02:07:27.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.061+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0046940 con 0x7f48d01017b0 2024-04-25T02:07:27.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.061+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d01a1c90 con 0x7f48d01017b0 2024-04-25T02:07:27.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.061+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d01a2180 con 0x7f48d01017b0 2024-04-25T02:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.062+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d0108a70 con 0x7f48d01017b0 2024-04-25T02:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.064+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f48c0030c30 con 0x7f48d01017b0 2024-04-25T02:07:27.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.066+0000 7f48ccc00640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 0x7f48b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.066+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8211+0+0 (secure 0 0 0) 0x7f48c00f03e0 con 0x7f48d01017b0 2024-04-25T02:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.066+0000 7f48cf400640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 0x7f48b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.067+0000 7f48cf400640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 0x7f48b40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48d0075260 tx=0x7f48b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.069+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f48c00bd380 con 0x7f48d01017b0 2024-04-25T02:07:27.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.312+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48d0062340 con 0x7f48d01017b0 2024-04-25T02:07:27.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.314+0000 7f48ccc00640 1 -- 172.21.15.137:0/3785556503 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f48c00bcc80 con 0x7f48d01017b0 2024-04-25T02:07:27.321 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:27.321 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:07:27.321 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 msgr2=0x7f48b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 0x7f48b40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48d0075260 tx=0x7f48b8005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 msgr2=0x7f48d00754f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f80 tx=0x7f48c0031ee0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 shutdown_connections 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f48b40a2c10 0x7f48b40a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d0103360 0x7f48d0074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48d01029a0 0x7f48d0073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 --2- 172.21.15.137:0/3785556503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48d01017b0 0x7f48d00754f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.317+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 >> 172.21.15.137:0/3785556503 conn(0x7f48d00fcd20 msgr2=0x7f48d0105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.318+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 shutdown_connections 2024-04-25T02:07:27.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.318+0000 7f48d7200640 1 -- 172.21.15.137:0/3785556503 wait complete. 2024-04-25T02:07:27.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:07:27.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 -- 172.21.15.137:0/112423550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed0108740 msgr2=0x7f5ed010ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/112423550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed0108740 0x7f5ed010ab70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009890 tx=0x7f5ec002a360 comp rx=0 tx=0).stop 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 -- 172.21.15.137:0/112423550 shutdown_connections 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/112423550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed010b530 0x7f5ed01143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/112423550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed0111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/112423550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed0108740 0x7f5ed010ab70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 -- 172.21.15.137:0/112423550 >> 172.21.15.137:0/112423550 conn(0x7f5ed006e980 msgr2=0x7f5ed0070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 -- 172.21.15.137:0/112423550 shutdown_connections 2024-04-25T02:07:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.544+0000 7f5ed5e00640 1 -- 172.21.15.137:0/112423550 wait complete. 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 Processor -- start 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 -- start start 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed01a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 0x7f5ed01a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0117f50 con 0x7f5ed010b0b0 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed0117dd0 con 0x7f5ed0108740 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.545+0000 7f5ed5e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed01180d0 con 0x7f5ed010b530 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ece000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed01a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 0x7f5ed01a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ece000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed01a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40032/0 (socket says 172.21.15.137:40032) 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:42812/0 (socket says 172.21.15.137:42812) 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ece000640 1 -- 172.21.15.137:0/2499684298 learned_addr learned my addr 172.21.15.137:0/2499684298 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 -- 172.21.15.137:0/2499684298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 msgr2=0x7f5ed01a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 -- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 msgr2=0x7f5ed01a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed01a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 -- 172.21.15.137:0/2499684298 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed01aa1c0 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecea00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.546+0000 7f5ecf400640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 0x7f5ed01a9b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009fd0 tx=0x7f5ec800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.547+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800ce20 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.547+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ec8004b20 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.547+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8010790 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.547+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed01aa4b0 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.547+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed01aaa50 con 0x7f5ed010b530 2024-04-25T02:07:27.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.548+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed0113590 con 0x7f5ed010b530 2024-04-25T02:07:27.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.550+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ec8005020 con 0x7f5ed010b530 2024-04-25T02:07:27.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.551+0000 7f5ed4a00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 0x7f5eb40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.551+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f5ec80cf850 con 0x7f5ed010b530 2024-04-25T02:07:27.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.551+0000 7f5ecea00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 0x7f5eb40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.552+0000 7f5ecea00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 0x7f5eb40a5160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0030650 tx=0x7f5ec0005780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.555+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5ec809c600 con 0x7f5ed010b530 2024-04-25T02:07:27.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.757+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ed0062340 con 0x7f5ed010b530 2024-04-25T02:07:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.759+0000 7f5ed4a00640 1 -- 172.21.15.137:0/2499684298 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7f5ec809bf00 con 0x7f5ed010b530 2024-04-25T02:07:27.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:27.766 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 msgr2=0x7f5eb40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 0x7f5eb40a5160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0030650 tx=0x7f5ec0005780 comp rx=0 tx=0).stop 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 msgr2=0x7f5ed01a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 0x7f5ed01a9b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009fd0 tx=0x7f5ec800ef10 comp rx=0 tx=0).stop 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 shutdown_connections 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5eb40a2ca0 0x7f5eb40a5160 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ed010b530 0x7f5ed01a9b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ed010b0b0 0x7f5ed01a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 --2- 172.21.15.137:0/2499684298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ed0108740 0x7f5ed01a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 >> 172.21.15.137:0/2499684298 conn(0x7f5ed006e980 msgr2=0x7f5ed006f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:27.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 shutdown_connections 2024-04-25T02:07:27.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.763+0000 7f5ed5e00640 1 -- 172.21.15.137:0/2499684298 wait complete. 2024-04-25T02:07:27.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: pgmap v315: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 769 B/s rd, 3.8 KiB/s wr, 12 op/s 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T02:07:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:27 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3785556503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:27.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:07:27.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: pgmap v315: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 769 B/s rd, 3.8 KiB/s wr, 12 op/s 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-04-25T02:07:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T02:07:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3785556503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: pgmap v315: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 769 B/s rd, 3.8 KiB/s wr, 12 op/s 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-04-25T02:07:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: osdmap e86: 12 total, 12 up, 12 in 2024-04-25T02:07:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:27 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3785556503' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 -- 172.21.15.137:0/520310941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c107bc0 msgr2=0x7fbc3c107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 --2- 172.21.15.137:0/520310941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c107fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009900 tx=0x7fbc2c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 -- 172.21.15.137:0/520310941 shutdown_connections 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 --2- 172.21.15.137:0/520310941 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c109770 0x7fbc3c110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 --2- 172.21.15.137:0/520310941 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c108db0 0x7fbc3c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 --2- 172.21.15.137:0/520310941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c107fe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 -- 172.21.15.137:0/520310941 >> 172.21.15.137:0/520310941 conn(0x7fbc3c076b80 msgr2=0x7fbc3c078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 -- 172.21.15.137:0/520310941 shutdown_connections 2024-04-25T02:07:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.980+0000 7fbc3be00640 1 -- 172.21.15.137:0/520310941 wait complete. 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.981+0000 7fbc3be00640 1 Processor -- start 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.981+0000 7fbc3be00640 1 -- start start 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c108db0 0x7fbc3c19e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1139b0 con 0x7fbc3c109770 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c113830 con 0x7fbc3c108db0 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c113b30 con 0x7fbc3c107bc0 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40038/0 (socket says 172.21.15.137:40038) 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 -- 172.21.15.137:0/892189327 learned_addr learned my addr 172.21.15.137:0/892189327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3aa00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc32000640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c108db0 0x7fbc3c19e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 -- 172.21.15.137:0/892189327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c107bc0 msgr2=0x7fbc3c19df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c19df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 -- 172.21.15.137:0/892189327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c108db0 msgr2=0x7fbc3c19e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:27.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c108db0 0x7fbc3c19e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:27.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.982+0000 7fbc3b400640 1 -- 172.21.15.137:0/892189327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1a5bb0 con 0x7fbc3c109770 2024-04-25T02:07:27.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc3b400640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400eb10 tx=0x7fbc3400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34004b20 con 0x7fbc3c109770 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc34004cc0 con 0x7fbc3c109770 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c1a5ea0 con 0x7fbc3c109770 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc340107f0 con 0x7fbc3c109770 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.983+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c1a6360 con 0x7fbc3c109770 2024-04-25T02:07:27.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.984+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3c10ee80 con 0x7fbc3c109770 2024-04-25T02:07:27.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.986+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbc34005020 con 0x7fbc3c109770 2024-04-25T02:07:27.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.989+0000 7fbc33e00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 0x7fbc200a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:27.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.989+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fbc340cf6d0 con 0x7fbc3c109770 2024-04-25T02:07:27.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.989+0000 7fbc3aa00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 0x7fbc200a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:27.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.990+0000 7fbc3aa00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 0x7fbc200a5160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c02a9e0 tx=0x7fbc2c005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:27.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:27.993+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fbc3409c480 con 0x7fbc3c109770 2024-04-25T02:07:28.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.193+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc3c061b80 con 0x7fbc200a2ca0 2024-04-25T02:07:28.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.219+0000 7fbc33e00640 1 -- 172.21.15.137:0/892189327 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258594 (secure 0 0 0) 0x7fbc3c061b80 con 0x7fbc200a2ca0 2024-04-25T02:07:28.230 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:28.231 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:07:28.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 msgr2=0x7fbc200a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 0x7fbc200a5160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c02a9e0 tx=0x7fbc2c005a20 comp rx=0 tx=0).stop 2024-04-25T02:07:28.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 msgr2=0x7fbc3c1a5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400eb10 tx=0x7fbc3400c2d0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 shutdown_connections 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbc200a2ca0 0x7fbc200a5160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc3c109770 0x7fbc3c1a5540 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc3c108db0 0x7fbc3c19e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 --2- 172.21.15.137:0/892189327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c107bc0 0x7fbc3c19df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 >> 172.21.15.137:0/892189327 conn(0x7fbc3c076b80 msgr2=0x7fbc3c10c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 shutdown_connections 2024-04-25T02:07:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.225+0000 7fbc3be00640 1 -- 172.21.15.137:0/892189327 wait complete. 2024-04-25T02:07:28.252 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-04-25T02:07:27.435622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":633070,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":167,"num_read_kb":177,"num_write":320,"num_write_kb":3019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":258,"ondisk_log_size":258,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370176,"kb_used_data":12700,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571648,"statfs":{"total":1151940427776,"available":1151561367552,"internally_reserved":0,"allocated":13004800,"data_stored":7087115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42508,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":131,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.063588"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.190187+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:21.190187+0000","last_peered":"2024-04-25T02:07:21.190187+0000","last_clean":"2024-04-25T02:07:21.190187+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:21.190187+0000","last_undegraded":"2024-04-25T02:07:21.190187+0000","last_fullsized":"2024-04-25T02:07:21.190187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452593+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:26.452593+0000","last_peered":"2024-04-25T02:07:26.452593+0000","last_clean":"2024-04-25T02:07:26.452593+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:26.452593+0000","last_undegraded":"2024-04-25T02:07:26.452593+0000","last_fullsized":"2024-04-25T02:07:26.452593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452550+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:26.452550+0000","last_peered":"2024-04-25T02:07:26.452550+0000","last_clean":"2024-04-25T02:07:26.452550+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:26.452550+0000","last_undegraded":"2024-04-25T02:07:26.452550+0000","last_fullsized":"2024-04-25T02:07:26.452550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442056+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:26.442056+0000","last_peered":"2024-04-25T02:07:26.442056+0000","last_clean":"2024-04-25T02:07:26.442056+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:26.442056+0000","last_undegraded":"2024-04-25T02:07:26.442056+0000","last_fullsized":"2024-04-25T02:07:26.442056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409309+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:20.409309+0000","last_peered":"2024-04-25T02:07:20.409309+0000","last_clean":"2024-04-25T02:07:20.409309+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:20.409309+0000","last_undegraded":"2024-04-25T02:07:20.409309+0000","last_fullsized":"2024-04-25T02:07:20.409309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443972+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:26.443972+0000","last_peered":"2024-04-25T02:07:26.443972+0000","last_clean":"2024-04-25T02:07:26.443972+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:26.443972+0000","last_undegraded":"2024-04-25T02:07:26.443972+0000","last_fullsized":"2024-04-25T02:07:26.443972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589139+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:20.589139+0000","last_peered":"2024-04-25T02:07:20.589139+0000","last_clean":"2024-04-25T02:07:20.589139+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:20.589139+0000","last_undegraded":"2024-04-25T02:07:20.589139+0000","last_fullsized":"2024-04-25T02:07:20.589139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412144+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:20.412144+0000","last_peered":"2024-04-25T02:07:20.412144+0000","last_clean":"2024-04-25T02:07:20.412144+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:20.412144+0000","last_undegraded":"2024-04-25T02:07:20.412144+0000","last_fullsized":"2024-04-25T02:07:20.412144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588818+0000","last_change":"2024-04-25T02:07:19.369352+0000","last_active":"2024-04-25T02:07:20.588818+0000","last_peered":"2024-04-25T02:07:20.588818+0000","last_clean":"2024-04-25T02:07:20.588818+0000","last_became_active":"2024-04-25T02:07:19.368863+0000","last_became_peered":"2024-04-25T02:07:19.368863+0000","last_unstale":"2024-04-25T02:07:20.588818+0000","last_undegraded":"2024-04-25T02:07:20.588818+0000","last_fullsized":"2024-04-25T02:07:20.588818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:37.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444218+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:26.444218+0000","last_peered":"2024-04-25T02:07:26.444218+0000","last_clean":"2024-04-25T02:07:26.444218+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:26.444218+0000","last_undegraded":"2024-04-25T02:07:26.444218+0000","last_fullsized":"2024-04-25T02:07:26.444218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589630+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:20.589630+0000","last_peered":"2024-04-25T02:07:20.589630+0000","last_clean":"2024-04-25T02:07:20.589630+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:20.589630+0000","last_undegraded":"2024-04-25T02:07:20.589630+0000","last_fullsized":"2024-04-25T02:07:20.589630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441916+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:26.441916+0000","last_peered":"2024-04-25T02:07:26.441916+0000","last_clean":"2024-04-25T02:07:26.441916+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:26.441916+0000","last_undegraded":"2024-04-25T02:07:26.441916+0000","last_fullsized":"2024-04-25T02:07:26.441916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591593+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:20.591593+0000","last_peered":"2024-04-25T02:07:20.591593+0000","last_clean":"2024-04-25T02:07:20.591593+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:20.591593+0000","last_undegraded":"2024-04-25T02:07:20.591593+0000","last_fullsized":"2024-04-25T02:07:20.591593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.450661+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:26.450661+0000","last_peered":"2024-04-25T02:07:26.450661+0000","last_clean":"2024-04-25T02:07:26.450661+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:26.450661+0000","last_undegraded":"2024-04-25T02:07:26.450661+0000","last_fullsized":"2024-04-25T02:07:26.450661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.808650+0000","last_change":"2024-04-25T02:07:26.452206+0000","last_active":"2024-04-25T02:07:26.452206+0000","last_peered":"2024-04-25T02:07:21.808650+0000","last_clean":"2024-04-25T02:07:21.808650+0000","last_became_active":"2024-04-25T02:07:19.393672+0000","last_became_peered":"2024-04-25T02:07:19.393672+0000","last_unstale":"2024-04-25T02:07:21.808650+0000","last_undegraded":"2024-04-25T02:07:21.808650+0000","last_fullsized":"2024-04-25T02:07:21.808650+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587795+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:20.587795+0000","last_peered":"2024-04-25T02:07:20.587795+0000","last_clean":"2024-04-25T02:07:20.587795+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:20.587795+0000","last_undegraded":"2024-04-25T02:07:20.587795+0000","last_fullsized":"2024-04-25T02:07:20.587795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.190275+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:21.190275+0000","last_peered":"2024-04-25T02:07:21.190275+0000","last_clean":"2024-04-25T02:07:21.190275+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:21.190275+0000","last_undegraded":"2024-04-25T02:07:21.190275+0000","last_fullsized":"2024-04-25T02:07:21.190275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440863+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:26.440863+0000","last_peered":"2024-04-25T02:07:26.440863+0000","last_clean":"2024-04-25T02:07:26.440863+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:26.440863+0000","last_undegraded":"2024-04-25T02:07:26.440863+0000","last_fullsized":"2024-04-25T02:07:26.440863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382630+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:20.382630+0000","last_peered":"2024-04-25T02:07:20.382630+0000","last_clean":"2024-04-25T02:07:20.382630+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:20.382630+0000","last_undegraded":"2024-04-25T02:07:20.382630+0000","last_fullsized":"2024-04-25T02:07:20.382630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:24.403779+0000","last_change":"2024-04-25T02:07:26.439997+0000","last_active":"2024-04-25T02:07:26.439997+0000","last_peered":"2024-04-25T02:07:24.403779+0000","last_clean":"2024-04-25T02:07:24.403779+0000","last_became_active":"2024-04-25T02:07:18.412408+0000","last_became_peered":"2024-04-25T02:07:18.412408+0000","last_unstale":"2024-04-25T02:07:24.403779+0000","last_undegraded":"2024-04-25T02:07:24.403779+0000","last_fullsized":"2024-04-25T02:07:24.403779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,8],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412726+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:20.412726+0000","last_peered":"2024-04-25T02:07:20.412726+0000","last_clean":"2024-04-25T02:07:20.412726+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:20.412726+0000","last_undegraded":"2024-04-25T02:07:20.412726+0000","last_fullsized":"2024-04-25T02:07:20.412726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.617568+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:20.617568+0000","last_peered":"2024-04-25T02:07:20.617568+0000","last_clean":"2024-04-25T02:07:20.617568+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:20.617568+0000","last_undegraded":"2024-04-25T02:07:20.617568+0000","last_fullsized":"2024-04-25T02:07:20.617568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452817+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:26.452817+0000","last_peered":"2024-04-25T02:07:26.452817+0000","last_clean":"2024-04-25T02:07:26.452817+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:26.452817+0000","last_undegraded":"2024-04-25T02:07:26.452817+0000","last_fullsized":"2024-04-25T02:07:26.452817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.391807+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:23.391807+0000","last_peered":"2024-04-25T02:07:23.391807+0000","last_clean":"2024-04-25T02:07:23.391807+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:23.391807+0000","last_undegraded":"2024-04-25T02:07:23.391807+0000","last_fullsized":"2024-04-25T02:07:23.391807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588113+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:20.588113+0000","last_peered":"2024-04-25T02:07:20.588113+0000","last_clean":"2024-04-25T02:07:20.588113+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:20.588113+0000","last_undegraded":"2024-04-25T02:07:20.588113+0000","last_fullsized":"2024-04-25T02:07:20.588113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409556+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:20.409556+0000","last_peered":"2024-04-25T02:07:20.409556+0000","last_clean":"2024-04-25T02:07:20.409556+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:20.409556+0000","last_undegraded":"2024-04-25T02:07:20.409556+0000","last_fullsized":"2024-04-25T02:07:20.409556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588324+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:20.588324+0000","last_peered":"2024-04-25T02:07:20.588324+0000","last_clean":"2024-04-25T02:07:20.588324+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:20.588324+0000","last_undegraded":"2024-04-25T02:07:20.588324+0000","last_fullsized":"2024-04-25T02:07:20.588324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:24.401752+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:07:24.401752+0000","last_peered":"2024-04-25T02:07:24.401752+0000","last_clean":"2024-04-25T02:07:24.401752+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:07:24.401752+0000","last_undegraded":"2024-04-25T02:07:24.401752+0000","last_fullsized":"2024-04-25T02:07:24.401752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409396+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:20.409396+0000","last_peered":"2024-04-25T02:07:20.409396+0000","last_clean":"2024-04-25T02:07:20.409396+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:20.409396+0000","last_undegraded":"2024-04-25T02:07:20.409396+0000","last_fullsized":"2024-04-25T02:07:20.409396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443897+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:26.443897+0000","last_peered":"2024-04-25T02:07:26.443897+0000","last_clean":"2024-04-25T02:07:26.443897+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:26.443897+0000","last_undegraded":"2024-04-25T02:07:26.443897+0000","last_fullsized":"2024-04-25T02:07:26.443897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588071+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:20.588071+0000","last_peered":"2024-04-25T02:07:20.588071+0000","last_clean":"2024-04-25T02:07:20.588071+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:20.588071+0000","last_undegraded":"2024-04-25T02:07:20.588071+0000","last_fullsized":"2024-04-25T02:07:20.588071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399328+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:23.399328+0000","last_peered":"2024-04-25T02:07:23.399328+0000","last_clean":"2024-04-25T02:07:23.399328+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:23.399328+0000","last_undegraded":"2024-04-25T02:07:23.399328+0000","last_fullsized":"2024-04-25T02:07:23.399328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":2,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-25T02:07:20.617139+0000","last_change":"2024-04-25T02:07:26.535367+0000","last_active":"2024-04-25T02:07:26.535367+0000","last_peered":"2024-04-25T02:07:20.617139+0000","last_clean":"2024-04-25T02:07:20.617139+0000","last_became_active":"2024-04-25T02:07:19.389991+0000","last_became_peered":"2024-04-25T02:07:19.389991+0000","last_unstale":"2024-04-25T02:07:20.617139+0000","last_undegraded":"2024-04-25T02:07:20.617139+0000","last_fullsized":"2024-04-25T02:07:20.617139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587713+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:20.587713+0000","last_peered":"2024-04-25T02:07:20.587713+0000","last_clean":"2024-04-25T02:07:20.587713+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:20.587713+0000","last_undegraded":"2024-04-25T02:07:20.587713+0000","last_fullsized":"2024-04-25T02:07:20.587713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.439736+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:26.439736+0000","last_peered":"2024-04-25T02:07:26.439736+0000","last_clean":"2024-04-25T02:07:26.439736+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:26.439736+0000","last_undegraded":"2024-04-25T02:07:26.439736+0000","last_fullsized":"2024-04-25T02:07:26.439736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444223+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:07:26.444223+0000","last_peered":"2024-04-25T02:07:26.444223+0000","last_clean":"2024-04-25T02:07:26.444223+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:07:26.444223+0000","last_undegraded":"2024-04-25T02:07:26.444223+0000","last_fullsized":"2024-04-25T02:07:26.444223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588744+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:20.588744+0000","last_peered":"2024-04-25T02:07:20.588744+0000","last_clean":"2024-04-25T02:07:20.588744+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:20.588744+0000","last_undegraded":"2024-04-25T02:07:20.588744+0000","last_fullsized":"2024-04-25T02:07:20.588744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381697+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:22.381697+0000","last_peered":"2024-04-25T02:07:22.381697+0000","last_clean":"2024-04-25T02:07:22.381697+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:22.381697+0000","last_undegraded":"2024-04-25T02:07:22.381697+0000","last_fullsized":"2024-04-25T02:07:22.381697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452614+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:26.452614+0000","last_peered":"2024-04-25T02:07:26.452614+0000","last_clean":"2024-04-25T02:07:26.452614+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:26.452614+0000","last_undegraded":"2024-04-25T02:07:26.452614+0000","last_fullsized":"2024-04-25T02:07:26.452614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.383503+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:22.383503+0000","last_peered":"2024-04-25T02:07:22.383503+0000","last_clean":"2024-04-25T02:07:22.383503+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:22.383503+0000","last_undegraded":"2024-04-25T02:07:22.383503+0000","last_fullsized":"2024-04-25T02:07:22.383503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588353+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:20.588353+0000","last_peered":"2024-04-25T02:07:20.588353+0000","last_clean":"2024-04-25T02:07:20.588353+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:20.588353+0000","last_undegraded":"2024-04-25T02:07:20.588353+0000","last_fullsized":"2024-04-25T02:07:20.588353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'19","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444061+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:07:26.444061+0000","last_peered":"2024-04-25T02:07:26.444061+0000","last_clean":"2024-04-25T02:07:26.444061+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:07:26.444061+0000","last_undegraded":"2024-04-25T02:07:26.444061+0000","last_fullsized":"2024-04-25T02:07:26.444061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":41,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409609+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:20.409609+0000","last_peered":"2024-04-25T02:07:20.409609+0000","last_clean":"2024-04-25T02:07:20.409609+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:20.409609+0000","last_undegraded":"2024-04-25T02:07:20.409609+0000","last_fullsized":"2024-04-25T02:07:20.409609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.398505+0000","last_change":"2024-04-25T02:07:18.408686+0000","last_active":"2024-04-25T02:07:23.398505+0000","last_peered":"2024-04-25T02:07:23.398505+0000","last_clean":"2024-04-25T02:07:23.398505+0000","last_became_active":"2024-04-25T02:07:18.408216+0000","last_became_peered":"2024-04-25T02:07:18.408216+0000","last_unstale":"2024-04-25T02:07:23.398505+0000","last_undegraded":"2024-04-25T02:07:23.398505+0000","last_fullsized":"2024-04-25T02:07:23.398505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:30:29.344954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591035+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:20.591035+0000","last_peered":"2024-04-25T02:07:20.591035+0000","last_clean":"2024-04-25T02:07:20.591035+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:20.591035+0000","last_undegraded":"2024-04-25T02:07:20.591035+0000","last_fullsized":"2024-04-25T02:07:20.591035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381836+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:22.381836+0000","last_peered":"2024-04-25T02:07:22.381836+0000","last_clean":"2024-04-25T02:07:22.381836+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:22.381836+0000","last_undegraded":"2024-04-25T02:07:22.381836+0000","last_fullsized":"2024-04-25T02:07:22.381836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589635+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:20.589635+0000","last_peered":"2024-04-25T02:07:20.589635+0000","last_clean":"2024-04-25T02:07:20.589635+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:20.589635+0000","last_undegraded":"2024-04-25T02:07:20.589635+0000","last_fullsized":"2024-04-25T02:07:20.589635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441938+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:07:26.441938+0000","last_peered":"2024-04-25T02:07:26.441938+0000","last_clean":"2024-04-25T02:07:26.441938+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:07:26.441938+0000","last_undegraded":"2024-04-25T02:07:26.441938+0000","last_fullsized":"2024-04-25T02:07:26.441938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589138+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:20.589138+0000","last_peered":"2024-04-25T02:07:20.589138+0000","last_clean":"2024-04-25T02:07:20.589138+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:20.589138+0000","last_undegraded":"2024-04-25T02:07:20.589138+0000","last_fullsized":"2024-04-25T02:07:20.589138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400362+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:23.400362+0000","last_peered":"2024-04-25T02:07:23.400362+0000","last_clean":"2024-04-25T02:07:23.400362+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:23.400362+0000","last_undegraded":"2024-04-25T02:07:23.400362+0000","last_fullsized":"2024-04-25T02:07:23.400362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587784+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:20.587784+0000","last_peered":"2024-04-25T02:07:20.587784+0000","last_clean":"2024-04-25T02:07:20.587784+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:20.587784+0000","last_undegraded":"2024-04-25T02:07:20.587784+0000","last_fullsized":"2024-04-25T02:07:20.587784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409584+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:20.409584+0000","last_peered":"2024-04-25T02:07:20.409584+0000","last_clean":"2024-04-25T02:07:20.409584+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:20.409584+0000","last_undegraded":"2024-04-25T02:07:20.409584+0000","last_fullsized":"2024-04-25T02:07:20.409584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.190099+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:21.190099+0000","last_peered":"2024-04-25T02:07:21.190099+0000","last_clean":"2024-04-25T02:07:21.190099+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:21.190099+0000","last_undegraded":"2024-04-25T02:07:21.190099+0000","last_fullsized":"2024-04-25T02:07:21.190099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.534816+0000","last_change":"2024-04-25T02:07:26.441856+0000","last_active":"2024-04-25T02:07:26.441856+0000","last_peered":"2024-04-25T02:07:21.534816+0000","last_clean":"2024-04-25T02:07:21.534816+0000","last_became_active":"2024-04-25T02:07:18.422561+0000","last_became_peered":"2024-04-25T02:07:18.422561+0000","last_unstale":"2024-04-25T02:07:21.534816+0000","last_undegraded":"2024-04-25T02:07:21.534816+0000","last_fullsized":"2024-04-25T02:07:21.534816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444068+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:26.444068+0000","last_peered":"2024-04-25T02:07:26.444068+0000","last_clean":"2024-04-25T02:07:26.444068+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:26.444068+0000","last_undegraded":"2024-04-25T02:07:26.444068+0000","last_fullsized":"2024-04-25T02:07:26.444068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589167+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:20.589167+0000","last_peered":"2024-04-25T02:07:20.589167+0000","last_clean":"2024-04-25T02:07:20.589167+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:20.589167+0000","last_undegraded":"2024-04-25T02:07:20.589167+0000","last_fullsized":"2024-04-25T02:07:20.589167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.582905+0000","last_change":"2024-04-25T02:07:26.444328+0000","last_active":"2024-04-25T02:07:26.444328+0000","last_peered":"2024-04-25T02:07:21.582905+0000","last_clean":"2024-04-25T02:07:21.582905+0000","last_became_active":"2024-04-25T02:07:19.384064+0000","last_became_peered":"2024-04-25T02:07:19.384064+0000","last_unstale":"2024-04-25T02:07:21.582905+0000","last_undegraded":"2024-04-25T02:07:21.582905+0000","last_fullsized":"2024-04-25T02:07:21.582905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587867+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:20.587867+0000","last_peered":"2024-04-25T02:07:20.587867+0000","last_clean":"2024-04-25T02:07:20.587867+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:20.587867+0000","last_undegraded":"2024-04-25T02:07:20.587867+0000","last_fullsized":"2024-04-25T02:07:20.587867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400286+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:07:23.400286+0000","last_peered":"2024-04-25T02:07:23.400286+0000","last_clean":"2024-04-25T02:07:23.400286+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:07:23.400286+0000","last_undegraded":"2024-04-25T02:07:23.400286+0000","last_fullsized":"2024-04-25T02:07:23.400286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412174+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:20.412174+0000","last_peered":"2024-04-25T02:07:20.412174+0000","last_clean":"2024-04-25T02:07:20.412174+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:20.412174+0000","last_undegraded":"2024-04-25T02:07:20.412174+0000","last_fullsized":"2024-04-25T02:07:20.412174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441921+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:26.441921+0000","last_peered":"2024-04-25T02:07:26.441921+0000","last_clean":"2024-04-25T02:07:26.441921+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:26.441921+0000","last_undegraded":"2024-04-25T02:07:26.441921+0000","last_fullsized":"2024-04-25T02:07:26.441921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589033+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:20.589033+0000","last_peered":"2024-04-25T02:07:20.589033+0000","last_clean":"2024-04-25T02:07:20.589033+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:20.589033+0000","last_undegraded":"2024-04-25T02:07:20.589033+0000","last_fullsized":"2024-04-25T02:07:20.589033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590113+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:20.590113+0000","last_peered":"2024-04-25T02:07:20.590113+0000","last_clean":"2024-04-25T02:07:20.590113+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:20.590113+0000","last_undegraded":"2024-04-25T02:07:20.590113+0000","last_fullsized":"2024-04-25T02:07:20.590113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589342+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:20.589342+0000","last_peered":"2024-04-25T02:07:20.589342+0000","last_clean":"2024-04-25T02:07:20.589342+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:20.589342+0000","last_undegraded":"2024-04-25T02:07:20.589342+0000","last_fullsized":"2024-04-25T02:07:20.589342+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409620+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:20.409620+0000","last_peered":"2024-04-25T02:07:20.409620+0000","last_clean":"2024-04-25T02:07:20.409620+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:20.409620+0000","last_undegraded":"2024-04-25T02:07:20.409620+0000","last_fullsized":"2024-04-25T02:07:20.409620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591324+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:20.591324+0000","last_peered":"2024-04-25T02:07:20.591324+0000","last_clean":"2024-04-25T02:07:20.591324+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:20.591324+0000","last_undegraded":"2024-04-25T02:07:20.591324+0000","last_fullsized":"2024-04-25T02:07:20.591324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440730+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:26.440730+0000","last_peered":"2024-04-25T02:07:26.440730+0000","last_clean":"2024-04-25T02:07:26.440730+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:26.440730+0000","last_undegraded":"2024-04-25T02:07:26.440730+0000","last_fullsized":"2024-04-25T02:07:26.440730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413428+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:20.413428+0000","last_peered":"2024-04-25T02:07:20.413428+0000","last_clean":"2024-04-25T02:07:20.413428+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:20.413428+0000","last_undegraded":"2024-04-25T02:07:20.413428+0000","last_fullsized":"2024-04-25T02:07:20.413428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442301+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:26.442301+0000","last_peered":"2024-04-25T02:07:26.442301+0000","last_clean":"2024-04-25T02:07:26.442301+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:26.442301+0000","last_undegraded":"2024-04-25T02:07:26.442301+0000","last_fullsized":"2024-04-25T02:07:26.442301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452720+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:26.452720+0000","last_peered":"2024-04-25T02:07:26.452720+0000","last_clean":"2024-04-25T02:07:26.452720+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:26.452720+0000","last_undegraded":"2024-04-25T02:07:26.452720+0000","last_fullsized":"2024-04-25T02:07:26.452720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.386004+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:22.386004+0000","last_peered":"2024-04-25T02:07:22.386004+0000","last_clean":"2024-04-25T02:07:22.386004+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:22.386004+0000","last_undegraded":"2024-04-25T02:07:22.386004+0000","last_fullsized":"2024-04-25T02:07:22.386004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409231+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:20.409231+0000","last_peered":"2024-04-25T02:07:20.409231+0000","last_clean":"2024-04-25T02:07:20.409231+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:20.409231+0000","last_undegraded":"2024-04-25T02:07:20.409231+0000","last_fullsized":"2024-04-25T02:07:20.409231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.388504+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:22.388504+0000","last_peered":"2024-04-25T02:07:22.388504+0000","last_clean":"2024-04-25T02:07:22.388504+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:22.388504+0000","last_undegraded":"2024-04-25T02:07:22.388504+0000","last_fullsized":"2024-04-25T02:07:22.388504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.189802+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:21.189802+0000","last_peered":"2024-04-25T02:07:21.189802+0000","last_clean":"2024-04-25T02:07:21.189802+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:21.189802+0000","last_undegraded":"2024-04-25T02:07:21.189802+0000","last_fullsized":"2024-04-25T02:07:21.189802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382605+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:20.382605+0000","last_peered":"2024-04-25T02:07:20.382605+0000","last_clean":"2024-04-25T02:07:20.382605+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:20.382605+0000","last_undegraded":"2024-04-25T02:07:20.382605+0000","last_fullsized":"2024-04-25T02:07:20.382605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413081+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:20.413081+0000","last_peered":"2024-04-25T02:07:20.413081+0000","last_clean":"2024-04-25T02:07:20.413081+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:20.413081+0000","last_undegraded":"2024-04-25T02:07:20.413081+0000","last_fullsized":"2024-04-25T02:07:20.413081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381602+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:22.381602+0000","last_peered":"2024-04-25T02:07:22.381602+0000","last_clean":"2024-04-25T02:07:22.381602+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:22.381602+0000","last_undegraded":"2024-04-25T02:07:22.381602+0000","last_fullsized":"2024-04-25T02:07:22.381602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589477+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:20.589477+0000","last_peered":"2024-04-25T02:07:20.589477+0000","last_clean":"2024-04-25T02:07:20.589477+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:20.589477+0000","last_undegraded":"2024-04-25T02:07:20.589477+0000","last_fullsized":"2024-04-25T02:07:20.589477+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399346+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:23.399346+0000","last_peered":"2024-04-25T02:07:23.399346+0000","last_clean":"2024-04-25T02:07:23.399346+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:23.399346+0000","last_undegraded":"2024-04-25T02:07:23.399346+0000","last_fullsized":"2024-04-25T02:07:23.399346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589732+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:20.589732+0000","last_peered":"2024-04-25T02:07:20.589732+0000","last_clean":"2024-04-25T02:07:20.589732+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:20.589732+0000","last_undegraded":"2024-04-25T02:07:20.589732+0000","last_fullsized":"2024-04-25T02:07:20.589732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588155+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:20.588155+0000","last_peered":"2024-04-25T02:07:20.588155+0000","last_clean":"2024-04-25T02:07:20.588155+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:20.588155+0000","last_undegraded":"2024-04-25T02:07:20.588155+0000","last_fullsized":"2024-04-25T02:07:20.588155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589476+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:20.589476+0000","last_peered":"2024-04-25T02:07:20.589476+0000","last_clean":"2024-04-25T02:07:20.589476+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:20.589476+0000","last_undegraded":"2024-04-25T02:07:20.589476+0000","last_fullsized":"2024-04-25T02:07:20.589476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590730+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:20.590730+0000","last_peered":"2024-04-25T02:07:20.590730+0000","last_clean":"2024-04-25T02:07:20.590730+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:20.590730+0000","last_undegraded":"2024-04-25T02:07:20.590730+0000","last_fullsized":"2024-04-25T02:07:20.590730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.589741+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:20.589741+0000","last_peered":"2024-04-25T02:07:20.589741+0000","last_clean":"2024-04-25T02:07:20.589741+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:20.589741+0000","last_undegraded":"2024-04-25T02:07:20.589741+0000","last_fullsized":"2024-04-25T02:07:20.589741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.189935+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:21.189935+0000","last_peered":"2024-04-25T02:07:21.189935+0000","last_clean":"2024-04-25T02:07:21.189935+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:21.189935+0000","last_undegraded":"2024-04-25T02:07:21.189935+0000","last_fullsized":"2024-04-25T02:07:21.189935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382638+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:20.382638+0000","last_peered":"2024-04-25T02:07:20.382638+0000","last_clean":"2024-04-25T02:07:20.382638+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:20.382638+0000","last_undegraded":"2024-04-25T02:07:20.382638+0000","last_fullsized":"2024-04-25T02:07:20.382638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382450+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:20.382450+0000","last_peered":"2024-04-25T02:07:20.382450+0000","last_clean":"2024-04-25T02:07:20.382450+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:20.382450+0000","last_undegraded":"2024-04-25T02:07:20.382450+0000","last_fullsized":"2024-04-25T02:07:20.382450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.453158+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:26.453158+0000","last_peered":"2024-04-25T02:07:26.453158+0000","last_clean":"2024-04-25T02:07:26.453158+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:26.453158+0000","last_undegraded":"2024-04-25T02:07:26.453158+0000","last_fullsized":"2024-04-25T02:07:26.453158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591502+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:20.591502+0000","last_peered":"2024-04-25T02:07:20.591502+0000","last_clean":"2024-04-25T02:07:20.591502+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:20.591502+0000","last_undegraded":"2024-04-25T02:07:20.591502+0000","last_fullsized":"2024-04-25T02:07:20.591502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.190042+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:21.190042+0000","last_peered":"2024-04-25T02:07:21.190042+0000","last_clean":"2024-04-25T02:07:21.190042+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:21.190042+0000","last_undegraded":"2024-04-25T02:07:21.190042+0000","last_fullsized":"2024-04-25T02:07:21.190042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.383007+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:20.383007+0000","last_peered":"2024-04-25T02:07:20.383007+0000","last_clean":"2024-04-25T02:07:20.383007+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:20.383007+0000","last_undegraded":"2024-04-25T02:07:20.383007+0000","last_fullsized":"2024-04-25T02:07:20.383007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413207+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:20.413207+0000","last_peered":"2024-04-25T02:07:20.413207+0000","last_clean":"2024-04-25T02:07:20.413207+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:20.413207+0000","last_undegraded":"2024-04-25T02:07:20.413207+0000","last_fullsized":"2024-04-25T02:07:20.413207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587830+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:20.587830+0000","last_peered":"2024-04-25T02:07:20.587830+0000","last_clean":"2024-04-25T02:07:20.587830+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:20.587830+0000","last_undegraded":"2024-04-25T02:07:20.587830+0000","last_fullsized":"2024-04-25T02:07:20.587830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.411899+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:20.411899+0000","last_peered":"2024-04-25T02:07:20.411899+0000","last_clean":"2024-04-25T02:07:20.411899+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:20.411899+0000","last_undegraded":"2024-04-25T02:07:20.411899+0000","last_fullsized":"2024-04-25T02:07:20.411899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588179+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:20.588179+0000","last_peered":"2024-04-25T02:07:20.588179+0000","last_clean":"2024-04-25T02:07:20.588179+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:20.588179+0000","last_undegraded":"2024-04-25T02:07:20.588179+0000","last_fullsized":"2024-04-25T02:07:20.588179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591437+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:20.591437+0000","last_peered":"2024-04-25T02:07:20.591437+0000","last_clean":"2024-04-25T02:07:20.591437+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:20.591437+0000","last_undegraded":"2024-04-25T02:07:20.591437+0000","last_fullsized":"2024-04-25T02:07:20.591437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:21.189914+0000","last_change":"2024-04-25T02:07:19.370021+0000","last_active":"2024-04-25T02:07:21.189914+0000","last_peered":"2024-04-25T02:07:21.189914+0000","last_clean":"2024-04-25T02:07:21.189914+0000","last_became_active":"2024-04-25T02:07:19.369689+0000","last_became_peered":"2024-04-25T02:07:19.369689+0000","last_unstale":"2024-04-25T02:07:21.189914+0000","last_undegraded":"2024-04-25T02:07:21.189914+0000","last_fullsized":"2024-04-25T02:07:21.189914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:14.313672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":42585,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":138,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":71533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383696,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1051870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332132,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1519616,"data_stored":1030093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":459416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":441483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32676,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712476,"statfs":{"total":95995035648,"available":95961575424,"internally_reserved":0,"allocated":1536000,"data_stored":1030365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":40162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:07:28.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 -- 172.21.15.137:0/2016164638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8076100 msgr2=0x7f42d8076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 --2- 172.21.15.137:0/2016164638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8076100 0x7f42d8076520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009900 tx=0x7f42cc02a410 comp rx=0 tx=0).stop 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 -- 172.21.15.137:0/2016164638 shutdown_connections 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 --2- 172.21.15.137:0/2016164638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8077ce0 0x7f42d8078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 --2- 172.21.15.137:0/2016164638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 0x7f42d80777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 --2- 172.21.15.137:0/2016164638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8076100 0x7f42d8076520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 -- 172.21.15.137:0/2016164638 >> 172.21.15.137:0/2016164638 conn(0x7f42d80fef30 msgr2=0x7f42d8101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 -- 172.21.15.137:0/2016164638 shutdown_connections 2024-04-25T02:07:28.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.496+0000 7f42e0200640 1 -- 172.21.15.137:0/2016164638 wait complete. 2024-04-25T02:07:28.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 Processor -- start 2024-04-25T02:07:28.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 -- start start 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 0x7f42d819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 0x7f42d81a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113bb0 con 0x7f42d8077ce0 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113a30 con 0x7f42d8077340 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42e0200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8113d30 con 0x7f42d8076100 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42de200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 0x7f42d81a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.498+0000 7f42dd800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35606/0 (socket says 172.21.15.137:35606) 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 0x7f42d819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 -- 172.21.15.137:0/822511767 learned_addr learned my addr 172.21.15.137:0/822511767 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 -- 172.21.15.137:0/822511767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 msgr2=0x7f42d819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 0x7f42d819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 -- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 msgr2=0x7f42d81a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 0x7f42d81a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 -- 172.21.15.137:0/822511767 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81a5de0 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42de200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 0x7f42d81a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42dd800640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0316a0 tx=0x7f42cc032d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.499+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc03f030 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.500+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f42cc003d00 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.500+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d81a6070 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.500+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc035070 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.500+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81a65b0 con 0x7f42d8076100 2024-04-25T02:07:28.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.501+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d8110470 con 0x7f42d8076100 2024-04-25T02:07:28.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.502+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f42cc042030 con 0x7f42d8076100 2024-04-25T02:07:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.504+0000 7f42d6000640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 0x7f42c00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.504+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f42cc0ef590 con 0x7f42d8076100 2024-04-25T02:07:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.504+0000 7f42dce00640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 0x7f42c00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.505+0000 7f42dce00640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 0x7f42c00a5160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42d819f6d0 tx=0x7f42c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:28.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.508+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f42cc0bbcf0 con 0x7f42d8076100 2024-04-25T02:07:28.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:28 smithi137 ceph-mon[28303]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:28.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:28 smithi137 ceph-mon[28303]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T02:07:28.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:28 smithi137 ceph-mon[28303]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-04-25T02:07:28.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2499684298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:28.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.704+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42d8061b80 con 0x7f42c00a2ca0 2024-04-25T02:07:28.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.729+0000 7f42d6000640 1 -- 172.21.15.137:0/822511767 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258608 (secure 0 0 0) 0x7f42d8061b80 con 0x7f42c00a2ca0 2024-04-25T02:07:28.739 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:28.741 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:07:28.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.735+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 msgr2=0x7f42c00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.735+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 0x7f42c00a5160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42d819f6d0 tx=0x7f42c4005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:28.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.735+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 msgr2=0x7f42d819e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:28.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.735+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0316a0 tx=0x7f42cc032d70 comp rx=0 tx=0).stop 2024-04-25T02:07:28.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 shutdown_connections 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42c00a2ca0 0x7f42c00a5160 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d8077ce0 0x7f42d81a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f42d8077340 0x7f42d819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 --2- 172.21.15.137:0/822511767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d8076100 0x7f42d819e1c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 >> 172.21.15.137:0/822511767 conn(0x7f42d80fef30 msgr2=0x7f42d8100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 shutdown_connections 2024-04-25T02:07:28.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:28.736+0000 7f42e0200640 1 -- 172.21.15.137:0/822511767 wait complete. 2024-04-25T02:07:28.762 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-04-25T02:07:28.375357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":633187,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":167,"num_read_kb":177,"num_write":324,"num_write_kb":3020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":262,"ondisk_log_size":262,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370232,"kb_used_data":12748,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571592,"statfs":{"total":1151940427776,"available":1151561310208,"internally_reserved":0,"allocated":13053952,"data_stored":7114921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42625,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":135,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.994159"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452593+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:26.452593+0000","last_peered":"2024-04-25T02:07:26.452593+0000","last_clean":"2024-04-25T02:07:26.452593+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:26.452593+0000","last_undegraded":"2024-04-25T02:07:26.452593+0000","last_fullsized":"2024-04-25T02:07:26.452593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452550+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:26.452550+0000","last_peered":"2024-04-25T02:07:26.452550+0000","last_clean":"2024-04-25T02:07:26.452550+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:26.452550+0000","last_undegraded":"2024-04-25T02:07:26.452550+0000","last_fullsized":"2024-04-25T02:07:26.452550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442056+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:26.442056+0000","last_peered":"2024-04-25T02:07:26.442056+0000","last_clean":"2024-04-25T02:07:26.442056+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:26.442056+0000","last_undegraded":"2024-04-25T02:07:26.442056+0000","last_fullsized":"2024-04-25T02:07:26.442056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409309+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:20.409309+0000","last_peered":"2024-04-25T02:07:20.409309+0000","last_clean":"2024-04-25T02:07:20.409309+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:20.409309+0000","last_undegraded":"2024-04-25T02:07:20.409309+0000","last_fullsized":"2024-04-25T02:07:20.409309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443972+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:26.443972+0000","last_peered":"2024-04-25T02:07:26.443972+0000","last_clean":"2024-04-25T02:07:26.443972+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:26.443972+0000","last_undegraded":"2024-04-25T02:07:26.443972+0000","last_fullsized":"2024-04-25T02:07:26.443972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412144+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:20.412144+0000","last_peered":"2024-04-25T02:07:20.412144+0000","last_clean":"2024-04-25T02:07:20.412144+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:20.412144+0000","last_undegraded":"2024-04-25T02:07:20.412144+0000","last_fullsized":"2024-04-25T02:07:20.412144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588818+0000","last_change":"2024-04-25T02:07:19.369352+0000","last_active":"2024-04-25T02:07:20.588818+0000","last_peered":"2024-04-25T02:07:20.588818+0000","last_clean":"2024-04-25T02:07:20.588818+0000","last_became_active":"2024-04-25T02:07:19.368863+0000","last_became_peered":"2024-04-25T02:07:19.368863+0000","last_unstale":"2024-04-25T02:07:20.588818+0000","last_undegraded":"2024-04-25T02:07:20.588818+0000","last_fullsized":"2024-04-25T02:07:20.588818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:37.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444218+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:26.444218+0000","last_peered":"2024-04-25T02:07:26.444218+0000","last_clean":"2024-04-25T02:07:26.444218+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:26.444218+0000","last_undegraded":"2024-04-25T02:07:26.444218+0000","last_fullsized":"2024-04-25T02:07:26.444218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441916+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:26.441916+0000","last_peered":"2024-04-25T02:07:26.441916+0000","last_clean":"2024-04-25T02:07:26.441916+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:26.441916+0000","last_undegraded":"2024-04-25T02:07:26.441916+0000","last_fullsized":"2024-04-25T02:07:26.441916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591593+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:20.591593+0000","last_peered":"2024-04-25T02:07:20.591593+0000","last_clean":"2024-04-25T02:07:20.591593+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:20.591593+0000","last_undegraded":"2024-04-25T02:07:20.591593+0000","last_fullsized":"2024-04-25T02:07:20.591593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.450661+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:26.450661+0000","last_peered":"2024-04-25T02:07:26.450661+0000","last_clean":"2024-04-25T02:07:26.450661+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:26.450661+0000","last_undegraded":"2024-04-25T02:07:26.450661+0000","last_fullsized":"2024-04-25T02:07:26.450661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.808650+0000","last_change":"2024-04-25T02:07:26.452206+0000","last_active":"2024-04-25T02:07:26.452206+0000","last_peered":"2024-04-25T02:07:21.808650+0000","last_clean":"2024-04-25T02:07:21.808650+0000","last_became_active":"2024-04-25T02:07:19.393672+0000","last_became_peered":"2024-04-25T02:07:19.393672+0000","last_unstale":"2024-04-25T02:07:21.808650+0000","last_undegraded":"2024-04-25T02:07:21.808650+0000","last_fullsized":"2024-04-25T02:07:21.808650+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587795+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:20.587795+0000","last_peered":"2024-04-25T02:07:20.587795+0000","last_clean":"2024-04-25T02:07:20.587795+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:20.587795+0000","last_undegraded":"2024-04-25T02:07:20.587795+0000","last_fullsized":"2024-04-25T02:07:20.587795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440863+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:26.440863+0000","last_peered":"2024-04-25T02:07:26.440863+0000","last_clean":"2024-04-25T02:07:26.440863+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:26.440863+0000","last_undegraded":"2024-04-25T02:07:26.440863+0000","last_fullsized":"2024-04-25T02:07:26.440863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382630+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:20.382630+0000","last_peered":"2024-04-25T02:07:20.382630+0000","last_clean":"2024-04-25T02:07:20.382630+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:20.382630+0000","last_undegraded":"2024-04-25T02:07:20.382630+0000","last_fullsized":"2024-04-25T02:07:20.382630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:24.403779+0000","last_change":"2024-04-25T02:07:26.439997+0000","last_active":"2024-04-25T02:07:26.439997+0000","last_peered":"2024-04-25T02:07:24.403779+0000","last_clean":"2024-04-25T02:07:24.403779+0000","last_became_active":"2024-04-25T02:07:18.412408+0000","last_became_peered":"2024-04-25T02:07:18.412408+0000","last_unstale":"2024-04-25T02:07:24.403779+0000","last_undegraded":"2024-04-25T02:07:24.403779+0000","last_fullsized":"2024-04-25T02:07:24.403779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,8],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412726+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:20.412726+0000","last_peered":"2024-04-25T02:07:20.412726+0000","last_clean":"2024-04-25T02:07:20.412726+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:20.412726+0000","last_undegraded":"2024-04-25T02:07:20.412726+0000","last_fullsized":"2024-04-25T02:07:20.412726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.617568+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:20.617568+0000","last_peered":"2024-04-25T02:07:20.617568+0000","last_clean":"2024-04-25T02:07:20.617568+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:20.617568+0000","last_undegraded":"2024-04-25T02:07:20.617568+0000","last_fullsized":"2024-04-25T02:07:20.617568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452817+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:26.452817+0000","last_peered":"2024-04-25T02:07:26.452817+0000","last_clean":"2024-04-25T02:07:26.452817+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:26.452817+0000","last_undegraded":"2024-04-25T02:07:26.452817+0000","last_fullsized":"2024-04-25T02:07:26.452817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.391807+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:23.391807+0000","last_peered":"2024-04-25T02:07:23.391807+0000","last_clean":"2024-04-25T02:07:23.391807+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:23.391807+0000","last_undegraded":"2024-04-25T02:07:23.391807+0000","last_fullsized":"2024-04-25T02:07:23.391807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588113+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:20.588113+0000","last_peered":"2024-04-25T02:07:20.588113+0000","last_clean":"2024-04-25T02:07:20.588113+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:20.588113+0000","last_undegraded":"2024-04-25T02:07:20.588113+0000","last_fullsized":"2024-04-25T02:07:20.588113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409556+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:20.409556+0000","last_peered":"2024-04-25T02:07:20.409556+0000","last_clean":"2024-04-25T02:07:20.409556+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:20.409556+0000","last_undegraded":"2024-04-25T02:07:20.409556+0000","last_fullsized":"2024-04-25T02:07:20.409556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588324+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:20.588324+0000","last_peered":"2024-04-25T02:07:20.588324+0000","last_clean":"2024-04-25T02:07:20.588324+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:20.588324+0000","last_undegraded":"2024-04-25T02:07:20.588324+0000","last_fullsized":"2024-04-25T02:07:20.588324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:24.401752+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:07:24.401752+0000","last_peered":"2024-04-25T02:07:24.401752+0000","last_clean":"2024-04-25T02:07:24.401752+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:07:24.401752+0000","last_undegraded":"2024-04-25T02:07:24.401752+0000","last_fullsized":"2024-04-25T02:07:24.401752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409396+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:20.409396+0000","last_peered":"2024-04-25T02:07:20.409396+0000","last_clean":"2024-04-25T02:07:20.409396+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:20.409396+0000","last_undegraded":"2024-04-25T02:07:20.409396+0000","last_fullsized":"2024-04-25T02:07:20.409396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443897+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:26.443897+0000","last_peered":"2024-04-25T02:07:26.443897+0000","last_clean":"2024-04-25T02:07:26.443897+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:26.443897+0000","last_undegraded":"2024-04-25T02:07:26.443897+0000","last_fullsized":"2024-04-25T02:07:26.443897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588071+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:20.588071+0000","last_peered":"2024-04-25T02:07:20.588071+0000","last_clean":"2024-04-25T02:07:20.588071+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:20.588071+0000","last_undegraded":"2024-04-25T02:07:20.588071+0000","last_fullsized":"2024-04-25T02:07:20.588071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399328+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:23.399328+0000","last_peered":"2024-04-25T02:07:23.399328+0000","last_clean":"2024-04-25T02:07:23.399328+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:23.399328+0000","last_undegraded":"2024-04-25T02:07:23.399328+0000","last_fullsized":"2024-04-25T02:07:23.399328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":2,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-25T02:07:20.617139+0000","last_change":"2024-04-25T02:07:26.535367+0000","last_active":"2024-04-25T02:07:26.535367+0000","last_peered":"2024-04-25T02:07:20.617139+0000","last_clean":"2024-04-25T02:07:20.617139+0000","last_became_active":"2024-04-25T02:07:19.389991+0000","last_became_peered":"2024-04-25T02:07:19.389991+0000","last_unstale":"2024-04-25T02:07:20.617139+0000","last_undegraded":"2024-04-25T02:07:20.617139+0000","last_fullsized":"2024-04-25T02:07:20.617139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587713+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:20.587713+0000","last_peered":"2024-04-25T02:07:20.587713+0000","last_clean":"2024-04-25T02:07:20.587713+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:20.587713+0000","last_undegraded":"2024-04-25T02:07:20.587713+0000","last_fullsized":"2024-04-25T02:07:20.587713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.439736+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:26.439736+0000","last_peered":"2024-04-25T02:07:26.439736+0000","last_clean":"2024-04-25T02:07:26.439736+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:26.439736+0000","last_undegraded":"2024-04-25T02:07:26.439736+0000","last_fullsized":"2024-04-25T02:07:26.439736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444223+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:07:26.444223+0000","last_peered":"2024-04-25T02:07:26.444223+0000","last_clean":"2024-04-25T02:07:26.444223+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:07:26.444223+0000","last_undegraded":"2024-04-25T02:07:26.444223+0000","last_fullsized":"2024-04-25T02:07:26.444223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588744+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:20.588744+0000","last_peered":"2024-04-25T02:07:20.588744+0000","last_clean":"2024-04-25T02:07:20.588744+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:20.588744+0000","last_undegraded":"2024-04-25T02:07:20.588744+0000","last_fullsized":"2024-04-25T02:07:20.588744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452614+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:26.452614+0000","last_peered":"2024-04-25T02:07:26.452614+0000","last_clean":"2024-04-25T02:07:26.452614+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:26.452614+0000","last_undegraded":"2024-04-25T02:07:26.452614+0000","last_fullsized":"2024-04-25T02:07:26.452614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.383503+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:22.383503+0000","last_peered":"2024-04-25T02:07:22.383503+0000","last_clean":"2024-04-25T02:07:22.383503+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:22.383503+0000","last_undegraded":"2024-04-25T02:07:22.383503+0000","last_fullsized":"2024-04-25T02:07:22.383503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588353+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:20.588353+0000","last_peered":"2024-04-25T02:07:20.588353+0000","last_clean":"2024-04-25T02:07:20.588353+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:20.588353+0000","last_undegraded":"2024-04-25T02:07:20.588353+0000","last_fullsized":"2024-04-25T02:07:20.588353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'19","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444061+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:07:26.444061+0000","last_peered":"2024-04-25T02:07:26.444061+0000","last_clean":"2024-04-25T02:07:26.444061+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:07:26.444061+0000","last_undegraded":"2024-04-25T02:07:26.444061+0000","last_fullsized":"2024-04-25T02:07:26.444061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":41,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409609+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:20.409609+0000","last_peered":"2024-04-25T02:07:20.409609+0000","last_clean":"2024-04-25T02:07:20.409609+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:20.409609+0000","last_undegraded":"2024-04-25T02:07:20.409609+0000","last_fullsized":"2024-04-25T02:07:20.409609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591035+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:20.591035+0000","last_peered":"2024-04-25T02:07:20.591035+0000","last_clean":"2024-04-25T02:07:20.591035+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:20.591035+0000","last_undegraded":"2024-04-25T02:07:20.591035+0000","last_fullsized":"2024-04-25T02:07:20.591035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381836+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:22.381836+0000","last_peered":"2024-04-25T02:07:22.381836+0000","last_clean":"2024-04-25T02:07:22.381836+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:22.381836+0000","last_undegraded":"2024-04-25T02:07:22.381836+0000","last_fullsized":"2024-04-25T02:07:22.381836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441938+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:07:26.441938+0000","last_peered":"2024-04-25T02:07:26.441938+0000","last_clean":"2024-04-25T02:07:26.441938+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:07:26.441938+0000","last_undegraded":"2024-04-25T02:07:26.441938+0000","last_fullsized":"2024-04-25T02:07:26.441938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400362+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:23.400362+0000","last_peered":"2024-04-25T02:07:23.400362+0000","last_clean":"2024-04-25T02:07:23.400362+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:23.400362+0000","last_undegraded":"2024-04-25T02:07:23.400362+0000","last_fullsized":"2024-04-25T02:07:23.400362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587784+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:20.587784+0000","last_peered":"2024-04-25T02:07:20.587784+0000","last_clean":"2024-04-25T02:07:20.587784+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:20.587784+0000","last_undegraded":"2024-04-25T02:07:20.587784+0000","last_fullsized":"2024-04-25T02:07:20.587784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409584+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:20.409584+0000","last_peered":"2024-04-25T02:07:20.409584+0000","last_clean":"2024-04-25T02:07:20.409584+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:20.409584+0000","last_undegraded":"2024-04-25T02:07:20.409584+0000","last_fullsized":"2024-04-25T02:07:20.409584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.534816+0000","last_change":"2024-04-25T02:07:26.441856+0000","last_active":"2024-04-25T02:07:26.441856+0000","last_peered":"2024-04-25T02:07:21.534816+0000","last_clean":"2024-04-25T02:07:21.534816+0000","last_became_active":"2024-04-25T02:07:18.422561+0000","last_became_peered":"2024-04-25T02:07:18.422561+0000","last_unstale":"2024-04-25T02:07:21.534816+0000","last_undegraded":"2024-04-25T02:07:21.534816+0000","last_fullsized":"2024-04-25T02:07:21.534816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444068+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:26.444068+0000","last_peered":"2024-04-25T02:07:26.444068+0000","last_clean":"2024-04-25T02:07:26.444068+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:26.444068+0000","last_undegraded":"2024-04-25T02:07:26.444068+0000","last_fullsized":"2024-04-25T02:07:26.444068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.582905+0000","last_change":"2024-04-25T02:07:26.444328+0000","last_active":"2024-04-25T02:07:26.444328+0000","last_peered":"2024-04-25T02:07:21.582905+0000","last_clean":"2024-04-25T02:07:21.582905+0000","last_became_active":"2024-04-25T02:07:19.384064+0000","last_became_peered":"2024-04-25T02:07:19.384064+0000","last_unstale":"2024-04-25T02:07:21.582905+0000","last_undegraded":"2024-04-25T02:07:21.582905+0000","last_fullsized":"2024-04-25T02:07:21.582905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587867+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:20.587867+0000","last_peered":"2024-04-25T02:07:20.587867+0000","last_clean":"2024-04-25T02:07:20.587867+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:20.587867+0000","last_undegraded":"2024-04-25T02:07:20.587867+0000","last_fullsized":"2024-04-25T02:07:20.587867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400286+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:07:23.400286+0000","last_peered":"2024-04-25T02:07:23.400286+0000","last_clean":"2024-04-25T02:07:23.400286+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:07:23.400286+0000","last_undegraded":"2024-04-25T02:07:23.400286+0000","last_fullsized":"2024-04-25T02:07:23.400286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412174+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:20.412174+0000","last_peered":"2024-04-25T02:07:20.412174+0000","last_clean":"2024-04-25T02:07:20.412174+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:20.412174+0000","last_undegraded":"2024-04-25T02:07:20.412174+0000","last_fullsized":"2024-04-25T02:07:20.412174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441921+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:26.441921+0000","last_peered":"2024-04-25T02:07:26.441921+0000","last_clean":"2024-04-25T02:07:26.441921+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:26.441921+0000","last_undegraded":"2024-04-25T02:07:26.441921+0000","last_fullsized":"2024-04-25T02:07:26.441921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445091+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445091+0000","last_peered":"2024-04-25T02:07:27.445091+0000","last_clean":"2024-04-25T02:07:27.445091+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445091+0000","last_undegraded":"2024-04-25T02:07:27.445091+0000","last_fullsized":"2024-04-25T02:07:27.445091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590113+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:20.590113+0000","last_peered":"2024-04-25T02:07:20.590113+0000","last_clean":"2024-04-25T02:07:20.590113+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:20.590113+0000","last_undegraded":"2024-04-25T02:07:20.590113+0000","last_fullsized":"2024-04-25T02:07:20.590113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409620+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:20.409620+0000","last_peered":"2024-04-25T02:07:20.409620+0000","last_clean":"2024-04-25T02:07:20.409620+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:20.409620+0000","last_undegraded":"2024-04-25T02:07:20.409620+0000","last_fullsized":"2024-04-25T02:07:20.409620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591324+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:20.591324+0000","last_peered":"2024-04-25T02:07:20.591324+0000","last_clean":"2024-04-25T02:07:20.591324+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:20.591324+0000","last_undegraded":"2024-04-25T02:07:20.591324+0000","last_fullsized":"2024-04-25T02:07:20.591324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440730+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:26.440730+0000","last_peered":"2024-04-25T02:07:26.440730+0000","last_clean":"2024-04-25T02:07:26.440730+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:26.440730+0000","last_undegraded":"2024-04-25T02:07:26.440730+0000","last_fullsized":"2024-04-25T02:07:26.440730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413428+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:20.413428+0000","last_peered":"2024-04-25T02:07:20.413428+0000","last_clean":"2024-04-25T02:07:20.413428+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:20.413428+0000","last_undegraded":"2024-04-25T02:07:20.413428+0000","last_fullsized":"2024-04-25T02:07:20.413428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442301+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:26.442301+0000","last_peered":"2024-04-25T02:07:26.442301+0000","last_clean":"2024-04-25T02:07:26.442301+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:26.442301+0000","last_undegraded":"2024-04-25T02:07:26.442301+0000","last_fullsized":"2024-04-25T02:07:26.442301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452720+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:26.452720+0000","last_peered":"2024-04-25T02:07:26.452720+0000","last_clean":"2024-04-25T02:07:26.452720+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:26.452720+0000","last_undegraded":"2024-04-25T02:07:26.452720+0000","last_fullsized":"2024-04-25T02:07:26.452720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.386004+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:22.386004+0000","last_peered":"2024-04-25T02:07:22.386004+0000","last_clean":"2024-04-25T02:07:22.386004+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:22.386004+0000","last_undegraded":"2024-04-25T02:07:22.386004+0000","last_fullsized":"2024-04-25T02:07:22.386004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409231+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:20.409231+0000","last_peered":"2024-04-25T02:07:20.409231+0000","last_clean":"2024-04-25T02:07:20.409231+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:20.409231+0000","last_undegraded":"2024-04-25T02:07:20.409231+0000","last_fullsized":"2024-04-25T02:07:20.409231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.388504+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:22.388504+0000","last_peered":"2024-04-25T02:07:22.388504+0000","last_clean":"2024-04-25T02:07:22.388504+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:22.388504+0000","last_undegraded":"2024-04-25T02:07:22.388504+0000","last_fullsized":"2024-04-25T02:07:22.388504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382605+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:20.382605+0000","last_peered":"2024-04-25T02:07:20.382605+0000","last_clean":"2024-04-25T02:07:20.382605+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:20.382605+0000","last_undegraded":"2024-04-25T02:07:20.382605+0000","last_fullsized":"2024-04-25T02:07:20.382605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413081+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:20.413081+0000","last_peered":"2024-04-25T02:07:20.413081+0000","last_clean":"2024-04-25T02:07:20.413081+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:20.413081+0000","last_undegraded":"2024-04-25T02:07:20.413081+0000","last_fullsized":"2024-04-25T02:07:20.413081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381602+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:22.381602+0000","last_peered":"2024-04-25T02:07:22.381602+0000","last_clean":"2024-04-25T02:07:22.381602+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:22.381602+0000","last_undegraded":"2024-04-25T02:07:22.381602+0000","last_fullsized":"2024-04-25T02:07:22.381602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399346+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:23.399346+0000","last_peered":"2024-04-25T02:07:23.399346+0000","last_clean":"2024-04-25T02:07:23.399346+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:23.399346+0000","last_undegraded":"2024-04-25T02:07:23.399346+0000","last_fullsized":"2024-04-25T02:07:23.399346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588155+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:20.588155+0000","last_peered":"2024-04-25T02:07:20.588155+0000","last_clean":"2024-04-25T02:07:20.588155+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:20.588155+0000","last_undegraded":"2024-04-25T02:07:20.588155+0000","last_fullsized":"2024-04-25T02:07:20.588155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590730+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:20.590730+0000","last_peered":"2024-04-25T02:07:20.590730+0000","last_clean":"2024-04-25T02:07:20.590730+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:20.590730+0000","last_undegraded":"2024-04-25T02:07:20.590730+0000","last_fullsized":"2024-04-25T02:07:20.590730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382638+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:20.382638+0000","last_peered":"2024-04-25T02:07:20.382638+0000","last_clean":"2024-04-25T02:07:20.382638+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:20.382638+0000","last_undegraded":"2024-04-25T02:07:20.382638+0000","last_fullsized":"2024-04-25T02:07:20.382638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382450+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:20.382450+0000","last_peered":"2024-04-25T02:07:20.382450+0000","last_clean":"2024-04-25T02:07:20.382450+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:20.382450+0000","last_undegraded":"2024-04-25T02:07:20.382450+0000","last_fullsized":"2024-04-25T02:07:20.382450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.453158+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:26.453158+0000","last_peered":"2024-04-25T02:07:26.453158+0000","last_clean":"2024-04-25T02:07:26.453158+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:26.453158+0000","last_undegraded":"2024-04-25T02:07:26.453158+0000","last_fullsized":"2024-04-25T02:07:26.453158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591502+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:20.591502+0000","last_peered":"2024-04-25T02:07:20.591502+0000","last_clean":"2024-04-25T02:07:20.591502+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:20.591502+0000","last_undegraded":"2024-04-25T02:07:20.591502+0000","last_fullsized":"2024-04-25T02:07:20.591502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.383007+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:20.383007+0000","last_peered":"2024-04-25T02:07:20.383007+0000","last_clean":"2024-04-25T02:07:20.383007+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:20.383007+0000","last_undegraded":"2024-04-25T02:07:20.383007+0000","last_fullsized":"2024-04-25T02:07:20.383007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413207+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:20.413207+0000","last_peered":"2024-04-25T02:07:20.413207+0000","last_clean":"2024-04-25T02:07:20.413207+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:20.413207+0000","last_undegraded":"2024-04-25T02:07:20.413207+0000","last_fullsized":"2024-04-25T02:07:20.413207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587830+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:20.587830+0000","last_peered":"2024-04-25T02:07:20.587830+0000","last_clean":"2024-04-25T02:07:20.587830+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:20.587830+0000","last_undegraded":"2024-04-25T02:07:20.587830+0000","last_fullsized":"2024-04-25T02:07:20.587830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.411899+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:20.411899+0000","last_peered":"2024-04-25T02:07:20.411899+0000","last_clean":"2024-04-25T02:07:20.411899+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:20.411899+0000","last_undegraded":"2024-04-25T02:07:20.411899+0000","last_fullsized":"2024-04-25T02:07:20.411899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588179+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:20.588179+0000","last_peered":"2024-04-25T02:07:20.588179+0000","last_clean":"2024-04-25T02:07:20.588179+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:20.588179+0000","last_undegraded":"2024-04-25T02:07:20.588179+0000","last_fullsized":"2024-04-25T02:07:20.588179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591437+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:20.591437+0000","last_peered":"2024-04-25T02:07:20.591437+0000","last_clean":"2024-04-25T02:07:20.591437+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:20.591437+0000","last_undegraded":"2024-04-25T02:07:20.591437+0000","last_fullsized":"2024-04-25T02:07:20.591437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":42585,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":141,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":73519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":447746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1051870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":459416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":441483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32676,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712476,"statfs":{"total":95995035648,"available":95961575424,"internally_reserved":0,"allocated":1536000,"data_stored":1030365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":40162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:07:28.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:28.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:28 smithi163 ceph-mon[32577]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:28.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:28 smithi163 ceph-mon[32577]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T02:07:28.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:28 smithi163 ceph-mon[32577]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-04-25T02:07:28.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:28 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2499684298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:28.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:28 smithi174 ceph-mon[33171]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:07:28.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:28 smithi174 ceph-mon[33171]: osdmap e87: 12 total, 12 up, 12 in 2024-04-25T02:07:28.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:28 smithi174 ceph-mon[33171]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-04-25T02:07:28.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:28 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2499684298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.001+0000 7f5ebce00640 1 -- 172.21.15.137:0/3652163736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8109770 msgr2=0x7f5eb8110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.001+0000 7f5ebce00640 1 --2- 172.21.15.137:0/3652163736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8109770 0x7f5eb8110000 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009ca0 tx=0x7f5eb002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 -- 172.21.15.137:0/3652163736 shutdown_connections 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 --2- 172.21.15.137:0/3652163736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8109770 0x7f5eb8110000 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 --2- 172.21.15.137:0/3652163736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8108db0 0x7f5eb8109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 --2- 172.21.15.137:0/3652163736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8107bc0 0x7f5eb8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 -- 172.21.15.137:0/3652163736 >> 172.21.15.137:0/3652163736 conn(0x7f5eb8076b80 msgr2=0x7f5eb8078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 -- 172.21.15.137:0/3652163736 shutdown_connections 2024-04-25T02:07:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.002+0000 7f5ebce00640 1 -- 172.21.15.137:0/3652163736 wait complete. 2024-04-25T02:07:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 Processor -- start 2024-04-25T02:07:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 -- start start 2024-04-25T02:07:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8108db0 0x7f5eb819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8109770 0x7f5eb81a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81139c0 con 0x7f5eb8107bc0 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8113840 con 0x7f5eb8108db0 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.003+0000 7f5ebce00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8113b40 con 0x7f5eb8109770 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40072/0 (socket says 172.21.15.137:40072) 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 -- 172.21.15.137:0/2919742645 learned_addr learned my addr 172.21.15.137:0/2919742645 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eafe00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8108db0 0x7f5eb819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7e00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8109770 0x7f5eb81a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 -- 172.21.15.137:0/2919742645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8109770 msgr2=0x7f5eb81a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8109770 0x7f5eb81a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 -- 172.21.15.137:0/2919742645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8108db0 msgr2=0x7f5eb819e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8108db0 0x7f5eb819e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 -- 172.21.15.137:0/2919742645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb81a5b40 con 0x7f5eb8107bc0 2024-04-25T02:07:29.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.004+0000 7f5eb7400640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e9c0 tx=0x7f5ea800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:29.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.005+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800cd80 con 0x7f5eb8107bc0 2024-04-25T02:07:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.005+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea80035f0 con 0x7f5eb8107bc0 2024-04-25T02:07:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.005+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb81a5e30 con 0x7f5eb8107bc0 2024-04-25T02:07:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.005+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8010690 con 0x7f5eb8107bc0 2024-04-25T02:07:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.005+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81a6290 con 0x7f5eb8107bc0 2024-04-25T02:07:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.006+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb810ee10 con 0x7f5eb8107bc0 2024-04-25T02:07:29.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.008+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ea80037a0 con 0x7f5eb8107bc0 2024-04-25T02:07:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.009+0000 7f5eb4c00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 0x7f5e9c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.010+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f5ea80cf610 con 0x7f5eb8107bc0 2024-04-25T02:07:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.010+0000 7f5eafe00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 0x7f5e9c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.010+0000 7f5eafe00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 0x7f5e9c0a50e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5eb819f430 tx=0x7f5ea0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:29.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.014+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5ea809c3c0 con 0x7f5eb8107bc0 2024-04-25T02:07:29.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.213+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5eb8061b80 con 0x7f5e9c0a2c20 2024-04-25T02:07:29.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.235+0000 7f5eb4c00640 1 -- 172.21.15.137:0/2919742645 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258608 (secure 0 0 0) 0x7f5eb8061b80 con 0x7f5e9c0a2c20 2024-04-25T02:07:29.244 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:29.246 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 msgr2=0x7f5e9c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 0x7f5e9c0a50e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5eb819f430 tx=0x7f5ea0005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 msgr2=0x7f5eb819df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e9c0 tx=0x7f5ea800ee80 comp rx=0 tx=0).stop 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 shutdown_connections 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5e9c0a2c20 0x7f5e9c0a50e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5eb8109770 0x7f5eb81a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eb8108db0 0x7f5eb819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 --2- 172.21.15.137:0/2919742645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5eb8107bc0 0x7f5eb819df20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 >> 172.21.15.137:0/2919742645 conn(0x7f5eb8076b80 msgr2=0x7f5eb810bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 shutdown_connections 2024-04-25T02:07:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.241+0000 7f5ebce00640 1 -- 172.21.15.137:0/2919742645 wait complete. 2024-04-25T02:07:29.267 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-04-25T02:07:28.375357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":633187,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":167,"num_read_kb":177,"num_write":324,"num_write_kb":3020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":262,"ondisk_log_size":262,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370232,"kb_used_data":12748,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571592,"statfs":{"total":1151940427776,"available":1151561310208,"internally_reserved":0,"allocated":13053952,"data_stored":7114921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42625,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":135,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.994159"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452593+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:26.452593+0000","last_peered":"2024-04-25T02:07:26.452593+0000","last_clean":"2024-04-25T02:07:26.452593+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:26.452593+0000","last_undegraded":"2024-04-25T02:07:26.452593+0000","last_fullsized":"2024-04-25T02:07:26.452593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452550+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:26.452550+0000","last_peered":"2024-04-25T02:07:26.452550+0000","last_clean":"2024-04-25T02:07:26.452550+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:26.452550+0000","last_undegraded":"2024-04-25T02:07:26.452550+0000","last_fullsized":"2024-04-25T02:07:26.452550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442056+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:26.442056+0000","last_peered":"2024-04-25T02:07:26.442056+0000","last_clean":"2024-04-25T02:07:26.442056+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:26.442056+0000","last_undegraded":"2024-04-25T02:07:26.442056+0000","last_fullsized":"2024-04-25T02:07:26.442056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409309+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:20.409309+0000","last_peered":"2024-04-25T02:07:20.409309+0000","last_clean":"2024-04-25T02:07:20.409309+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:20.409309+0000","last_undegraded":"2024-04-25T02:07:20.409309+0000","last_fullsized":"2024-04-25T02:07:20.409309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443972+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:26.443972+0000","last_peered":"2024-04-25T02:07:26.443972+0000","last_clean":"2024-04-25T02:07:26.443972+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:26.443972+0000","last_undegraded":"2024-04-25T02:07:26.443972+0000","last_fullsized":"2024-04-25T02:07:26.443972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412144+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:20.412144+0000","last_peered":"2024-04-25T02:07:20.412144+0000","last_clean":"2024-04-25T02:07:20.412144+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:20.412144+0000","last_undegraded":"2024-04-25T02:07:20.412144+0000","last_fullsized":"2024-04-25T02:07:20.412144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588818+0000","last_change":"2024-04-25T02:07:19.369352+0000","last_active":"2024-04-25T02:07:20.588818+0000","last_peered":"2024-04-25T02:07:20.588818+0000","last_clean":"2024-04-25T02:07:20.588818+0000","last_became_active":"2024-04-25T02:07:19.368863+0000","last_became_peered":"2024-04-25T02:07:19.368863+0000","last_unstale":"2024-04-25T02:07:20.588818+0000","last_undegraded":"2024-04-25T02:07:20.588818+0000","last_fullsized":"2024-04-25T02:07:20.588818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:37.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444218+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:26.444218+0000","last_peered":"2024-04-25T02:07:26.444218+0000","last_clean":"2024-04-25T02:07:26.444218+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:26.444218+0000","last_undegraded":"2024-04-25T02:07:26.444218+0000","last_fullsized":"2024-04-25T02:07:26.444218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441916+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:26.441916+0000","last_peered":"2024-04-25T02:07:26.441916+0000","last_clean":"2024-04-25T02:07:26.441916+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:26.441916+0000","last_undegraded":"2024-04-25T02:07:26.441916+0000","last_fullsized":"2024-04-25T02:07:26.441916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591593+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:20.591593+0000","last_peered":"2024-04-25T02:07:20.591593+0000","last_clean":"2024-04-25T02:07:20.591593+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:20.591593+0000","last_undegraded":"2024-04-25T02:07:20.591593+0000","last_fullsized":"2024-04-25T02:07:20.591593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.450661+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:26.450661+0000","last_peered":"2024-04-25T02:07:26.450661+0000","last_clean":"2024-04-25T02:07:26.450661+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:26.450661+0000","last_undegraded":"2024-04-25T02:07:26.450661+0000","last_fullsized":"2024-04-25T02:07:26.450661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.808650+0000","last_change":"2024-04-25T02:07:26.452206+0000","last_active":"2024-04-25T02:07:26.452206+0000","last_peered":"2024-04-25T02:07:21.808650+0000","last_clean":"2024-04-25T02:07:21.808650+0000","last_became_active":"2024-04-25T02:07:19.393672+0000","last_became_peered":"2024-04-25T02:07:19.393672+0000","last_unstale":"2024-04-25T02:07:21.808650+0000","last_undegraded":"2024-04-25T02:07:21.808650+0000","last_fullsized":"2024-04-25T02:07:21.808650+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587795+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:20.587795+0000","last_peered":"2024-04-25T02:07:20.587795+0000","last_clean":"2024-04-25T02:07:20.587795+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:20.587795+0000","last_undegraded":"2024-04-25T02:07:20.587795+0000","last_fullsized":"2024-04-25T02:07:20.587795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440863+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:26.440863+0000","last_peered":"2024-04-25T02:07:26.440863+0000","last_clean":"2024-04-25T02:07:26.440863+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:26.440863+0000","last_undegraded":"2024-04-25T02:07:26.440863+0000","last_fullsized":"2024-04-25T02:07:26.440863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382630+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:20.382630+0000","last_peered":"2024-04-25T02:07:20.382630+0000","last_clean":"2024-04-25T02:07:20.382630+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:20.382630+0000","last_undegraded":"2024-04-25T02:07:20.382630+0000","last_fullsized":"2024-04-25T02:07:20.382630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:24.403779+0000","last_change":"2024-04-25T02:07:26.439997+0000","last_active":"2024-04-25T02:07:26.439997+0000","last_peered":"2024-04-25T02:07:24.403779+0000","last_clean":"2024-04-25T02:07:24.403779+0000","last_became_active":"2024-04-25T02:07:18.412408+0000","last_became_peered":"2024-04-25T02:07:18.412408+0000","last_unstale":"2024-04-25T02:07:24.403779+0000","last_undegraded":"2024-04-25T02:07:24.403779+0000","last_fullsized":"2024-04-25T02:07:24.403779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,8],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412726+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:20.412726+0000","last_peered":"2024-04-25T02:07:20.412726+0000","last_clean":"2024-04-25T02:07:20.412726+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:20.412726+0000","last_undegraded":"2024-04-25T02:07:20.412726+0000","last_fullsized":"2024-04-25T02:07:20.412726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.617568+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:20.617568+0000","last_peered":"2024-04-25T02:07:20.617568+0000","last_clean":"2024-04-25T02:07:20.617568+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:20.617568+0000","last_undegraded":"2024-04-25T02:07:20.617568+0000","last_fullsized":"2024-04-25T02:07:20.617568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452817+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:26.452817+0000","last_peered":"2024-04-25T02:07:26.452817+0000","last_clean":"2024-04-25T02:07:26.452817+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:26.452817+0000","last_undegraded":"2024-04-25T02:07:26.452817+0000","last_fullsized":"2024-04-25T02:07:26.452817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.391807+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:23.391807+0000","last_peered":"2024-04-25T02:07:23.391807+0000","last_clean":"2024-04-25T02:07:23.391807+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:23.391807+0000","last_undegraded":"2024-04-25T02:07:23.391807+0000","last_fullsized":"2024-04-25T02:07:23.391807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588113+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:20.588113+0000","last_peered":"2024-04-25T02:07:20.588113+0000","last_clean":"2024-04-25T02:07:20.588113+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:20.588113+0000","last_undegraded":"2024-04-25T02:07:20.588113+0000","last_fullsized":"2024-04-25T02:07:20.588113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409556+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:20.409556+0000","last_peered":"2024-04-25T02:07:20.409556+0000","last_clean":"2024-04-25T02:07:20.409556+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:20.409556+0000","last_undegraded":"2024-04-25T02:07:20.409556+0000","last_fullsized":"2024-04-25T02:07:20.409556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588324+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:20.588324+0000","last_peered":"2024-04-25T02:07:20.588324+0000","last_clean":"2024-04-25T02:07:20.588324+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:20.588324+0000","last_undegraded":"2024-04-25T02:07:20.588324+0000","last_fullsized":"2024-04-25T02:07:20.588324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:24.401752+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:07:24.401752+0000","last_peered":"2024-04-25T02:07:24.401752+0000","last_clean":"2024-04-25T02:07:24.401752+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:07:24.401752+0000","last_undegraded":"2024-04-25T02:07:24.401752+0000","last_fullsized":"2024-04-25T02:07:24.401752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409396+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:20.409396+0000","last_peered":"2024-04-25T02:07:20.409396+0000","last_clean":"2024-04-25T02:07:20.409396+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:20.409396+0000","last_undegraded":"2024-04-25T02:07:20.409396+0000","last_fullsized":"2024-04-25T02:07:20.409396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443897+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:26.443897+0000","last_peered":"2024-04-25T02:07:26.443897+0000","last_clean":"2024-04-25T02:07:26.443897+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:26.443897+0000","last_undegraded":"2024-04-25T02:07:26.443897+0000","last_fullsized":"2024-04-25T02:07:26.443897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588071+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:20.588071+0000","last_peered":"2024-04-25T02:07:20.588071+0000","last_clean":"2024-04-25T02:07:20.588071+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:20.588071+0000","last_undegraded":"2024-04-25T02:07:20.588071+0000","last_fullsized":"2024-04-25T02:07:20.588071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399328+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:23.399328+0000","last_peered":"2024-04-25T02:07:23.399328+0000","last_clean":"2024-04-25T02:07:23.399328+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:23.399328+0000","last_undegraded":"2024-04-25T02:07:23.399328+0000","last_fullsized":"2024-04-25T02:07:23.399328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":2,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-25T02:07:20.617139+0000","last_change":"2024-04-25T02:07:26.535367+0000","last_active":"2024-04-25T02:07:26.535367+0000","last_peered":"2024-04-25T02:07:20.617139+0000","last_clean":"2024-04-25T02:07:20.617139+0000","last_became_active":"2024-04-25T02:07:19.389991+0000","last_became_peered":"2024-04-25T02:07:19.389991+0000","last_unstale":"2024-04-25T02:07:20.617139+0000","last_undegraded":"2024-04-25T02:07:20.617139+0000","last_fullsized":"2024-04-25T02:07:20.617139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587713+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:20.587713+0000","last_peered":"2024-04-25T02:07:20.587713+0000","last_clean":"2024-04-25T02:07:20.587713+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:20.587713+0000","last_undegraded":"2024-04-25T02:07:20.587713+0000","last_fullsized":"2024-04-25T02:07:20.587713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.439736+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:26.439736+0000","last_peered":"2024-04-25T02:07:26.439736+0000","last_clean":"2024-04-25T02:07:26.439736+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:26.439736+0000","last_undegraded":"2024-04-25T02:07:26.439736+0000","last_fullsized":"2024-04-25T02:07:26.439736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444223+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:07:26.444223+0000","last_peered":"2024-04-25T02:07:26.444223+0000","last_clean":"2024-04-25T02:07:26.444223+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:07:26.444223+0000","last_undegraded":"2024-04-25T02:07:26.444223+0000","last_fullsized":"2024-04-25T02:07:26.444223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588744+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:20.588744+0000","last_peered":"2024-04-25T02:07:20.588744+0000","last_clean":"2024-04-25T02:07:20.588744+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:20.588744+0000","last_undegraded":"2024-04-25T02:07:20.588744+0000","last_fullsized":"2024-04-25T02:07:20.588744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452614+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:26.452614+0000","last_peered":"2024-04-25T02:07:26.452614+0000","last_clean":"2024-04-25T02:07:26.452614+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:26.452614+0000","last_undegraded":"2024-04-25T02:07:26.452614+0000","last_fullsized":"2024-04-25T02:07:26.452614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.383503+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:22.383503+0000","last_peered":"2024-04-25T02:07:22.383503+0000","last_clean":"2024-04-25T02:07:22.383503+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:22.383503+0000","last_undegraded":"2024-04-25T02:07:22.383503+0000","last_fullsized":"2024-04-25T02:07:22.383503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588353+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:20.588353+0000","last_peered":"2024-04-25T02:07:20.588353+0000","last_clean":"2024-04-25T02:07:20.588353+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:20.588353+0000","last_undegraded":"2024-04-25T02:07:20.588353+0000","last_fullsized":"2024-04-25T02:07:20.588353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'19","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444061+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:07:26.444061+0000","last_peered":"2024-04-25T02:07:26.444061+0000","last_clean":"2024-04-25T02:07:26.444061+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:07:26.444061+0000","last_undegraded":"2024-04-25T02:07:26.444061+0000","last_fullsized":"2024-04-25T02:07:26.444061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":41,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409609+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:20.409609+0000","last_peered":"2024-04-25T02:07:20.409609+0000","last_clean":"2024-04-25T02:07:20.409609+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:20.409609+0000","last_undegraded":"2024-04-25T02:07:20.409609+0000","last_fullsized":"2024-04-25T02:07:20.409609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591035+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:20.591035+0000","last_peered":"2024-04-25T02:07:20.591035+0000","last_clean":"2024-04-25T02:07:20.591035+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:20.591035+0000","last_undegraded":"2024-04-25T02:07:20.591035+0000","last_fullsized":"2024-04-25T02:07:20.591035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381836+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:22.381836+0000","last_peered":"2024-04-25T02:07:22.381836+0000","last_clean":"2024-04-25T02:07:22.381836+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:22.381836+0000","last_undegraded":"2024-04-25T02:07:22.381836+0000","last_fullsized":"2024-04-25T02:07:22.381836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441938+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:07:26.441938+0000","last_peered":"2024-04-25T02:07:26.441938+0000","last_clean":"2024-04-25T02:07:26.441938+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:07:26.441938+0000","last_undegraded":"2024-04-25T02:07:26.441938+0000","last_fullsized":"2024-04-25T02:07:26.441938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400362+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:23.400362+0000","last_peered":"2024-04-25T02:07:23.400362+0000","last_clean":"2024-04-25T02:07:23.400362+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:23.400362+0000","last_undegraded":"2024-04-25T02:07:23.400362+0000","last_fullsized":"2024-04-25T02:07:23.400362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587784+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:20.587784+0000","last_peered":"2024-04-25T02:07:20.587784+0000","last_clean":"2024-04-25T02:07:20.587784+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:20.587784+0000","last_undegraded":"2024-04-25T02:07:20.587784+0000","last_fullsized":"2024-04-25T02:07:20.587784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409584+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:20.409584+0000","last_peered":"2024-04-25T02:07:20.409584+0000","last_clean":"2024-04-25T02:07:20.409584+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:20.409584+0000","last_undegraded":"2024-04-25T02:07:20.409584+0000","last_fullsized":"2024-04-25T02:07:20.409584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.534816+0000","last_change":"2024-04-25T02:07:26.441856+0000","last_active":"2024-04-25T02:07:26.441856+0000","last_peered":"2024-04-25T02:07:21.534816+0000","last_clean":"2024-04-25T02:07:21.534816+0000","last_became_active":"2024-04-25T02:07:18.422561+0000","last_became_peered":"2024-04-25T02:07:18.422561+0000","last_unstale":"2024-04-25T02:07:21.534816+0000","last_undegraded":"2024-04-25T02:07:21.534816+0000","last_fullsized":"2024-04-25T02:07:21.534816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444068+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:26.444068+0000","last_peered":"2024-04-25T02:07:26.444068+0000","last_clean":"2024-04-25T02:07:26.444068+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:26.444068+0000","last_undegraded":"2024-04-25T02:07:26.444068+0000","last_fullsized":"2024-04-25T02:07:26.444068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.582905+0000","last_change":"2024-04-25T02:07:26.444328+0000","last_active":"2024-04-25T02:07:26.444328+0000","last_peered":"2024-04-25T02:07:21.582905+0000","last_clean":"2024-04-25T02:07:21.582905+0000","last_became_active":"2024-04-25T02:07:19.384064+0000","last_became_peered":"2024-04-25T02:07:19.384064+0000","last_unstale":"2024-04-25T02:07:21.582905+0000","last_undegraded":"2024-04-25T02:07:21.582905+0000","last_fullsized":"2024-04-25T02:07:21.582905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587867+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:20.587867+0000","last_peered":"2024-04-25T02:07:20.587867+0000","last_clean":"2024-04-25T02:07:20.587867+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:20.587867+0000","last_undegraded":"2024-04-25T02:07:20.587867+0000","last_fullsized":"2024-04-25T02:07:20.587867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400286+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:07:23.400286+0000","last_peered":"2024-04-25T02:07:23.400286+0000","last_clean":"2024-04-25T02:07:23.400286+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:07:23.400286+0000","last_undegraded":"2024-04-25T02:07:23.400286+0000","last_fullsized":"2024-04-25T02:07:23.400286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412174+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:20.412174+0000","last_peered":"2024-04-25T02:07:20.412174+0000","last_clean":"2024-04-25T02:07:20.412174+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:20.412174+0000","last_undegraded":"2024-04-25T02:07:20.412174+0000","last_fullsized":"2024-04-25T02:07:20.412174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441921+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:26.441921+0000","last_peered":"2024-04-25T02:07:26.441921+0000","last_clean":"2024-04-25T02:07:26.441921+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:26.441921+0000","last_undegraded":"2024-04-25T02:07:26.441921+0000","last_fullsized":"2024-04-25T02:07:26.441921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445091+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445091+0000","last_peered":"2024-04-25T02:07:27.445091+0000","last_clean":"2024-04-25T02:07:27.445091+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445091+0000","last_undegraded":"2024-04-25T02:07:27.445091+0000","last_fullsized":"2024-04-25T02:07:27.445091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590113+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:20.590113+0000","last_peered":"2024-04-25T02:07:20.590113+0000","last_clean":"2024-04-25T02:07:20.590113+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:20.590113+0000","last_undegraded":"2024-04-25T02:07:20.590113+0000","last_fullsized":"2024-04-25T02:07:20.590113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409620+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:20.409620+0000","last_peered":"2024-04-25T02:07:20.409620+0000","last_clean":"2024-04-25T02:07:20.409620+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:20.409620+0000","last_undegraded":"2024-04-25T02:07:20.409620+0000","last_fullsized":"2024-04-25T02:07:20.409620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591324+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:20.591324+0000","last_peered":"2024-04-25T02:07:20.591324+0000","last_clean":"2024-04-25T02:07:20.591324+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:20.591324+0000","last_undegraded":"2024-04-25T02:07:20.591324+0000","last_fullsized":"2024-04-25T02:07:20.591324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440730+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:26.440730+0000","last_peered":"2024-04-25T02:07:26.440730+0000","last_clean":"2024-04-25T02:07:26.440730+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:26.440730+0000","last_undegraded":"2024-04-25T02:07:26.440730+0000","last_fullsized":"2024-04-25T02:07:26.440730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413428+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:20.413428+0000","last_peered":"2024-04-25T02:07:20.413428+0000","last_clean":"2024-04-25T02:07:20.413428+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:20.413428+0000","last_undegraded":"2024-04-25T02:07:20.413428+0000","last_fullsized":"2024-04-25T02:07:20.413428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442301+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:26.442301+0000","last_peered":"2024-04-25T02:07:26.442301+0000","last_clean":"2024-04-25T02:07:26.442301+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:26.442301+0000","last_undegraded":"2024-04-25T02:07:26.442301+0000","last_fullsized":"2024-04-25T02:07:26.442301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452720+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:26.452720+0000","last_peered":"2024-04-25T02:07:26.452720+0000","last_clean":"2024-04-25T02:07:26.452720+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:26.452720+0000","last_undegraded":"2024-04-25T02:07:26.452720+0000","last_fullsized":"2024-04-25T02:07:26.452720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.386004+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:22.386004+0000","last_peered":"2024-04-25T02:07:22.386004+0000","last_clean":"2024-04-25T02:07:22.386004+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:22.386004+0000","last_undegraded":"2024-04-25T02:07:22.386004+0000","last_fullsized":"2024-04-25T02:07:22.386004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409231+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:20.409231+0000","last_peered":"2024-04-25T02:07:20.409231+0000","last_clean":"2024-04-25T02:07:20.409231+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:20.409231+0000","last_undegraded":"2024-04-25T02:07:20.409231+0000","last_fullsized":"2024-04-25T02:07:20.409231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.388504+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:22.388504+0000","last_peered":"2024-04-25T02:07:22.388504+0000","last_clean":"2024-04-25T02:07:22.388504+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:22.388504+0000","last_undegraded":"2024-04-25T02:07:22.388504+0000","last_fullsized":"2024-04-25T02:07:22.388504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382605+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:20.382605+0000","last_peered":"2024-04-25T02:07:20.382605+0000","last_clean":"2024-04-25T02:07:20.382605+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:20.382605+0000","last_undegraded":"2024-04-25T02:07:20.382605+0000","last_fullsized":"2024-04-25T02:07:20.382605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413081+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:20.413081+0000","last_peered":"2024-04-25T02:07:20.413081+0000","last_clean":"2024-04-25T02:07:20.413081+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:20.413081+0000","last_undegraded":"2024-04-25T02:07:20.413081+0000","last_fullsized":"2024-04-25T02:07:20.413081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381602+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:22.381602+0000","last_peered":"2024-04-25T02:07:22.381602+0000","last_clean":"2024-04-25T02:07:22.381602+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:22.381602+0000","last_undegraded":"2024-04-25T02:07:22.381602+0000","last_fullsized":"2024-04-25T02:07:22.381602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399346+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:23.399346+0000","last_peered":"2024-04-25T02:07:23.399346+0000","last_clean":"2024-04-25T02:07:23.399346+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:23.399346+0000","last_undegraded":"2024-04-25T02:07:23.399346+0000","last_fullsized":"2024-04-25T02:07:23.399346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588155+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:20.588155+0000","last_peered":"2024-04-25T02:07:20.588155+0000","last_clean":"2024-04-25T02:07:20.588155+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:20.588155+0000","last_undegraded":"2024-04-25T02:07:20.588155+0000","last_fullsized":"2024-04-25T02:07:20.588155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590730+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:20.590730+0000","last_peered":"2024-04-25T02:07:20.590730+0000","last_clean":"2024-04-25T02:07:20.590730+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:20.590730+0000","last_undegraded":"2024-04-25T02:07:20.590730+0000","last_fullsized":"2024-04-25T02:07:20.590730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382638+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:20.382638+0000","last_peered":"2024-04-25T02:07:20.382638+0000","last_clean":"2024-04-25T02:07:20.382638+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:20.382638+0000","last_undegraded":"2024-04-25T02:07:20.382638+0000","last_fullsized":"2024-04-25T02:07:20.382638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382450+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:20.382450+0000","last_peered":"2024-04-25T02:07:20.382450+0000","last_clean":"2024-04-25T02:07:20.382450+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:20.382450+0000","last_undegraded":"2024-04-25T02:07:20.382450+0000","last_fullsized":"2024-04-25T02:07:20.382450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.453158+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:26.453158+0000","last_peered":"2024-04-25T02:07:26.453158+0000","last_clean":"2024-04-25T02:07:26.453158+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:26.453158+0000","last_undegraded":"2024-04-25T02:07:26.453158+0000","last_fullsized":"2024-04-25T02:07:26.453158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591502+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:20.591502+0000","last_peered":"2024-04-25T02:07:20.591502+0000","last_clean":"2024-04-25T02:07:20.591502+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:20.591502+0000","last_undegraded":"2024-04-25T02:07:20.591502+0000","last_fullsized":"2024-04-25T02:07:20.591502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.383007+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:20.383007+0000","last_peered":"2024-04-25T02:07:20.383007+0000","last_clean":"2024-04-25T02:07:20.383007+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:20.383007+0000","last_undegraded":"2024-04-25T02:07:20.383007+0000","last_fullsized":"2024-04-25T02:07:20.383007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413207+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:20.413207+0000","last_peered":"2024-04-25T02:07:20.413207+0000","last_clean":"2024-04-25T02:07:20.413207+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:20.413207+0000","last_undegraded":"2024-04-25T02:07:20.413207+0000","last_fullsized":"2024-04-25T02:07:20.413207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587830+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:20.587830+0000","last_peered":"2024-04-25T02:07:20.587830+0000","last_clean":"2024-04-25T02:07:20.587830+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:20.587830+0000","last_undegraded":"2024-04-25T02:07:20.587830+0000","last_fullsized":"2024-04-25T02:07:20.587830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.411899+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:20.411899+0000","last_peered":"2024-04-25T02:07:20.411899+0000","last_clean":"2024-04-25T02:07:20.411899+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:20.411899+0000","last_undegraded":"2024-04-25T02:07:20.411899+0000","last_fullsized":"2024-04-25T02:07:20.411899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588179+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:20.588179+0000","last_peered":"2024-04-25T02:07:20.588179+0000","last_clean":"2024-04-25T02:07:20.588179+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:20.588179+0000","last_undegraded":"2024-04-25T02:07:20.588179+0000","last_fullsized":"2024-04-25T02:07:20.588179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591437+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:20.591437+0000","last_peered":"2024-04-25T02:07:20.591437+0000","last_clean":"2024-04-25T02:07:20.591437+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:20.591437+0000","last_undegraded":"2024-04-25T02:07:20.591437+0000","last_fullsized":"2024-04-25T02:07:20.591437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":42585,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":141,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":73519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":447746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1051870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":459416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":441483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32676,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712476,"statfs":{"total":95995035648,"available":95961575424,"internally_reserved":0,"allocated":1536000,"data_stored":1030365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":40162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:07:29.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-04-25T02:07:29.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 85, 'state': 'peering', 'last_fresh': '2024-04-25T02:07:21.808650+0000', 'last_change': '2024-04-25T02:07:26.452206+0000', 'last_active': '2024-04-25T02:07:26.452206+0000', 'last_peered': '2024-04-25T02:07:21.808650+0000', 'last_clean': '2024-04-25T02:07:21.808650+0000', 'last_became_active': '2024-04-25T02:07:19.393672+0000', 'last_became_peered': '2024-04-25T02:07:19.393672+0000', 'last_unstale': '2024-04-25T02:07:21.808650+0000', 'last_undegraded': '2024-04-25T02:07:21.808650+0000', 'last_fullsized': '2024-04-25T02:07:21.808650+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_clean_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 8, 2], 'acting': [0, 8, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2, 4, 8], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "85'9", 'reported_seq': 26, 'reported_epoch': 85, 'state': 'peering', 'last_fresh': '2024-04-25T02:07:24.403779+0000', 'last_change': '2024-04-25T02:07:26.439997+0000', 'last_active': '2024-04-25T02:07:26.439997+0000', 'last_peered': '2024-04-25T02:07:24.403779+0000', 'last_clean': '2024-04-25T02:07:24.403779+0000', 'last_became_active': '2024-04-25T02:07:18.412408+0000', 'last_became_peered': '2024-04-25T02:07:18.412408+0000', 'last_unstale': '2024-04-25T02:07:24.403779+0000', 'last_undegraded': '2024-04-25T02:07:24.403779+0000', 'last_fullsized': '2024-04-25T02:07:24.403779+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'last_clean_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'objects_scrubbed': 0, 'log_size': 9, 'log_dups_size': 0, 'ondisk_log_size': 9, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 582, 'num_objects': 4, 'num_object_clones': 0, 'num_object_copies': 12, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 4, 'num_whiteouts': 0, 'num_read': 1, 'num_read_kb': 1, 'num_write': 10, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 3, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 7, 4], 'acting': [9, 7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 7, 8], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 86, 'state': 'peering', 'last_fresh': '2024-04-25T02:07:20.617139+0000', 'last_change': '2024-04-25T02:07:26.535367+0000', 'last_active': '2024-04-25T02:07:26.535367+0000', 'last_peered': '2024-04-25T02:07:20.617139+0000', 'last_clean': '2024-04-25T02:07:20.617139+0000', 'last_became_active': '2024-04-25T02:07:19.389991+0000', 'last_became_peered': '2024-04-25T02:07:19.389991+0000', 'last_unstale': '2024-04-25T02:07:20.617139+0000', 'last_undegraded': '2024-04-25T02:07:20.617139+0000', 'last_fullsized': '2024-04-25T02:07:20.617139+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_clean_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 11, 6], 'acting': [9, 11, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 16, 'reported_epoch': 85, 'state': 'peering', 'last_fresh': '2024-04-25T02:07:21.534816+0000', 'last_change': '2024-04-25T02:07:26.441856+0000', 'last_active': '2024-04-25T02:07:26.441856+0000', 'last_peered': '2024-04-25T02:07:21.534816+0000', 'last_clean': '2024-04-25T02:07:21.534816+0000', 'last_became_active': '2024-04-25T02:07:18.422561+0000', 'last_became_peered': '2024-04-25T02:07:18.422561+0000', 'last_unstale': '2024-04-25T02:07:21.534816+0000', 'last_undegraded': '2024-04-25T02:07:21.534816+0000', 'last_fullsized': '2024-04-25T02:07:21.534816+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'last_clean_scrub_stamp': '2024-04-25T02:07:17.384268+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 11, 0], 'acting': [9, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2, 11], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-25T02:07:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 85, 'state': 'peering', 'last_fresh': '2024-04-25T02:07:21.582905+0000', 'last_change': '2024-04-25T02:07:26.444328+0000', 'last_active': '2024-04-25T02:07:26.444328+0000', 'last_peered': '2024-04-25T02:07:21.582905+0000', 'last_clean': '2024-04-25T02:07:21.582905+0000', 'last_became_active': '2024-04-25T02:07:19.384064+0000', 'last_became_peered': '2024-04-25T02:07:19.384064+0000', 'last_unstale': '2024-04-25T02:07:21.582905+0000', 'last_undegraded': '2024-04-25T02:07:21.582905+0000', 'last_fullsized': '2024-04-25T02:07:21.582905+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'last_clean_scrub_stamp': '2024-04-25T02:07:18.389719+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 9, 0], 'acting': [10, 9, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 4, 9], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-04-25T02:07:29.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T02:07:29.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 -- 172.21.15.137:0/422670012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e8102040 msgr2=0x7fc0e8104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 --2- 172.21.15.137:0/422670012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e8102040 0x7fc0e8104430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009ca0 tx=0x7fc0d802a8c0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 -- 172.21.15.137:0/422670012 shutdown_connections 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 --2- 172.21.15.137:0/422670012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e81072a0 0x7fc0e81096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 --2- 172.21.15.137:0/422670012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8104970 0x7fc0e8106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 --2- 172.21.15.137:0/422670012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e8102040 0x7fc0e8104430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 -- 172.21.15.137:0/422670012 >> 172.21.15.137:0/422670012 conn(0x7fc0e80fba10 msgr2=0x7fc0e80fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 -- 172.21.15.137:0/422670012 shutdown_connections 2024-04-25T02:07:29.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.506+0000 7fc0ed000640 1 -- 172.21.15.137:0/422670012 wait complete. 2024-04-25T02:07:29.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 Processor -- start 2024-04-25T02:07:29.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 -- start start 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 0x7fc0e81019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e81072a0 0x7fc0e8100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810d390 con 0x7fc0e8104970 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810d210 con 0x7fc0e81072a0 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.507+0000 7fc0ed000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810d510 con 0x7fc0e8102040 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0dea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 0x7fc0e81019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0dea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40086/0 (socket says 172.21.15.137:40086) 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0dea00640 1 -- 172.21.15.137:0/3863303040 learned_addr learned my addr 172.21.15.137:0/3863303040 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7e00640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e81072a0 0x7fc0e8100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 -- 172.21.15.137:0/3863303040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e81072a0 msgr2=0x7fc0e8100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e81072a0 0x7fc0e8100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 -- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 msgr2=0x7fc0e80ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0e7400640 1 -- 172.21.15.137:0/3863303040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e8100dc0 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.508+0000 7fc0dea00640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0e7400640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 0x7fc0e81019b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8000f80 tx=0x7fc0d8031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d802faa0 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0d802fc40 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e81a1ac0 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80468e0 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.509+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e81a2010 con 0x7fc0e8102040 2024-04-25T02:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.510+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e80fd500 con 0x7fc0e8102040 2024-04-25T02:07:29.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.512+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc0d80305c0 con 0x7fc0e8102040 2024-04-25T02:07:29.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.513+0000 7fc0e4c00640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 0x7fc0cc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:29.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.513+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc0d80f0410 con 0x7fc0e8102040 2024-04-25T02:07:29.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.513+0000 7fc0dea00640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 0x7fc0cc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:29.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.514+0000 7fc0dea00640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 0x7fc0cc0a50e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8101720 tx=0x7fc0d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:29.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.517+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc0d80bd360 con 0x7fc0e8102040 2024-04-25T02:07:29.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:29 smithi137 ceph-mon[28303]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:29.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:29 smithi137 ceph-mon[28303]: pgmap v318: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9.1 KiB/s wr, 20 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:29.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.792+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc0e802d390 con 0x7fc0e8102040 2024-04-25T02:07:29.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.793+0000 7fc0e4c00640 1 -- 172.21.15.137:0/3863303040 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3316 (secure 0 0 0) 0x7fc0d80bcc60 con 0x7fc0e8102040 2024-04-25T02:07:29.800 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:29.800 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":415,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":12,"num_up_osds":12,"osd_up_since":1714010777,"num_in_osds":12,"osd_in_since":1714010756,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":63,"data_bytes":633187,"bytes_used":379117568,"bytes_avail":1151561310208,"bytes_total":1151940427776,"inactive_pgs_ratio":0.051546391099691391,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":4,"recovering_keys_per_sec":1,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"read_bytes_sec":7429,"write_bytes_sec":9350,"read_op_per_sec":3,"write_op_per_sec":16},"fsmap":{"epoch":22,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24488},{"filesystem_id":1,"rank":1,"name":"h","status":"up:standby-replay","gid":24512},{"filesystem_id":1,"rank":0,"name":"f","status":"up:standby-replay","gid":24526},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24538},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24559},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24560}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.137:8443/"}},"servicemap":{"epoch":18,"modified":"2024-04-25T02:07:18.371615+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 msgr2=0x7fc0cc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 0x7fc0cc0a50e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8101720 tx=0x7fc0d0005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 msgr2=0x7fc0e81019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 0x7fc0e81019b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8000f80 tx=0x7fc0d8031ee0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 shutdown_connections 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0cc0a2c20 0x7fc0cc0a50e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0e81072a0 0x7fc0e8100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e8104970 0x7fc0e80ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 --2- 172.21.15.137:0/3863303040 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0e8102040 0x7fc0e81019b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:29.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 >> 172.21.15.137:0/3863303040 conn(0x7fc0e80fba10 msgr2=0x7fc0e81028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:29.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 shutdown_connections 2024-04-25T02:07:29.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:29.796+0000 7fc0ed000640 1 -- 172.21.15.137:0/3863303040 wait complete. 2024-04-25T02:07:29.821 INFO:tasks.cephfs.filesystem.ceph_manager:making progress, resetting timeout 2024-04-25T02:07:29.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:29.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:29 smithi163 ceph-mon[32577]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:29.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:29 smithi163 ceph-mon[32577]: pgmap v318: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9.1 KiB/s wr, 20 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:29.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:29 smithi174 ceph-mon[33171]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:29.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:29 smithi174 ceph-mon[33171]: pgmap v318: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 9.1 KiB/s wr, 20 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 -- 172.21.15.137:0/28627891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 msgr2=0x7fe79c1019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:30.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/28627891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c1019e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe790009860 tx=0x7fe79002a340 comp rx=0 tx=0).stop 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 -- 172.21.15.137:0/28627891 shutdown_connections 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/28627891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/28627891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/28627891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c1019e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 -- 172.21.15.137:0/28627891 >> 172.21.15.137:0/28627891 conn(0x7fe79c0fcb50 msgr2=0x7fe79c0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 -- 172.21.15.137:0/28627891 shutdown_connections 2024-04-25T02:07:30.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.020+0000 7fe7a1e00640 1 -- 172.21.15.137:0/28627891 wait complete. 2024-04-25T02:07:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 Processor -- start 2024-04-25T02:07:30.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 -- start start 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c1a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c10d370 con 0x7fe79c1015c0 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c10d1f0 con 0x7fe79c1027b0 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a1e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c10d4f0 con 0x7fe79c103170 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.021+0000 7fe7a0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40110/0 (socket says 172.21.15.137:40110) 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 -- 172.21.15.137:0/2677409757 learned_addr learned my addr 172.21.15.137:0/2677409757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe79be00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a1400640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c1a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:30.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 -- 172.21.15.137:0/2677409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 msgr2=0x7fe79c1a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c1a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 -- 172.21.15.137:0/2677409757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 msgr2=0x7fe79c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 -- 172.21.15.137:0/2677409757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a1840 con 0x7fe79c1015c0 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a1400640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c1a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe79be00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe7a0a00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7900057c0 tx=0x7fe7900326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.022+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790040030 con 0x7fe79c1015c0 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.023+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe790038040 con 0x7fe79c1015c0 2024-04-25T02:07:30.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.023+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe790037070 con 0x7fe79c1015c0 2024-04-25T02:07:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.023+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a1ad0 con 0x7fe79c1015c0 2024-04-25T02:07:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.023+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a1fc0 con 0x7fe79c1015c0 2024-04-25T02:07:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.024+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79c1a2190 con 0x7fe79c1015c0 2024-04-25T02:07:30.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.026+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe790043070 con 0x7fe79c1015c0 2024-04-25T02:07:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.027+0000 7fe799600640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 0x7fe7840a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.027+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe7900ee990 con 0x7fe79c1015c0 2024-04-25T02:07:30.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.027+0000 7fe79be00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 0x7fe7840a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:30.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.028+0000 7fe79be00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 0x7fe7840a50e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7880096c0 tx=0x7fe788009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:30.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.031+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe79004a060 con 0x7fe79c1015c0 2024-04-25T02:07:30.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.226+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe79c075090 con 0x7fe7840a2c20 2024-04-25T02:07:30.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.235+0000 7fe799600640 1 -- 172.21.15.137:0/2677409757 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258608 (secure 0 0 0) 0x7fe79c075090 con 0x7fe7840a2c20 2024-04-25T02:07:30.244 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:30.246 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:07:30.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 msgr2=0x7fe7840a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 0x7fe7840a50e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7880096c0 tx=0x7fe788009260 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 msgr2=0x7fe79c199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7900057c0 tx=0x7fe7900326f0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 shutdown_connections 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe7840a2c20 0x7fe7840a50e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c103170 0x7fe79c1a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe79c1027b0 0x7fe79c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 --2- 172.21.15.137:0/2677409757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe79c1015c0 0x7fe79c199c30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.239+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 >> 172.21.15.137:0/2677409757 conn(0x7fe79c0fcb50 msgr2=0x7fe79c073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:30.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.240+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 shutdown_connections 2024-04-25T02:07:30.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:30.240+0000 7fe7a1e00640 1 -- 172.21.15.137:0/2677409757 wait complete. 2024-04-25T02:07:30.265 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-04-25T02:07:28.375357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":633187,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":167,"num_read_kb":177,"num_write":324,"num_write_kb":3020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":262,"ondisk_log_size":262,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370232,"kb_used_data":12748,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571592,"statfs":{"total":1151940427776,"available":1151561310208,"internally_reserved":0,"allocated":13053952,"data_stored":7114921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42625,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":135,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.994159"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452593+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:26.452593+0000","last_peered":"2024-04-25T02:07:26.452593+0000","last_clean":"2024-04-25T02:07:26.452593+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:26.452593+0000","last_undegraded":"2024-04-25T02:07:26.452593+0000","last_fullsized":"2024-04-25T02:07:26.452593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452550+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:26.452550+0000","last_peered":"2024-04-25T02:07:26.452550+0000","last_clean":"2024-04-25T02:07:26.452550+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:26.452550+0000","last_undegraded":"2024-04-25T02:07:26.452550+0000","last_fullsized":"2024-04-25T02:07:26.452550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442056+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:26.442056+0000","last_peered":"2024-04-25T02:07:26.442056+0000","last_clean":"2024-04-25T02:07:26.442056+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:26.442056+0000","last_undegraded":"2024-04-25T02:07:26.442056+0000","last_fullsized":"2024-04-25T02:07:26.442056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409309+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:20.409309+0000","last_peered":"2024-04-25T02:07:20.409309+0000","last_clean":"2024-04-25T02:07:20.409309+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:20.409309+0000","last_undegraded":"2024-04-25T02:07:20.409309+0000","last_fullsized":"2024-04-25T02:07:20.409309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443972+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:26.443972+0000","last_peered":"2024-04-25T02:07:26.443972+0000","last_clean":"2024-04-25T02:07:26.443972+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:26.443972+0000","last_undegraded":"2024-04-25T02:07:26.443972+0000","last_fullsized":"2024-04-25T02:07:26.443972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412144+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:20.412144+0000","last_peered":"2024-04-25T02:07:20.412144+0000","last_clean":"2024-04-25T02:07:20.412144+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:20.412144+0000","last_undegraded":"2024-04-25T02:07:20.412144+0000","last_fullsized":"2024-04-25T02:07:20.412144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588818+0000","last_change":"2024-04-25T02:07:19.369352+0000","last_active":"2024-04-25T02:07:20.588818+0000","last_peered":"2024-04-25T02:07:20.588818+0000","last_clean":"2024-04-25T02:07:20.588818+0000","last_became_active":"2024-04-25T02:07:19.368863+0000","last_became_peered":"2024-04-25T02:07:19.368863+0000","last_unstale":"2024-04-25T02:07:20.588818+0000","last_undegraded":"2024-04-25T02:07:20.588818+0000","last_fullsized":"2024-04-25T02:07:20.588818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:37.885708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444218+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:26.444218+0000","last_peered":"2024-04-25T02:07:26.444218+0000","last_clean":"2024-04-25T02:07:26.444218+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:26.444218+0000","last_undegraded":"2024-04-25T02:07:26.444218+0000","last_fullsized":"2024-04-25T02:07:26.444218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441916+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:26.441916+0000","last_peered":"2024-04-25T02:07:26.441916+0000","last_clean":"2024-04-25T02:07:26.441916+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:26.441916+0000","last_undegraded":"2024-04-25T02:07:26.441916+0000","last_fullsized":"2024-04-25T02:07:26.441916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591593+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:20.591593+0000","last_peered":"2024-04-25T02:07:20.591593+0000","last_clean":"2024-04-25T02:07:20.591593+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:20.591593+0000","last_undegraded":"2024-04-25T02:07:20.591593+0000","last_fullsized":"2024-04-25T02:07:20.591593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.450661+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:26.450661+0000","last_peered":"2024-04-25T02:07:26.450661+0000","last_clean":"2024-04-25T02:07:26.450661+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:26.450661+0000","last_undegraded":"2024-04-25T02:07:26.450661+0000","last_fullsized":"2024-04-25T02:07:26.450661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.808650+0000","last_change":"2024-04-25T02:07:26.452206+0000","last_active":"2024-04-25T02:07:26.452206+0000","last_peered":"2024-04-25T02:07:21.808650+0000","last_clean":"2024-04-25T02:07:21.808650+0000","last_became_active":"2024-04-25T02:07:19.393672+0000","last_became_peered":"2024-04-25T02:07:19.393672+0000","last_unstale":"2024-04-25T02:07:21.808650+0000","last_undegraded":"2024-04-25T02:07:21.808650+0000","last_fullsized":"2024-04-25T02:07:21.808650+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4,8],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587795+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:20.587795+0000","last_peered":"2024-04-25T02:07:20.587795+0000","last_clean":"2024-04-25T02:07:20.587795+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:20.587795+0000","last_undegraded":"2024-04-25T02:07:20.587795+0000","last_fullsized":"2024-04-25T02:07:20.587795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440863+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:26.440863+0000","last_peered":"2024-04-25T02:07:26.440863+0000","last_clean":"2024-04-25T02:07:26.440863+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:26.440863+0000","last_undegraded":"2024-04-25T02:07:26.440863+0000","last_fullsized":"2024-04-25T02:07:26.440863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382630+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:20.382630+0000","last_peered":"2024-04-25T02:07:20.382630+0000","last_clean":"2024-04-25T02:07:20.382630+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:20.382630+0000","last_undegraded":"2024-04-25T02:07:20.382630+0000","last_fullsized":"2024-04-25T02:07:20.382630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":26,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:24.403779+0000","last_change":"2024-04-25T02:07:26.439997+0000","last_active":"2024-04-25T02:07:26.439997+0000","last_peered":"2024-04-25T02:07:24.403779+0000","last_clean":"2024-04-25T02:07:24.403779+0000","last_became_active":"2024-04-25T02:07:18.412408+0000","last_became_peered":"2024-04-25T02:07:18.412408+0000","last_unstale":"2024-04-25T02:07:24.403779+0000","last_undegraded":"2024-04-25T02:07:24.403779+0000","last_fullsized":"2024-04-25T02:07:24.403779+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7,8],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412726+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:20.412726+0000","last_peered":"2024-04-25T02:07:20.412726+0000","last_clean":"2024-04-25T02:07:20.412726+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:20.412726+0000","last_undegraded":"2024-04-25T02:07:20.412726+0000","last_fullsized":"2024-04-25T02:07:20.412726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.617568+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:20.617568+0000","last_peered":"2024-04-25T02:07:20.617568+0000","last_clean":"2024-04-25T02:07:20.617568+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:20.617568+0000","last_undegraded":"2024-04-25T02:07:20.617568+0000","last_fullsized":"2024-04-25T02:07:20.617568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452817+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:26.452817+0000","last_peered":"2024-04-25T02:07:26.452817+0000","last_clean":"2024-04-25T02:07:26.452817+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:26.452817+0000","last_undegraded":"2024-04-25T02:07:26.452817+0000","last_fullsized":"2024-04-25T02:07:26.452817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.391807+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:23.391807+0000","last_peered":"2024-04-25T02:07:23.391807+0000","last_clean":"2024-04-25T02:07:23.391807+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:23.391807+0000","last_undegraded":"2024-04-25T02:07:23.391807+0000","last_fullsized":"2024-04-25T02:07:23.391807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588113+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:20.588113+0000","last_peered":"2024-04-25T02:07:20.588113+0000","last_clean":"2024-04-25T02:07:20.588113+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:20.588113+0000","last_undegraded":"2024-04-25T02:07:20.588113+0000","last_fullsized":"2024-04-25T02:07:20.588113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409556+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:20.409556+0000","last_peered":"2024-04-25T02:07:20.409556+0000","last_clean":"2024-04-25T02:07:20.409556+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:20.409556+0000","last_undegraded":"2024-04-25T02:07:20.409556+0000","last_fullsized":"2024-04-25T02:07:20.409556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588324+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:20.588324+0000","last_peered":"2024-04-25T02:07:20.588324+0000","last_clean":"2024-04-25T02:07:20.588324+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:20.588324+0000","last_undegraded":"2024-04-25T02:07:20.588324+0000","last_fullsized":"2024-04-25T02:07:20.588324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:24.401752+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:07:24.401752+0000","last_peered":"2024-04-25T02:07:24.401752+0000","last_clean":"2024-04-25T02:07:24.401752+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:07:24.401752+0000","last_undegraded":"2024-04-25T02:07:24.401752+0000","last_fullsized":"2024-04-25T02:07:24.401752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409396+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:20.409396+0000","last_peered":"2024-04-25T02:07:20.409396+0000","last_clean":"2024-04-25T02:07:20.409396+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:20.409396+0000","last_undegraded":"2024-04-25T02:07:20.409396+0000","last_fullsized":"2024-04-25T02:07:20.409396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.443897+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:26.443897+0000","last_peered":"2024-04-25T02:07:26.443897+0000","last_clean":"2024-04-25T02:07:26.443897+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:26.443897+0000","last_undegraded":"2024-04-25T02:07:26.443897+0000","last_fullsized":"2024-04-25T02:07:26.443897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588071+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:20.588071+0000","last_peered":"2024-04-25T02:07:20.588071+0000","last_clean":"2024-04-25T02:07:20.588071+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:20.588071+0000","last_undegraded":"2024-04-25T02:07:20.588071+0000","last_fullsized":"2024-04-25T02:07:20.588071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399328+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:23.399328+0000","last_peered":"2024-04-25T02:07:23.399328+0000","last_clean":"2024-04-25T02:07:23.399328+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:23.399328+0000","last_undegraded":"2024-04-25T02:07:23.399328+0000","last_fullsized":"2024-04-25T02:07:23.399328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":2,"reported_epoch":86,"state":"peering","last_fresh":"2024-04-25T02:07:20.617139+0000","last_change":"2024-04-25T02:07:26.535367+0000","last_active":"2024-04-25T02:07:26.535367+0000","last_peered":"2024-04-25T02:07:20.617139+0000","last_clean":"2024-04-25T02:07:20.617139+0000","last_became_active":"2024-04-25T02:07:19.389991+0000","last_became_peered":"2024-04-25T02:07:19.389991+0000","last_unstale":"2024-04-25T02:07:20.617139+0000","last_undegraded":"2024-04-25T02:07:20.617139+0000","last_fullsized":"2024-04-25T02:07:20.617139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587713+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:20.587713+0000","last_peered":"2024-04-25T02:07:20.587713+0000","last_clean":"2024-04-25T02:07:20.587713+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:20.587713+0000","last_undegraded":"2024-04-25T02:07:20.587713+0000","last_fullsized":"2024-04-25T02:07:20.587713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.439736+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:26.439736+0000","last_peered":"2024-04-25T02:07:26.439736+0000","last_clean":"2024-04-25T02:07:26.439736+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:26.439736+0000","last_undegraded":"2024-04-25T02:07:26.439736+0000","last_fullsized":"2024-04-25T02:07:26.439736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444223+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:07:26.444223+0000","last_peered":"2024-04-25T02:07:26.444223+0000","last_clean":"2024-04-25T02:07:26.444223+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:07:26.444223+0000","last_undegraded":"2024-04-25T02:07:26.444223+0000","last_fullsized":"2024-04-25T02:07:26.444223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588744+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:20.588744+0000","last_peered":"2024-04-25T02:07:20.588744+0000","last_clean":"2024-04-25T02:07:20.588744+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:20.588744+0000","last_undegraded":"2024-04-25T02:07:20.588744+0000","last_fullsized":"2024-04-25T02:07:20.588744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452614+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:26.452614+0000","last_peered":"2024-04-25T02:07:26.452614+0000","last_clean":"2024-04-25T02:07:26.452614+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:26.452614+0000","last_undegraded":"2024-04-25T02:07:26.452614+0000","last_fullsized":"2024-04-25T02:07:26.452614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.383503+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:22.383503+0000","last_peered":"2024-04-25T02:07:22.383503+0000","last_clean":"2024-04-25T02:07:22.383503+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:22.383503+0000","last_undegraded":"2024-04-25T02:07:22.383503+0000","last_fullsized":"2024-04-25T02:07:22.383503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588353+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:20.588353+0000","last_peered":"2024-04-25T02:07:20.588353+0000","last_clean":"2024-04-25T02:07:20.588353+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:20.588353+0000","last_undegraded":"2024-04-25T02:07:20.588353+0000","last_fullsized":"2024-04-25T02:07:20.588353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'19","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444061+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:07:26.444061+0000","last_peered":"2024-04-25T02:07:26.444061+0000","last_clean":"2024-04-25T02:07:26.444061+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:07:26.444061+0000","last_undegraded":"2024-04-25T02:07:26.444061+0000","last_fullsized":"2024-04-25T02:07:26.444061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":41,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409609+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:20.409609+0000","last_peered":"2024-04-25T02:07:20.409609+0000","last_clean":"2024-04-25T02:07:20.409609+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:20.409609+0000","last_undegraded":"2024-04-25T02:07:20.409609+0000","last_fullsized":"2024-04-25T02:07:20.409609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591035+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:20.591035+0000","last_peered":"2024-04-25T02:07:20.591035+0000","last_clean":"2024-04-25T02:07:20.591035+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:20.591035+0000","last_undegraded":"2024-04-25T02:07:20.591035+0000","last_fullsized":"2024-04-25T02:07:20.591035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381836+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:22.381836+0000","last_peered":"2024-04-25T02:07:22.381836+0000","last_clean":"2024-04-25T02:07:22.381836+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:22.381836+0000","last_undegraded":"2024-04-25T02:07:22.381836+0000","last_fullsized":"2024-04-25T02:07:22.381836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441938+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:07:26.441938+0000","last_peered":"2024-04-25T02:07:26.441938+0000","last_clean":"2024-04-25T02:07:26.441938+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:07:26.441938+0000","last_undegraded":"2024-04-25T02:07:26.441938+0000","last_fullsized":"2024-04-25T02:07:26.441938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400362+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:23.400362+0000","last_peered":"2024-04-25T02:07:23.400362+0000","last_clean":"2024-04-25T02:07:23.400362+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:23.400362+0000","last_undegraded":"2024-04-25T02:07:23.400362+0000","last_fullsized":"2024-04-25T02:07:23.400362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587784+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:20.587784+0000","last_peered":"2024-04-25T02:07:20.587784+0000","last_clean":"2024-04-25T02:07:20.587784+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:20.587784+0000","last_undegraded":"2024-04-25T02:07:20.587784+0000","last_fullsized":"2024-04-25T02:07:20.587784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409584+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:20.409584+0000","last_peered":"2024-04-25T02:07:20.409584+0000","last_clean":"2024-04-25T02:07:20.409584+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:20.409584+0000","last_undegraded":"2024-04-25T02:07:20.409584+0000","last_fullsized":"2024-04-25T02:07:20.409584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.534816+0000","last_change":"2024-04-25T02:07:26.441856+0000","last_active":"2024-04-25T02:07:26.441856+0000","last_peered":"2024-04-25T02:07:21.534816+0000","last_clean":"2024-04-25T02:07:21.534816+0000","last_became_active":"2024-04-25T02:07:18.422561+0000","last_became_peered":"2024-04-25T02:07:18.422561+0000","last_unstale":"2024-04-25T02:07:21.534816+0000","last_undegraded":"2024-04-25T02:07:21.534816+0000","last_fullsized":"2024-04-25T02:07:21.534816+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.444068+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:26.444068+0000","last_peered":"2024-04-25T02:07:26.444068+0000","last_clean":"2024-04-25T02:07:26.444068+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:26.444068+0000","last_undegraded":"2024-04-25T02:07:26.444068+0000","last_fullsized":"2024-04-25T02:07:26.444068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"peering","last_fresh":"2024-04-25T02:07:21.582905+0000","last_change":"2024-04-25T02:07:26.444328+0000","last_active":"2024-04-25T02:07:26.444328+0000","last_peered":"2024-04-25T02:07:21.582905+0000","last_clean":"2024-04-25T02:07:21.582905+0000","last_became_active":"2024-04-25T02:07:19.384064+0000","last_became_peered":"2024-04-25T02:07:19.384064+0000","last_unstale":"2024-04-25T02:07:21.582905+0000","last_undegraded":"2024-04-25T02:07:21.582905+0000","last_fullsized":"2024-04-25T02:07:21.582905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4,9],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587867+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:20.587867+0000","last_peered":"2024-04-25T02:07:20.587867+0000","last_clean":"2024-04-25T02:07:20.587867+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:20.587867+0000","last_undegraded":"2024-04-25T02:07:20.587867+0000","last_fullsized":"2024-04-25T02:07:20.587867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.400286+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:07:23.400286+0000","last_peered":"2024-04-25T02:07:23.400286+0000","last_clean":"2024-04-25T02:07:23.400286+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:07:23.400286+0000","last_undegraded":"2024-04-25T02:07:23.400286+0000","last_fullsized":"2024-04-25T02:07:23.400286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.412174+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:20.412174+0000","last_peered":"2024-04-25T02:07:20.412174+0000","last_clean":"2024-04-25T02:07:20.412174+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:20.412174+0000","last_undegraded":"2024-04-25T02:07:20.412174+0000","last_fullsized":"2024-04-25T02:07:20.412174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.441921+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:26.441921+0000","last_peered":"2024-04-25T02:07:26.441921+0000","last_clean":"2024-04-25T02:07:26.441921+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:26.441921+0000","last_undegraded":"2024-04-25T02:07:26.441921+0000","last_fullsized":"2024-04-25T02:07:26.441921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445091+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445091+0000","last_peered":"2024-04-25T02:07:27.445091+0000","last_clean":"2024-04-25T02:07:27.445091+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445091+0000","last_undegraded":"2024-04-25T02:07:27.445091+0000","last_fullsized":"2024-04-25T02:07:27.445091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590113+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:20.590113+0000","last_peered":"2024-04-25T02:07:20.590113+0000","last_clean":"2024-04-25T02:07:20.590113+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:20.590113+0000","last_undegraded":"2024-04-25T02:07:20.590113+0000","last_fullsized":"2024-04-25T02:07:20.590113+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409620+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:20.409620+0000","last_peered":"2024-04-25T02:07:20.409620+0000","last_clean":"2024-04-25T02:07:20.409620+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:20.409620+0000","last_undegraded":"2024-04-25T02:07:20.409620+0000","last_fullsized":"2024-04-25T02:07:20.409620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591324+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:20.591324+0000","last_peered":"2024-04-25T02:07:20.591324+0000","last_clean":"2024-04-25T02:07:20.591324+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:20.591324+0000","last_undegraded":"2024-04-25T02:07:20.591324+0000","last_fullsized":"2024-04-25T02:07:20.591324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.440730+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:26.440730+0000","last_peered":"2024-04-25T02:07:26.440730+0000","last_clean":"2024-04-25T02:07:26.440730+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:26.440730+0000","last_undegraded":"2024-04-25T02:07:26.440730+0000","last_fullsized":"2024-04-25T02:07:26.440730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413428+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:20.413428+0000","last_peered":"2024-04-25T02:07:20.413428+0000","last_clean":"2024-04-25T02:07:20.413428+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:20.413428+0000","last_undegraded":"2024-04-25T02:07:20.413428+0000","last_fullsized":"2024-04-25T02:07:20.413428+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.442301+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:26.442301+0000","last_peered":"2024-04-25T02:07:26.442301+0000","last_clean":"2024-04-25T02:07:26.442301+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:26.442301+0000","last_undegraded":"2024-04-25T02:07:26.442301+0000","last_fullsized":"2024-04-25T02:07:26.442301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.452720+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:26.452720+0000","last_peered":"2024-04-25T02:07:26.452720+0000","last_clean":"2024-04-25T02:07:26.452720+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:26.452720+0000","last_undegraded":"2024-04-25T02:07:26.452720+0000","last_fullsized":"2024-04-25T02:07:26.452720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.386004+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:22.386004+0000","last_peered":"2024-04-25T02:07:22.386004+0000","last_clean":"2024-04-25T02:07:22.386004+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:22.386004+0000","last_undegraded":"2024-04-25T02:07:22.386004+0000","last_fullsized":"2024-04-25T02:07:22.386004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.409231+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:20.409231+0000","last_peered":"2024-04-25T02:07:20.409231+0000","last_clean":"2024-04-25T02:07:20.409231+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:20.409231+0000","last_undegraded":"2024-04-25T02:07:20.409231+0000","last_fullsized":"2024-04-25T02:07:20.409231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.388504+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:22.388504+0000","last_peered":"2024-04-25T02:07:22.388504+0000","last_clean":"2024-04-25T02:07:22.388504+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:22.388504+0000","last_undegraded":"2024-04-25T02:07:22.388504+0000","last_fullsized":"2024-04-25T02:07:22.388504+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382605+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:20.382605+0000","last_peered":"2024-04-25T02:07:20.382605+0000","last_clean":"2024-04-25T02:07:20.382605+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:20.382605+0000","last_undegraded":"2024-04-25T02:07:20.382605+0000","last_fullsized":"2024-04-25T02:07:20.382605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413081+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:20.413081+0000","last_peered":"2024-04-25T02:07:20.413081+0000","last_clean":"2024-04-25T02:07:20.413081+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:20.413081+0000","last_undegraded":"2024-04-25T02:07:20.413081+0000","last_fullsized":"2024-04-25T02:07:20.413081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:22.381602+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:22.381602+0000","last_peered":"2024-04-25T02:07:22.381602+0000","last_clean":"2024-04-25T02:07:22.381602+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:22.381602+0000","last_undegraded":"2024-04-25T02:07:22.381602+0000","last_fullsized":"2024-04-25T02:07:22.381602+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:23.399346+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:23.399346+0000","last_peered":"2024-04-25T02:07:23.399346+0000","last_clean":"2024-04-25T02:07:23.399346+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:23.399346+0000","last_undegraded":"2024-04-25T02:07:23.399346+0000","last_fullsized":"2024-04-25T02:07:23.399346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588155+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:20.588155+0000","last_peered":"2024-04-25T02:07:20.588155+0000","last_clean":"2024-04-25T02:07:20.588155+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:20.588155+0000","last_undegraded":"2024-04-25T02:07:20.588155+0000","last_fullsized":"2024-04-25T02:07:20.588155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.590730+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:20.590730+0000","last_peered":"2024-04-25T02:07:20.590730+0000","last_clean":"2024-04-25T02:07:20.590730+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:20.590730+0000","last_undegraded":"2024-04-25T02:07:20.590730+0000","last_fullsized":"2024-04-25T02:07:20.590730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382638+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:20.382638+0000","last_peered":"2024-04-25T02:07:20.382638+0000","last_clean":"2024-04-25T02:07:20.382638+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:20.382638+0000","last_undegraded":"2024-04-25T02:07:20.382638+0000","last_fullsized":"2024-04-25T02:07:20.382638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.382450+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:20.382450+0000","last_peered":"2024-04-25T02:07:20.382450+0000","last_clean":"2024-04-25T02:07:20.382450+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:20.382450+0000","last_undegraded":"2024-04-25T02:07:20.382450+0000","last_fullsized":"2024-04-25T02:07:20.382450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-25T02:07:26.453158+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:26.453158+0000","last_peered":"2024-04-25T02:07:26.453158+0000","last_clean":"2024-04-25T02:07:26.453158+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:26.453158+0000","last_undegraded":"2024-04-25T02:07:26.453158+0000","last_fullsized":"2024-04-25T02:07:26.453158+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591502+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:20.591502+0000","last_peered":"2024-04-25T02:07:20.591502+0000","last_clean":"2024-04-25T02:07:20.591502+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:20.591502+0000","last_undegraded":"2024-04-25T02:07:20.591502+0000","last_fullsized":"2024-04-25T02:07:20.591502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.383007+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:20.383007+0000","last_peered":"2024-04-25T02:07:20.383007+0000","last_clean":"2024-04-25T02:07:20.383007+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:20.383007+0000","last_undegraded":"2024-04-25T02:07:20.383007+0000","last_fullsized":"2024-04-25T02:07:20.383007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.413207+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:20.413207+0000","last_peered":"2024-04-25T02:07:20.413207+0000","last_clean":"2024-04-25T02:07:20.413207+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:20.413207+0000","last_undegraded":"2024-04-25T02:07:20.413207+0000","last_fullsized":"2024-04-25T02:07:20.413207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.587830+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:20.587830+0000","last_peered":"2024-04-25T02:07:20.587830+0000","last_clean":"2024-04-25T02:07:20.587830+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:20.587830+0000","last_undegraded":"2024-04-25T02:07:20.587830+0000","last_fullsized":"2024-04-25T02:07:20.587830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.411899+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:20.411899+0000","last_peered":"2024-04-25T02:07:20.411899+0000","last_clean":"2024-04-25T02:07:20.411899+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:20.411899+0000","last_undegraded":"2024-04-25T02:07:20.411899+0000","last_fullsized":"2024-04-25T02:07:20.411899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.588179+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:20.588179+0000","last_peered":"2024-04-25T02:07:20.588179+0000","last_clean":"2024-04-25T02:07:20.588179+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:20.588179+0000","last_undegraded":"2024-04-25T02:07:20.588179+0000","last_fullsized":"2024-04-25T02:07:20.588179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T02:07:20.591437+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:20.591437+0000","last_peered":"2024-04-25T02:07:20.591437+0000","last_clean":"2024-04-25T02:07:20.591437+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:20.591437+0000","last_undegraded":"2024-04-25T02:07:20.591437+0000","last_fullsized":"2024-04-25T02:07:20.591437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":42585,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":141,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":73519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":447746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1572864,"data_stored":1051870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":439339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070495,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":439147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495658,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":438521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":459416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":439999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":441483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":438805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":439556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32676,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712476,"statfs":{"total":95995035648,"available":95961575424,"internally_reserved":0,"allocated":1536000,"data_stored":1030365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":40162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:07:30.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:30 smithi137 ceph-mon[28303]: from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:30 smithi137 ceph-mon[28303]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:30 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3863303040' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-25T02:07:30.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:30 smithi163 ceph-mon[32577]: from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:30 smithi163 ceph-mon[32577]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:30 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3863303040' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-25T02:07:30.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:30 smithi174 ceph-mon[33171]: from='client.24742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:30 smithi174 ceph-mon[33171]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:30.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:30 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3863303040' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-04-25T02:07:31.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:31 smithi137 ceph-mon[28303]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:31.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:31 smithi137 ceph-mon[28303]: pgmap v319: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:31.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:31 smithi163 ceph-mon[32577]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:31.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:31 smithi163 ceph-mon[32577]: pgmap v319: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:31.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:31 smithi174 ceph-mon[33171]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:31.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:31 smithi174 ceph-mon[33171]: pgmap v319: 97 pgs: 5 peering, 92 active+clean; 618 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.6 KiB/s wr, 21 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:33.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:07:33.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 -- 172.21.15.137:0/1795888584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801037c0 msgr2=0x7f6d80103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/1795888584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801037c0 0x7f6d80103be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009900 tx=0x7f6d7002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 -- 172.21.15.137:0/1795888584 shutdown_connections 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/1795888584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d8010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/1795888584 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801049b0 0x7f6d80104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/1795888584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801037c0 0x7f6d80103be0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 -- 172.21.15.137:0/1795888584 >> 172.21.15.137:0/1795888584 conn(0x7f6d800fed50 msgr2=0x7f6d80101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 -- 172.21.15.137:0/1795888584 shutdown_connections 2024-04-25T02:07:33.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.477+0000 7f6d7fe00640 1 -- 172.21.15.137:0/1795888584 wait complete. 2024-04-25T02:07:33.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.478+0000 7f6d7fe00640 1 Processor -- start 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.478+0000 7f6d7fe00640 1 -- start start 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.478+0000 7f6d7fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.478+0000 7f6d7fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 0x7f6d8019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d801a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8010f5c0 con 0x7f6d801049b0 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7fe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8010f440 con 0x7f6d801037c0 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7fe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8010f740 con 0x7f6d80105370 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 0x7f6d8019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:35178/0 (socket says 172.21.15.137:35178) 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 -- 172.21.15.137:0/3497158555 learned_addr learned my addr 172.21.15.137:0/3497158555 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:33.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7f400640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d801a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 -- 172.21.15.137:0/3497158555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 msgr2=0x7f6d801a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d801a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 -- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 msgr2=0x7f6d8019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 0x7f6d8019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7ea00640 1 -- 172.21.15.137:0/3497158555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d801a17a0 con 0x7f6d801037c0 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7f400640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d801a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.479+0000 7f6d7e000640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 0x7f6d8019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:33.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.480+0000 7f6d7ea00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d700316a0 tx=0x7f6d70032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.481+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7003f030 con 0x7f6d801037c0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.481+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d801a1a30 con 0x7f6d801037c0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.481+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d70003d00 con 0x7f6d801037c0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.481+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70035070 con 0x7f6d801037c0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.481+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d801a1f20 con 0x7f6d801037c0 2024-04-25T02:07:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.482+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8010aa80 con 0x7f6d801037c0 2024-04-25T02:07:33.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.484+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6d70042030 con 0x7f6d801037c0 2024-04-25T02:07:33.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.485+0000 7f6d77400640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 0x7f6d640a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:33.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.485+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f6d700ef9d0 con 0x7f6d801037c0 2024-04-25T02:07:33.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.486+0000 7f6d7e000640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 0x7f6d640a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:33.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.486+0000 7f6d7e000640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 0x7f6d640a50e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0095f0 tx=0x7f6d6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:33.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.490+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6d700bc130 con 0x7f6d801037c0 2024-04-25T02:07:33.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.687+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d80061b80 con 0x7f6d640a2c20 2024-04-25T02:07:33.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.695+0000 7f6d77400640 1 -- 172.21.15.137:0/3497158555 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258777 (secure 0 0 0) 0x7f6d80061b80 con 0x7f6d640a2c20 2024-04-25T02:07:33.705 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:33.707 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 msgr2=0x7f6d640a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 0x7f6d640a50e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0095f0 tx=0x7f6d6c005f90 comp rx=0 tx=0).stop 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 msgr2=0x7f6d80199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d700316a0 tx=0x7f6d70032d70 comp rx=0 tx=0).stop 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 shutdown_connections 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6d640a2c20 0x7f6d640a50e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d80105370 0x7f6d801a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d801049b0 0x7f6d8019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 --2- 172.21.15.137:0/3497158555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d801037c0 0x7f6d80199b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.701+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 >> 172.21.15.137:0/3497158555 conn(0x7f6d800fed50 msgr2=0x7f6d80107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.702+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 shutdown_connections 2024-04-25T02:07:33.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:33.702+0000 7f6d7fe00640 1 -- 172.21.15.137:0/3497158555 wait complete. 2024-04-25T02:07:33.723 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:33 smithi137 ceph-mon[28303]: pgmap v320: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 18 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:33.728 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-04-25T02:07:32.377044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638371,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":204,"num_read_kb":204,"num_write":330,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370616,"kb_used_data":13092,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571208,"statfs":{"total":1151940427776,"available":1151560916992,"internally_reserved":0,"allocated":13406208,"data_stored":7366139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45369,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":68,"num_read_kb":85,"num_write":80,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003162"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447270+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:27.447270+0000","last_peered":"2024-04-25T02:07:27.447270+0000","last_clean":"2024-04-25T02:07:27.447270+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:27.447270+0000","last_undegraded":"2024-04-25T02:07:27.447270+0000","last_fullsized":"2024-04-25T02:07:27.447270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.446666+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:27.446666+0000","last_peered":"2024-04-25T02:07:27.446666+0000","last_clean":"2024-04-25T02:07:27.446666+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:27.446666+0000","last_undegraded":"2024-04-25T02:07:27.446666+0000","last_fullsized":"2024-04-25T02:07:27.446666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335780+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:28.335780+0000","last_peered":"2024-04-25T02:07:28.335780+0000","last_clean":"2024-04-25T02:07:28.335780+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:28.335780+0000","last_undegraded":"2024-04-25T02:07:28.335780+0000","last_fullsized":"2024-04-25T02:07:28.335780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439308+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:27.439308+0000","last_peered":"2024-04-25T02:07:27.439308+0000","last_clean":"2024-04-25T02:07:27.439308+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:27.439308+0000","last_undegraded":"2024-04-25T02:07:27.439308+0000","last_fullsized":"2024-04-25T02:07:27.439308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441104+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:27.441104+0000","last_peered":"2024-04-25T02:07:27.441104+0000","last_clean":"2024-04-25T02:07:27.441104+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:27.441104+0000","last_undegraded":"2024-04-25T02:07:27.441104+0000","last_fullsized":"2024-04-25T02:07:27.441104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452349+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:27.452349+0000","last_peered":"2024-04-25T02:07:27.452349+0000","last_clean":"2024-04-25T02:07:27.452349+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:27.452349+0000","last_undegraded":"2024-04-25T02:07:27.452349+0000","last_fullsized":"2024-04-25T02:07:27.452349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.162662+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:07:28.162662+0000","last_peered":"2024-04-25T02:07:28.162662+0000","last_clean":"2024-04-25T02:07:28.162662+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:07:28.162662+0000","last_undegraded":"2024-04-25T02:07:28.162662+0000","last_fullsized":"2024-04-25T02:07:28.162662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441483+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:27.441483+0000","last_peered":"2024-04-25T02:07:27.441483+0000","last_clean":"2024-04-25T02:07:27.441483+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:27.441483+0000","last_undegraded":"2024-04-25T02:07:27.441483+0000","last_fullsized":"2024-04-25T02:07:27.441483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335695+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:28.335695+0000","last_peered":"2024-04-25T02:07:28.335695+0000","last_clean":"2024-04-25T02:07:28.335695+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:28.335695+0000","last_undegraded":"2024-04-25T02:07:28.335695+0000","last_fullsized":"2024-04-25T02:07:28.335695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159865+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:28.159865+0000","last_peered":"2024-04-25T02:07:28.159865+0000","last_clean":"2024-04-25T02:07:28.159865+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:28.159865+0000","last_undegraded":"2024-04-25T02:07:28.159865+0000","last_fullsized":"2024-04-25T02:07:28.159865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445435+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:27.445435+0000","last_peered":"2024-04-25T02:07:27.445435+0000","last_clean":"2024-04-25T02:07:27.445435+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:27.445435+0000","last_undegraded":"2024-04-25T02:07:27.445435+0000","last_fullsized":"2024-04-25T02:07:27.445435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457403+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:07:27.457403+0000","last_peered":"2024-04-25T02:07:27.457403+0000","last_clean":"2024-04-25T02:07:27.457403+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:07:27.457403+0000","last_undegraded":"2024-04-25T02:07:27.457403+0000","last_fullsized":"2024-04-25T02:07:27.457403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437030+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:27.437030+0000","last_peered":"2024-04-25T02:07:27.437030+0000","last_clean":"2024-04-25T02:07:27.437030+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:27.437030+0000","last_undegraded":"2024-04-25T02:07:27.437030+0000","last_fullsized":"2024-04-25T02:07:27.437030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442889+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:27.442889+0000","last_peered":"2024-04-25T02:07:27.442889+0000","last_clean":"2024-04-25T02:07:27.442889+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:27.442889+0000","last_undegraded":"2024-04-25T02:07:27.442889+0000","last_fullsized":"2024-04-25T02:07:27.442889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444246+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:27.444246+0000","last_peered":"2024-04-25T02:07:27.444246+0000","last_clean":"2024-04-25T02:07:27.444246+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:27.444246+0000","last_undegraded":"2024-04-25T02:07:27.444246+0000","last_fullsized":"2024-04-25T02:07:27.444246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.345920+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:07:28.345920+0000","last_peered":"2024-04-25T02:07:28.345920+0000","last_clean":"2024-04-25T02:07:28.345920+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:07:28.345920+0000","last_undegraded":"2024-04-25T02:07:28.345920+0000","last_fullsized":"2024-04-25T02:07:28.345920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.455141+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:27.455141+0000","last_peered":"2024-04-25T02:07:27.455141+0000","last_clean":"2024-04-25T02:07:27.455141+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:27.455141+0000","last_undegraded":"2024-04-25T02:07:27.455141+0000","last_fullsized":"2024-04-25T02:07:27.455141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.458218+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:27.458218+0000","last_peered":"2024-04-25T02:07:27.458218+0000","last_clean":"2024-04-25T02:07:27.458218+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:27.458218+0000","last_undegraded":"2024-04-25T02:07:27.458218+0000","last_fullsized":"2024-04-25T02:07:27.458218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.448024+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:27.448024+0000","last_peered":"2024-04-25T02:07:27.448024+0000","last_clean":"2024-04-25T02:07:27.448024+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:27.448024+0000","last_undegraded":"2024-04-25T02:07:27.448024+0000","last_fullsized":"2024-04-25T02:07:27.448024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439635+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:27.439635+0000","last_peered":"2024-04-25T02:07:27.439635+0000","last_clean":"2024-04-25T02:07:27.439635+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:27.439635+0000","last_undegraded":"2024-04-25T02:07:27.439635+0000","last_fullsized":"2024-04-25T02:07:27.439635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437171+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:27.437171+0000","last_peered":"2024-04-25T02:07:27.437171+0000","last_clean":"2024-04-25T02:07:27.437171+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:27.437171+0000","last_undegraded":"2024-04-25T02:07:27.437171+0000","last_fullsized":"2024-04-25T02:07:27.437171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439586+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:27.439586+0000","last_peered":"2024-04-25T02:07:27.439586+0000","last_clean":"2024-04-25T02:07:27.439586+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:27.439586+0000","last_undegraded":"2024-04-25T02:07:27.439586+0000","last_fullsized":"2024-04-25T02:07:27.439586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409529+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:28.409529+0000","last_peered":"2024-04-25T02:07:28.409529+0000","last_clean":"2024-04-25T02:07:28.409529+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:28.409529+0000","last_undegraded":"2024-04-25T02:07:28.409529+0000","last_fullsized":"2024-04-25T02:07:28.409529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409846+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:07:28.409846+0000","last_peered":"2024-04-25T02:07:28.409846+0000","last_clean":"2024-04-25T02:07:28.409846+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:07:28.409846+0000","last_undegraded":"2024-04-25T02:07:28.409846+0000","last_fullsized":"2024-04-25T02:07:28.409846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439297+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:27.439297+0000","last_peered":"2024-04-25T02:07:27.439297+0000","last_clean":"2024-04-25T02:07:27.439297+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:27.439297+0000","last_undegraded":"2024-04-25T02:07:27.439297+0000","last_fullsized":"2024-04-25T02:07:27.439297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441062+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:27.441062+0000","last_peered":"2024-04-25T02:07:27.441062+0000","last_clean":"2024-04-25T02:07:27.441062+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:27.441062+0000","last_undegraded":"2024-04-25T02:07:27.441062+0000","last_fullsized":"2024-04-25T02:07:27.441062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409368+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:28.409368+0000","last_peered":"2024-04-25T02:07:28.409368+0000","last_clean":"2024-04-25T02:07:28.409368+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:28.409368+0000","last_undegraded":"2024-04-25T02:07:28.409368+0000","last_fullsized":"2024-04-25T02:07:28.409368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159404+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:28.159404+0000","last_peered":"2024-04-25T02:07:28.159404+0000","last_clean":"2024-04-25T02:07:28.159404+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:28.159404+0000","last_undegraded":"2024-04-25T02:07:28.159404+0000","last_fullsized":"2024-04-25T02:07:28.159404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.163409+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:07:28.163409+0000","last_peered":"2024-04-25T02:07:28.163409+0000","last_clean":"2024-04-25T02:07:28.163409+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:07:28.163409+0000","last_undegraded":"2024-04-25T02:07:28.163409+0000","last_fullsized":"2024-04-25T02:07:28.163409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409204+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:28.409204+0000","last_peered":"2024-04-25T02:07:28.409204+0000","last_clean":"2024-04-25T02:07:28.409204+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:28.409204+0000","last_undegraded":"2024-04-25T02:07:28.409204+0000","last_fullsized":"2024-04-25T02:07:28.409204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442400+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:27.442400+0000","last_peered":"2024-04-25T02:07:27.442400+0000","last_clean":"2024-04-25T02:07:27.442400+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:27.442400+0000","last_undegraded":"2024-04-25T02:07:27.442400+0000","last_fullsized":"2024-04-25T02:07:27.442400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:30.412210+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:07:30.412210+0000","last_peered":"2024-04-25T02:07:30.412210+0000","last_clean":"2024-04-25T02:07:30.412210+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:07:30.412210+0000","last_undegraded":"2024-04-25T02:07:30.412210+0000","last_fullsized":"2024-04-25T02:07:30.412210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437496+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:27.437496+0000","last_peered":"2024-04-25T02:07:27.437496+0000","last_clean":"2024-04-25T02:07:27.437496+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:27.437496+0000","last_undegraded":"2024-04-25T02:07:27.437496+0000","last_fullsized":"2024-04-25T02:07:27.437496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447874+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:27.447874+0000","last_peered":"2024-04-25T02:07:27.447874+0000","last_clean":"2024-04-25T02:07:27.447874+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:27.447874+0000","last_undegraded":"2024-04-25T02:07:27.447874+0000","last_fullsized":"2024-04-25T02:07:27.447874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409638+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:28.409638+0000","last_peered":"2024-04-25T02:07:28.409638+0000","last_clean":"2024-04-25T02:07:28.409638+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:28.409638+0000","last_undegraded":"2024-04-25T02:07:28.409638+0000","last_fullsized":"2024-04-25T02:07:28.409638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437333+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:27.437333+0000","last_peered":"2024-04-25T02:07:27.437333+0000","last_clean":"2024-04-25T02:07:27.437333+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:27.437333+0000","last_undegraded":"2024-04-25T02:07:27.437333+0000","last_fullsized":"2024-04-25T02:07:27.437333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'20","reported_seq":60,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:31.419177+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:07:31.419177+0000","last_peered":"2024-04-25T02:07:31.419177+0000","last_clean":"2024-04-25T02:07:31.419177+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:07:31.419177+0000","last_undegraded":"2024-04-25T02:07:31.419177+0000","last_fullsized":"2024-04-25T02:07:31.419177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43377,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":52,"num_write":21,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439450+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:27.439450+0000","last_peered":"2024-04-25T02:07:27.439450+0000","last_clean":"2024-04-25T02:07:27.439450+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:27.439450+0000","last_undegraded":"2024-04-25T02:07:27.439450+0000","last_fullsized":"2024-04-25T02:07:27.439450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159268+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:28.159268+0000","last_peered":"2024-04-25T02:07:28.159268+0000","last_clean":"2024-04-25T02:07:28.159268+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:28.159268+0000","last_undegraded":"2024-04-25T02:07:28.159268+0000","last_fullsized":"2024-04-25T02:07:28.159268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409374+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:28.409374+0000","last_peered":"2024-04-25T02:07:28.409374+0000","last_clean":"2024-04-25T02:07:28.409374+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:28.409374+0000","last_undegraded":"2024-04-25T02:07:28.409374+0000","last_fullsized":"2024-04-25T02:07:28.409374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:30.412438+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:07:30.412438+0000","last_peered":"2024-04-25T02:07:30.412438+0000","last_clean":"2024-04-25T02:07:30.412438+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:07:30.412438+0000","last_undegraded":"2024-04-25T02:07:30.412438+0000","last_fullsized":"2024-04-25T02:07:30.412438+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439210+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:27.439210+0000","last_peered":"2024-04-25T02:07:27.439210+0000","last_clean":"2024-04-25T02:07:27.439210+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:27.439210+0000","last_undegraded":"2024-04-25T02:07:27.439210+0000","last_fullsized":"2024-04-25T02:07:27.439210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409467+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:28.409467+0000","last_peered":"2024-04-25T02:07:28.409467+0000","last_clean":"2024-04-25T02:07:28.409467+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:28.409467+0000","last_undegraded":"2024-04-25T02:07:28.409467+0000","last_fullsized":"2024-04-25T02:07:28.409467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439644+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:27.439644+0000","last_peered":"2024-04-25T02:07:27.439644+0000","last_clean":"2024-04-25T02:07:27.439644+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:27.439644+0000","last_undegraded":"2024-04-25T02:07:27.439644+0000","last_fullsized":"2024-04-25T02:07:27.439644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457333+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:07:27.457333+0000","last_peered":"2024-04-25T02:07:27.457333+0000","last_clean":"2024-04-25T02:07:27.457333+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:07:27.457333+0000","last_undegraded":"2024-04-25T02:07:27.457333+0000","last_fullsized":"2024-04-25T02:07:27.457333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441250+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:27.441250+0000","last_peered":"2024-04-25T02:07:27.441250+0000","last_clean":"2024-04-25T02:07:27.441250+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:27.441250+0000","last_undegraded":"2024-04-25T02:07:27.441250+0000","last_fullsized":"2024-04-25T02:07:27.441250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.454152+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:07:27.454152+0000","last_peered":"2024-04-25T02:07:27.454152+0000","last_clean":"2024-04-25T02:07:27.454152+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:07:27.454152+0000","last_undegraded":"2024-04-25T02:07:27.454152+0000","last_fullsized":"2024-04-25T02:07:27.454152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409617+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:28.409617+0000","last_peered":"2024-04-25T02:07:28.409617+0000","last_clean":"2024-04-25T02:07:28.409617+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:28.409617+0000","last_undegraded":"2024-04-25T02:07:28.409617+0000","last_fullsized":"2024-04-25T02:07:28.409617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159216+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:07:28.159216+0000","last_peered":"2024-04-25T02:07:28.159216+0000","last_clean":"2024-04-25T02:07:28.159216+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:07:28.159216+0000","last_undegraded":"2024-04-25T02:07:28.159216+0000","last_fullsized":"2024-04-25T02:07:28.159216+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451462+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:27.451462+0000","last_peered":"2024-04-25T02:07:27.451462+0000","last_clean":"2024-04-25T02:07:27.451462+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:27.451462+0000","last_undegraded":"2024-04-25T02:07:27.451462+0000","last_fullsized":"2024-04-25T02:07:27.451462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335930+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:28.335930+0000","last_peered":"2024-04-25T02:07:28.335930+0000","last_clean":"2024-04-25T02:07:28.335930+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:28.335930+0000","last_undegraded":"2024-04-25T02:07:28.335930+0000","last_fullsized":"2024-04-25T02:07:28.335930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445091+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445091+0000","last_peered":"2024-04-25T02:07:27.445091+0000","last_clean":"2024-04-25T02:07:27.445091+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445091+0000","last_undegraded":"2024-04-25T02:07:27.445091+0000","last_fullsized":"2024-04-25T02:07:27.445091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159027+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:28.159027+0000","last_peered":"2024-04-25T02:07:28.159027+0000","last_clean":"2024-04-25T02:07:28.159027+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:28.159027+0000","last_undegraded":"2024-04-25T02:07:28.159027+0000","last_fullsized":"2024-04-25T02:07:28.159027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439510+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:27.439510+0000","last_peered":"2024-04-25T02:07:27.439510+0000","last_clean":"2024-04-25T02:07:27.439510+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:27.439510+0000","last_undegraded":"2024-04-25T02:07:27.439510+0000","last_fullsized":"2024-04-25T02:07:27.439510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159617+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:28.159617+0000","last_peered":"2024-04-25T02:07:28.159617+0000","last_clean":"2024-04-25T02:07:28.159617+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:28.159617+0000","last_undegraded":"2024-04-25T02:07:28.159617+0000","last_fullsized":"2024-04-25T02:07:28.159617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442833+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:27.442833+0000","last_peered":"2024-04-25T02:07:27.442833+0000","last_clean":"2024-04-25T02:07:27.442833+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:27.442833+0000","last_undegraded":"2024-04-25T02:07:27.442833+0000","last_fullsized":"2024-04-25T02:07:27.442833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457822+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:27.457822+0000","last_peered":"2024-04-25T02:07:27.457822+0000","last_clean":"2024-04-25T02:07:27.457822+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:27.457822+0000","last_undegraded":"2024-04-25T02:07:27.457822+0000","last_fullsized":"2024-04-25T02:07:27.457822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.336281+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:28.336281+0000","last_peered":"2024-04-25T02:07:28.336281+0000","last_clean":"2024-04-25T02:07:28.336281+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:28.336281+0000","last_undegraded":"2024-04-25T02:07:28.336281+0000","last_fullsized":"2024-04-25T02:07:28.336281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447383+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:27.447383+0000","last_peered":"2024-04-25T02:07:27.447383+0000","last_clean":"2024-04-25T02:07:27.447383+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:27.447383+0000","last_undegraded":"2024-04-25T02:07:27.447383+0000","last_fullsized":"2024-04-25T02:07:27.447383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437102+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:27.437102+0000","last_peered":"2024-04-25T02:07:27.437102+0000","last_clean":"2024-04-25T02:07:27.437102+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:27.437102+0000","last_undegraded":"2024-04-25T02:07:27.437102+0000","last_fullsized":"2024-04-25T02:07:27.437102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439160+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:27.439160+0000","last_peered":"2024-04-25T02:07:27.439160+0000","last_clean":"2024-04-25T02:07:27.439160+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:27.439160+0000","last_undegraded":"2024-04-25T02:07:27.439160+0000","last_fullsized":"2024-04-25T02:07:27.439160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452101+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:27.452101+0000","last_peered":"2024-04-25T02:07:27.452101+0000","last_clean":"2024-04-25T02:07:27.452101+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:27.452101+0000","last_undegraded":"2024-04-25T02:07:27.452101+0000","last_fullsized":"2024-04-25T02:07:27.452101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443699+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:27.443699+0000","last_peered":"2024-04-25T02:07:27.443699+0000","last_clean":"2024-04-25T02:07:27.443699+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:27.443699+0000","last_undegraded":"2024-04-25T02:07:27.443699+0000","last_fullsized":"2024-04-25T02:07:27.443699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452950+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:27.452950+0000","last_peered":"2024-04-25T02:07:27.452950+0000","last_clean":"2024-04-25T02:07:27.452950+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:27.452950+0000","last_undegraded":"2024-04-25T02:07:27.452950+0000","last_fullsized":"2024-04-25T02:07:27.452950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439460+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:27.439460+0000","last_peered":"2024-04-25T02:07:27.439460+0000","last_clean":"2024-04-25T02:07:27.439460+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:27.439460+0000","last_undegraded":"2024-04-25T02:07:27.439460+0000","last_fullsized":"2024-04-25T02:07:27.439460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444042+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:27.444042+0000","last_peered":"2024-04-25T02:07:27.444042+0000","last_clean":"2024-04-25T02:07:27.444042+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:27.444042+0000","last_undegraded":"2024-04-25T02:07:27.444042+0000","last_fullsized":"2024-04-25T02:07:27.444042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409505+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:28.409505+0000","last_peered":"2024-04-25T02:07:28.409505+0000","last_clean":"2024-04-25T02:07:28.409505+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:28.409505+0000","last_undegraded":"2024-04-25T02:07:28.409505+0000","last_fullsized":"2024-04-25T02:07:28.409505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.160117+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:28.160117+0000","last_peered":"2024-04-25T02:07:28.160117+0000","last_clean":"2024-04-25T02:07:28.160117+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:28.160117+0000","last_undegraded":"2024-04-25T02:07:28.160117+0000","last_fullsized":"2024-04-25T02:07:28.160117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443677+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:27.443677+0000","last_peered":"2024-04-25T02:07:27.443677+0000","last_clean":"2024-04-25T02:07:27.443677+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:27.443677+0000","last_undegraded":"2024-04-25T02:07:27.443677+0000","last_fullsized":"2024-04-25T02:07:27.443677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443549+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:27.443549+0000","last_peered":"2024-04-25T02:07:27.443549+0000","last_clean":"2024-04-25T02:07:27.443549+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:27.443549+0000","last_undegraded":"2024-04-25T02:07:27.443549+0000","last_fullsized":"2024-04-25T02:07:27.443549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444582+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:27.444582+0000","last_peered":"2024-04-25T02:07:27.444582+0000","last_clean":"2024-04-25T02:07:27.444582+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:27.444582+0000","last_undegraded":"2024-04-25T02:07:27.444582+0000","last_fullsized":"2024-04-25T02:07:27.444582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159864+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:28.159864+0000","last_peered":"2024-04-25T02:07:28.159864+0000","last_clean":"2024-04-25T02:07:28.159864+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:28.159864+0000","last_undegraded":"2024-04-25T02:07:28.159864+0000","last_fullsized":"2024-04-25T02:07:28.159864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444698+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:27.444698+0000","last_peered":"2024-04-25T02:07:27.444698+0000","last_clean":"2024-04-25T02:07:27.444698+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:27.444698+0000","last_undegraded":"2024-04-25T02:07:27.444698+0000","last_fullsized":"2024-04-25T02:07:27.444698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457698+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:27.457698+0000","last_peered":"2024-04-25T02:07:27.457698+0000","last_clean":"2024-04-25T02:07:27.457698+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:27.457698+0000","last_undegraded":"2024-04-25T02:07:27.457698+0000","last_fullsized":"2024-04-25T02:07:27.457698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409458+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:28.409458+0000","last_peered":"2024-04-25T02:07:28.409458+0000","last_clean":"2024-04-25T02:07:28.409458+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:28.409458+0000","last_undegraded":"2024-04-25T02:07:28.409458+0000","last_fullsized":"2024-04-25T02:07:28.409458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451968+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:27.451968+0000","last_peered":"2024-04-25T02:07:27.451968+0000","last_clean":"2024-04-25T02:07:27.451968+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:27.451968+0000","last_undegraded":"2024-04-25T02:07:27.451968+0000","last_fullsized":"2024-04-25T02:07:27.451968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437218+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:27.437218+0000","last_peered":"2024-04-25T02:07:27.437218+0000","last_clean":"2024-04-25T02:07:27.437218+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:27.437218+0000","last_undegraded":"2024-04-25T02:07:27.437218+0000","last_fullsized":"2024-04-25T02:07:27.437218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159757+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:28.159757+0000","last_peered":"2024-04-25T02:07:28.159757+0000","last_clean":"2024-04-25T02:07:28.159757+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:28.159757+0000","last_undegraded":"2024-04-25T02:07:28.159757+0000","last_fullsized":"2024-04-25T02:07:28.159757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":47769,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":68,"num_read_kb":85,"num_write":147,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":143307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":447746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645333,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28608,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716544,"statfs":{"total":95995035648,"available":95965741056,"internally_reserved":0,"allocated":1622016,"data_stored":1091446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":456433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070496,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":456353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332133,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32700,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712452,"statfs":{"total":95995035648,"available":95961550848,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":447371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":498992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":966656,"data_stored":457093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1011712,"data_stored":500699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":457232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1564672,"data_stored":1047967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":45084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":45346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:07:33.732 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:07:33.732 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T02:07:33.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T02:07:33.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:33 smithi163 ceph-mon[32577]: pgmap v320: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 18 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:33.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:33 smithi174 ceph-mon[33171]: pgmap v320: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 18 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:34.185 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:35.728 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:35 smithi137 ceph-mon[28303]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:35.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:35 smithi137 ceph-mon[28303]: pgmap v321: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:35.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:35 smithi163 ceph-mon[32577]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:35.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:35 smithi163 ceph-mon[32577]: pgmap v321: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:35.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:35 smithi174 ceph-mon[33171]: from='client.24728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:07:35.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:35 smithi174 ceph-mon[33171]: pgmap v321: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 15 op/s; 76 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 -- 172.21.15.137:0/778001634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638105670 msgr2=0x7f9638107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 --2- 172.21.15.137:0/778001634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638105670 0x7f9638107a60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96200098f0 tx=0x7f9620009c00 comp rx=0 tx=0).stop 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 -- 172.21.15.137:0/778001634 shutdown_connections 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 --2- 172.21.15.137:0/778001634 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638105130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 --2- 172.21.15.137:0/778001634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638107fa0 0x7f963810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 --2- 172.21.15.137:0/778001634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638105670 0x7f9638107a60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 -- 172.21.15.137:0/778001634 >> 172.21.15.137:0/778001634 conn(0x7f96380fc750 msgr2=0x7f96380feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 -- 172.21.15.137:0/778001634 shutdown_connections 2024-04-25T02:07:36.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.222+0000 7f963ea00700 1 -- 172.21.15.137:0/778001634 wait complete. 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.223+0000 7f963ea00700 1 Processor -- start 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 -- start start 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638105670 0x7f9638198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638107fa0 0x7f963819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f963810dfe0 con 0x7f9638105670 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f963810de60 con 0x7f9638102d40 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f963ea00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f963810e160 con 0x7f9638107fa0 2024-04-25T02:07:36.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f9637e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f9637e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:35206/0 (socket says 172.21.15.137:35206) 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.224+0000 7f9637e00700 1 -- 172.21.15.137:0/3374184281 learned_addr learned my addr 172.21.15.137:0/3374184281 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f963ca00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638107fa0 0x7f963819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f962fe00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638105670 0x7f9638198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 -- 172.21.15.137:0/3374184281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638107fa0 msgr2=0x7f963819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638107fa0 0x7f963819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 -- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638105670 msgr2=0x7f9638198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638105670 0x7f9638198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 -- 172.21.15.137:0/3374184281 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96381a0160 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9637e00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f962800e9c0 tx=0x7f962800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.225+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962800cbd0 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.226+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96381a0450 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.226+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f962800ee60 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.226+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628010430 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.226+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96381a0990 con 0x7f9638102d40 2024-04-25T02:07:36.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.227+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96380507a0 con 0x7f9638102d40 2024-04-25T02:07:36.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.229+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9628004750 con 0x7f9638102d40 2024-04-25T02:07:36.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.230+0000 7f9635600700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 0x7f961c0a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:36.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.230+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f96280cf410 con 0x7f9638102d40 2024-04-25T02:07:36.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.230+0000 7f962fe00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 0x7f961c0a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:36.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.231+0000 7f962fe00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 0x7f961c0a52a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f962000fc60 tx=0x7f9620019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:36.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.234+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f962809c1c0 con 0x7f9638102d40 2024-04-25T02:07:36.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.552+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f963802db30 con 0x7f9638102d40 2024-04-25T02:07:36.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.559+0000 7f9635600700 1 -- 172.21.15.137:0/3374184281 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f962809bac0 con 0x7f9638102d40 2024-04-25T02:07:36.565 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-25T02:07:36.566 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQDouilmD2cHIRAAguFL+1wZVybTrmmuu+Rz/Q== 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 msgr2=0x7f961c0a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 0x7f961c0a52a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f962000fc60 tx=0x7f9620019040 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 msgr2=0x7f9638198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f962800e9c0 tx=0x7f962800ecd0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 shutdown_connections 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f961c0a2de0 0x7f961c0a52a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9638102d40 0x7f9638198500 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9638107fa0 0x7f963819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 --2- 172.21.15.137:0/3374184281 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9638105670 0x7f9638198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.562+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 >> 172.21.15.137:0/3374184281 conn(0x7f96380fc750 msgr2=0x7f9638103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:36.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.563+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 shutdown_connections 2024-04-25T02:07:36.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:36.563+0000 7f963ea00700 1 -- 172.21.15.137:0/3374184281 wait complete. 2024-04-25T02:07:37.335 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:07:37.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T02:07:37.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:07:37.456 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:07:37.457 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:07:37.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T02:07:37.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:37 smithi137 ceph-mon[28303]: pgmap v322: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 12 op/s; 61 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:37.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:37 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3374184281' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:37 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:37 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:07:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:37 smithi163 ceph-mon[32577]: pgmap v322: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 12 op/s; 61 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:37 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3374184281' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:37 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:37 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:07:37.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:37 smithi174 ceph-mon[33171]: pgmap v322: 97 pgs: 97 active+clean; 623 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 12 op/s; 61 B/s, 1 keys/s, 0 objects/s recovering 2024-04-25T02:07:37.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:37 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3374184281' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:37 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T02:07:37.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:37 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T02:07:37.935 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:39.624 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:39 smithi137 ceph-mon[28303]: pgmap v323: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 56 B/s, 0 keys/s, 0 objects/s recovering 2024-04-25T02:07:39.748 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:39 smithi174 ceph-mon[33171]: pgmap v323: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 56 B/s, 0 keys/s, 0 objects/s recovering 2024-04-25T02:07:39.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:39 smithi163 ceph-mon[32577]: pgmap v323: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s; 56 B/s, 0 keys/s, 0 objects/s recovering 2024-04-25T02:07:40.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.136+0000 7fd27f600700 1 -- 172.21.15.137:0/3099703915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074460 msgr2=0x7fd278074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.136+0000 7fd27f600700 1 --2- 172.21.15.137:0/3099703915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074460 0x7fd278074840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009990 tx=0x7fd26c009ca0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 -- 172.21.15.137:0/3099703915 shutdown_connections 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 --2- 172.21.15.137:0/3099703915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd27810ec30 0x7fd278111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 --2- 172.21.15.137:0/3099703915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074460 0x7fd278074840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 --2- 172.21.15.137:0/3099703915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd278074d80 0x7fd27810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 -- 172.21.15.137:0/3099703915 >> 172.21.15.137:0/3099703915 conn(0x7fd278079390 msgr2=0x7fd2780797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 -- 172.21.15.137:0/3099703915 shutdown_connections 2024-04-25T02:07:40.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.137+0000 7fd27f600700 1 -- 172.21.15.137:0/3099703915 wait complete. 2024-04-25T02:07:40.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 Processor -- start 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 -- start start 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074d80 0x7fd2781a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd27810ec30 0x7fd27819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd278114860 con 0x7fd278074d80 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd2781146e0 con 0x7fd27810ec30 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.138+0000 7fd27f600700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2781149e0 con 0x7fd278074460 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:44982/0 (socket says 172.21.15.137:44982) 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 -- 172.21.15.137:0/2439466107 learned_addr learned my addr 172.21.15.137:0/2439466107 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd277e00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074d80 0x7fd2781a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27d600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd27810ec30 0x7fd27819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 -- 172.21.15.137:0/2439466107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd27810ec30 msgr2=0x7fd27819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:40.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd27810ec30 0x7fd27819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 -- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074d80 msgr2=0x7fd2781a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074d80 0x7fd2781a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 -- 172.21.15.137:0/2439466107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27819b200 con 0x7fd278074460 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.139+0000 7fd27cc00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0095b0 tx=0x7fd26c005590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.140+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c026070 con 0x7fd278074460 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.140+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd26c00fe30 con 0x7fd278074460 2024-04-25T02:07:40.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.140+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27819b490 con 0x7fd278074460 2024-04-25T02:07:40.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.140+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0173f0 con 0x7fd278074460 2024-04-25T02:07:40.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.140+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2781a77b0 con 0x7fd278074460 2024-04-25T02:07:40.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.141+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd278068f20 con 0x7fd278074460 2024-04-25T02:07:40.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.143+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd26c029070 con 0x7fd278074460 2024-04-25T02:07:40.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.144+0000 7fd275600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 0x7fd2600a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:40.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.144+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd26c0cfda0 con 0x7fd278074460 2024-04-25T02:07:40.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.144+0000 7fd277e00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 0x7fd2600a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:40.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.145+0000 7fd277e00700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 0x7fd2600a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd278110710 tx=0x7fd264009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:40.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.146+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd26c013070 con 0x7fd278074460 2024-04-25T02:07:40.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.434+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd2781a79e0 con 0x7fd278074460 2024-04-25T02:07:40.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.442+0000 7fd275600700 1 -- 172.21.15.137:0/2439466107 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263203 (secure 0 0 0) 0x7fd26c09cbe0 con 0x7fd278074460 2024-04-25T02:07:40.455 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:40.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 msgr2=0x7fd2600a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:40.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 0x7fd2600a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd278110710 tx=0x7fd264009260 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 msgr2=0x7fd2781a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0095b0 tx=0x7fd26c005590 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 shutdown_connections 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd2600a2d30 0x7fd2600a51f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd27810ec30 0x7fd27819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd278074460 0x7fd2781a08e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 --2- 172.21.15.137:0/2439466107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd278074d80 0x7fd2781a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:40.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 >> 172.21.15.137:0/2439466107 conn(0x7fd278079390 msgr2=0x7fd278100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:40.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 shutdown_connections 2024-04-25T02:07:40.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:40.447+0000 7fd27f600700 1 -- 172.21.15.137:0/2439466107 wait complete. 2024-04-25T02:07:40.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:40 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2439466107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T02:07:40.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:40 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2439466107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T02:07:40.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:40 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2439466107' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T02:07:41.327 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":205966009},{"type":"v1","addr":"172.21.15.137:6801","nonce":205966009}]},"active_addr":"172.21.15.137:6801/205966009","active_change":"2024-04-25T01:59:26.231868+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.137:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":16164329}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":652761516}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1200236983}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3780953419}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":556645493}]}]} 2024-04-25T02:07:41.332 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T02:07:41.332 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T02:07:41.332 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:07:41.776 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:41.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:41 smithi137 ceph-mon[28303]: pgmap v324: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:41.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:41 smithi163 ceph-mon[32577]: pgmap v324: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:41.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:41 smithi174 ceph-mon[33171]: pgmap v324: 97 pgs: 97 active+clean; 631 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:43.641 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:43 smithi137 ceph-mon[28303]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:43.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 -- 172.21.15.137:0/1708553575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 msgr2=0x7f61a0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:43.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 --2- 172.21.15.137:0/1708553575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a0106da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f618c009920 tx=0x7f618c009c30 comp rx=0 tx=0).stop 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 -- 172.21.15.137:0/1708553575 shutdown_connections 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 --2- 172.21.15.137:0/1708553575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 0x7f61a010f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 --2- 172.21.15.137:0/1708553575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 --2- 172.21.15.137:0/1708553575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a0106da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 -- 172.21.15.137:0/1708553575 >> 172.21.15.137:0/1708553575 conn(0x7f61a00fdc50 msgr2=0x7f61a0100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 -- 172.21.15.137:0/1708553575 shutdown_connections 2024-04-25T02:07:43.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.800+0000 7f61a5800700 1 -- 172.21.15.137:0/1708553575 wait complete. 2024-04-25T02:07:43.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 Processor -- start 2024-04-25T02:07:43.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 -- start start 2024-04-25T02:07:43.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:43.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a01a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:43.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 0x7f61a019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61a01125d0 con 0x7f61a01023a0 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f61a0112450 con 0x7f61a0107480 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.802+0000 7f61a5800700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f61a0112750 con 0x7f61a0102d50 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43196/0 (socket says 172.21.15.137:43196) 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619fe00700 1 -- 172.21.15.137:0/2177849552 learned_addr learned my addr 172.21.15.137:0/2177849552 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a01a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f61a4e00700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 0x7f61a019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 -- 172.21.15.137:0/2177849552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 msgr2=0x7f61a019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 0x7f61a019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 -- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 msgr2=0x7f61a01a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 -- 172.21.15.137:0/2177849552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a019b230 con 0x7f61a0102d50 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619fe00700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:43.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.803+0000 7f619f400700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a01a0e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f618c000c00 tx=0x7f618c010f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.804+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c027070 con 0x7f61a0102d50 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.804+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f618c00f9e0 con 0x7f61a0102d50 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.804+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a019b4c0 con 0x7f61a0102d50 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.804+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c004930 con 0x7f61a0102d50 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.804+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a01a77e0 con 0x7f61a0102d50 2024-04-25T02:07:43.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.805+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a0068f20 con 0x7f61a0102d50 2024-04-25T02:07:43.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.808+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f618c02a070 con 0x7f61a0102d50 2024-04-25T02:07:43.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.809+0000 7f619cc00700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 0x7f61840a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:43.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.809+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f618c0cf9f0 con 0x7f61a0102d50 2024-04-25T02:07:43.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.809+0000 7f619fe00700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 0x7f61840a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:43.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.810+0000 7f619fe00700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 0x7f61840a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6190005950 tx=0x7f6190009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:43.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:43.813+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f618c05e740 con 0x7f61a0102d50 2024-04-25T02:07:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:43 smithi163 ceph-mon[32577]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:43.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:43 smithi174 ceph-mon[33171]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.0 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-04-25T02:07:44.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.038+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61a01a79b0 con 0x7f61a0102d50 2024-04-25T02:07:44.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.040+0000 7f619cc00700 1 -- 172.21.15.137:0/2177849552 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7f618c013030 con 0x7f61a0102d50 2024-04-25T02:07:44.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:44.047 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:44.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 msgr2=0x7f61840a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:44.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 0x7f61840a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6190005950 tx=0x7f6190009310 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 msgr2=0x7f61a01a0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a01a0e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f618c000c00 tx=0x7f618c010f70 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 shutdown_connections 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f61840a2d30 0x7f61840a51f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f61a0107480 0x7f61a019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61a01023a0 0x7f61a01a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 --2- 172.21.15.137:0/2177849552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61a0102d50 0x7f61a01a0e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 >> 172.21.15.137:0/2177849552 conn(0x7f61a00fdc50 msgr2=0x7f61a0100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 shutdown_connections 2024-04-25T02:07:44.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:44.043+0000 7f61a5800700 1 -- 172.21.15.137:0/2177849552 wait complete. 2024-04-25T02:07:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:44 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2177849552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:44.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:44 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2177849552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:44.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:44 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2177849552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:44.955 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T02:07:44.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T02:07:45.401 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:45 smithi137 ceph-mon[28303]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:45 smithi163 ceph-mon[32577]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:45 smithi174 ceph-mon[33171]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:46.681 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:46 smithi137 ceph-mon[28303]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:46.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:46 smithi163 ceph-mon[32577]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:46.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:46 smithi174 ceph-mon[33171]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-04-25T02:07:47.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 -- 172.21.15.137:0/254201254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0074074ef0 msgr2=0x7f0074112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 --2- 172.21.15.137:0/254201254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0074074ef0 0x7f0074112c10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0060009990 tx=0x7f0060009ca0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 -- 172.21.15.137:0/254201254 shutdown_connections 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 --2- 172.21.15.137:0/254201254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00740745d0 0x7f00740749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 --2- 172.21.15.137:0/254201254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074113150 0x7f0074115540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 --2- 172.21.15.137:0/254201254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0074074ef0 0x7f0074112c10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 -- 172.21.15.137:0/254201254 >> 172.21.15.137:0/254201254 conn(0x7f00740fdc50 msgr2=0x7f0074100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 -- 172.21.15.137:0/254201254 shutdown_connections 2024-04-25T02:07:47.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.477+0000 7f0079a00700 1 -- 172.21.15.137:0/254201254 wait complete. 2024-04-25T02:07:47.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.478+0000 7f0079a00700 1 Processor -- start 2024-04-25T02:07:47.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.478+0000 7f0079a00700 1 -- start start 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.478+0000 7f0079a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00740745d0 0x7f007419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079a00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 0x7f007419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079a00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 0x7f00741a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0074118c00 con 0x7f00740745d0 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079a00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0074118a80 con 0x7f0074113150 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079a00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0074118d80 con 0x7f0074074ef0 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0073400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 0x7f007419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0073e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00740745d0 0x7f007419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0073400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 0x7f007419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:40766/0 (socket says 172.21.15.137:40766) 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0073400700 1 -- 172.21.15.137:0/1927193802 learned_addr learned my addr 172.21.15.137:0/1927193802 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 0x7f00741a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 -- 172.21.15.137:0/1927193802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 msgr2=0x7f007419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 0x7f007419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 -- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00740745d0 msgr2=0x7f007419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00740745d0 0x7f007419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.479+0000 7f0079000700 1 -- 172.21.15.137:0/1927193802 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00741a3fc0 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0079000700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 0x7f00741a3880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f006c00ef90 tx=0x7f006c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0092e0 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00741a4250 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f006c004bb0 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c004260 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.480+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00741abb30 con 0x7f0074113150 2024-04-25T02:07:47.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.481+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0074068f20 con 0x7f0074113150 2024-04-25T02:07:47.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.483+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f006c01b030 con 0x7f0074113150 2024-04-25T02:07:47.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.485+0000 7f0070c00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 0x7f00580a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:47.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.485+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f006c0cec50 con 0x7f0074113150 2024-04-25T02:07:47.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.485+0000 7f0073e00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 0x7f00580a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:47.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.486+0000 7f0073e00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 0x7f00580a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0064009c60 tx=0x7f0064009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:47.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.490+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f006c022020 con 0x7f0074113150 2024-04-25T02:07:47.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.713+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f007402db30 con 0x7f0074113150 2024-04-25T02:07:47.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.715+0000 7f0070c00700 1 -- 172.21.15.137:0/1927193802 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7f006c010040 con 0x7f0074113150 2024-04-25T02:07:47.722 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:07:47.723 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:07:47.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 msgr2=0x7f00580a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 0x7f00580a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0064009c60 tx=0x7f0064009260 comp rx=0 tx=0).stop 2024-04-25T02:07:47.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 msgr2=0x7f00741a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:47.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 0x7f00741a3880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f006c00ef90 tx=0x7f006c00c3a0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 shutdown_connections 2024-04-25T02:07:47.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f00580a2d30 0x7f00580a51f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074113150 0x7f00741a3880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f00740745d0 0x7f007419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 --2- 172.21.15.137:0/1927193802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0074074ef0 0x7f007419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 >> 172.21.15.137:0/1927193802 conn(0x7f00740fdc50 msgr2=0x7f00740fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 shutdown_connections 2024-04-25T02:07:47.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:47.718+0000 7f0079a00700 1 -- 172.21.15.137:0/1927193802 wait complete. 2024-04-25T02:07:48.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1927193802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:48.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1927193802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:48.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1927193802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:07:48.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T02:07:48.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T02:07:48.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T02:07:48.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T02:07:48.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T02:07:48.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T02:07:48.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-25T02:07:48.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-25T02:07:48.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-25T02:07:48.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-25T02:07:48.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-25T02:07:48.466 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-25T02:07:49.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:48 smithi137 ceph-mon[28303]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T02:07:49.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:48 smithi163 ceph-mon[32577]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T02:07:49.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:48 smithi174 ceph-mon[33171]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-25T02:07:49.457 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:49.480 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:50.997 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:50.997 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.001 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.002 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.002 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.011 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.292 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:07:51.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:51 smithi137 ceph-mon[28303]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 852 B/s wr, 6 op/s 2024-04-25T02:07:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:51 smithi163 ceph-mon[32577]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 852 B/s wr, 6 op/s 2024-04-25T02:07:51.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:51 smithi174 ceph-mon[33171]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 852 B/s wr, 6 op/s 2024-04-25T02:07:53.512 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:53 smithi137 ceph-mon[28303]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-04-25T02:07:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:53 smithi163 ceph-mon[32577]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-04-25T02:07:53.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:53 smithi174 ceph-mon[33171]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 852 B/s wr, 7 op/s 2024-04-25T02:07:55.633 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:55 smithi137 ceph-mon[28303]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:55.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:55 smithi163 ceph-mon[32577]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:55.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:55 smithi174 ceph-mon[33171]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:57.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 -- 172.21.15.137:0/2683854708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c1096a0 msgr2=0x7fec3c111270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 --2- 172.21.15.137:0/2683854708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c1096a0 0x7fec3c111270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec3400b0a0 tx=0x7fec3400b3b0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 -- 172.21.15.137:0/2683854708 shutdown_connections 2024-04-25T02:07:57.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 --2- 172.21.15.137:0/2683854708 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c1096a0 0x7fec3c111270 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 --2- 172.21.15.137:0/2683854708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 --2- 172.21.15.137:0/2683854708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec3c104f70 0x7fec3c108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 -- 172.21.15.137:0/2683854708 >> 172.21.15.137:0/2683854708 conn(0x7fec3c0ffe50 msgr2=0x7fec3c102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:57.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:57 smithi137 ceph-mon[28303]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.732+0000 7fec41c00700 1 -- 172.21.15.137:0/2683854708 shutdown_connections 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.733+0000 7fec41c00700 1 -- 172.21.15.137:0/2683854708 wait complete. 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 Processor -- start 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 -- start start 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c104f70 0x7fec3c1a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec3c1096a0 0x7fec3c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c114820 con 0x7fec3c1045c0 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c1146a0 con 0x7fec3c104f70 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.734+0000 7fec41c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c1149a0 con 0x7fec3c1096a0 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52560/0 (socket says 172.21.15.137:52560) 2024-04-25T02:07:57.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 -- 172.21.15.137:0/731380393 learned_addr learned my addr 172.21.15.137:0/731380393 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3b400700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c104f70 0x7fec3c1a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec41200700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec3c1096a0 0x7fec3c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 -- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec3c1096a0 msgr2=0x7fec3c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec3c1096a0 0x7fec3c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 -- 172.21.15.137:0/731380393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c104f70 msgr2=0x7fec3c1a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c104f70 0x7fec3c1a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c19b160 con 0x7fec3c1045c0 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3b400700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec3c104f70 0x7fec3c1a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:07:57.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.735+0000 7fec3be00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1a07f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00e9a0 tx=0x7fec2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.736+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00ca10 con 0x7fec3c1045c0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.736+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec2c00cbb0 con 0x7fec3c1045c0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.736+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c018710 con 0x7fec3c1045c0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.736+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c19b450 con 0x7fec3c1045c0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.736+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c1a76c0 con 0x7fec3c1045c0 2024-04-25T02:07:57.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.737+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec3c1011a0 con 0x7fec3c1045c0 2024-04-25T02:07:57.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.739+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fec2c010430 con 0x7fec3c1045c0 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.741+0000 7fec38c00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fec200a2cb0 0x7fec200a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.741+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fec2c0cfbc0 con 0x7fec3c1045c0 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec3b400700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fec200a2cb0 0x7fec200a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec38c00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] conn(0x7fec200ac7f0 0x7fec200aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec2c01bec0 con 0x7fec200ac7f0 2024-04-25T02:07:57.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fec2c0cff70 con 0x7fec3c1045c0 2024-04-25T02:07:57.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec41200700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] conn(0x7fec200ac7f0 0x7fec200aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:07:57.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.742+0000 7fec3b400700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fec200a2cb0 0x7fec200a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec28009680 tx=0x7fec28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:57.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.743+0000 7fec41200700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] conn(0x7fec200ac7f0 0x7fec200aec90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:07:57.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.744+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== osd.2 v2:172.21.15.174:6800/2383666582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec2c01bec0 con 0x7fec200ac7f0 2024-04-25T02:07:57.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.762+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 --> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec3c105aa0 con 0x7fec200ac7f0 2024-04-25T02:07:57.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.762+0000 7fec38c00700 1 -- 172.21.15.137:0/731380393 <== osd.2 v2:172.21.15.174:6800/2383666582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec3c105aa0 con 0x7fec200ac7f0 2024-04-25T02:07:57.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] conn(0x7fec200ac7f0 msgr2=0x7fec200aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] conn(0x7fec200ac7f0 0x7fec200aec90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fec200a2cb0 msgr2=0x7fec200a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fec200a2cb0 0x7fec200a5170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec28009680 tx=0x7fec28009260 comp rx=0 tx=0).stop 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 msgr2=0x7fec3c1a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 --2- 172.21.15.137:0/731380393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fec3c1045c0 0x7fec3c1a07f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00e9a0 tx=0x7fec2c00ecb0 comp rx=0 tx=0).stop 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41200700 1 -- 172.21.15.137:0/731380393 reap_dead start 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 shutdown_connections 2024-04-25T02:07:57.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.763+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 >> 172.21.15.137:0/731380393 conn(0x7fec3c0ffe50 msgr2=0x7fec3c100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:07:57.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.764+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 shutdown_connections 2024-04-25T02:07:57.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:57.764+0000 7fec41c00700 1 -- 172.21.15.137:0/731380393 wait complete. 2024-04-25T02:07:57.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:57 smithi163 ceph-mon[32577]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:57.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:57 smithi174 ceph-mon[33171]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-25T02:07:59.761 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:07:59 smithi137 ceph-mon[28303]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:07:59.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:07:59 smithi163 ceph-mon[32577]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:07:59.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:07:59 smithi174 ceph-mon[33171]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:08:01.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 -- 172.21.15.137:0/1329965477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd74410e860 msgr2=0x7fd74410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 --2- 172.21.15.137:0/1329965477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd74410e860 0x7fd74410ec40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd734009990 tx=0x7fd734009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 -- 172.21.15.137:0/1329965477 shutdown_connections 2024-04-25T02:08:01.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 --2- 172.21.15.137:0/1329965477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd744109220 0x7fd744115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 --2- 172.21.15.137:0/1329965477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd74410e860 0x7fd74410ec40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 --2- 172.21.15.137:0/1329965477 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd744108860 0x7fd744108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 -- 172.21.15.137:0/1329965477 >> 172.21.15.137:0/1329965477 conn(0x7fd744075a00 msgr2=0x7fd744107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 -- 172.21.15.137:0/1329965477 shutdown_connections 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.109+0000 7fd749400700 1 -- 172.21.15.137:0/1329965477 wait complete. 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 Processor -- start 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 -- start start 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 0x7fd74419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd744109220 0x7fd74419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd74410e860 0x7fd7441a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd744118d30 con 0x7fd744108860 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd744118bb0 con 0x7fd74410e860 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.110+0000 7fd749400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd744118eb0 con 0x7fd744109220 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 0x7fd74419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 0x7fd74419f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53244/0 (socket says 172.21.15.137:53244) 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 -- 172.21.15.137:0/907905030 learned_addr learned my addr 172.21.15.137:0/907905030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd743200700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd74410e860 0x7fd7441a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd741e00700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd744109220 0x7fd74419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 -- 172.21.15.137:0/907905030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd744109220 msgr2=0x7fd74419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd744109220 0x7fd74419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 -- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd74410e860 msgr2=0x7fd7441a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd74410e860 0x7fd7441a3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7441a40c0 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.111+0000 7fd742800700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 0x7fd74419f100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.112+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734027070 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.112+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd73400fdc0 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.112+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7441a4350 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.112+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7340173f0 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.112+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7441abc30 con 0x7fd744108860 2024-04-25T02:08:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.113+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd744062980 con 0x7fd744108860 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.115+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd73402a070 con 0x7fd744108860 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.116+0000 7fd73b400700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7280a2cb0 0x7fd7280a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.116+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd7340d01a0 con 0x7fd744108860 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.116+0000 7fd741e00700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7280a2cb0 0x7fd7280a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.117+0000 7fd73b400700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] conn(0x7fd7280ac6c0 0x7fd7280aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.117+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd734001d30 con 0x7fd7280ac6c0 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.117+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd7340d0550 con 0x7fd744108860 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.117+0000 7fd741e00700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7280a2cb0 0x7fd7280a5170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7440777c0 tx=0x7fd730009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.117+0000 7fd743200700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] conn(0x7fd7280ac6c0 0x7fd7280aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.118+0000 7fd743200700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] conn(0x7fd7280ac6c0 0x7fd7280aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.119+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== osd.10 v2:172.21.15.163:6824/2960962752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd734001d30 con 0x7fd7280ac6c0 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.137+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 --> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd744062e00 con 0x7fd7280ac6c0 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.138+0000 7fd73b400700 1 -- 172.21.15.137:0/907905030 <== osd.10 v2:172.21.15.163:6824/2960962752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd744062e00 con 0x7fd7280ac6c0 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] conn(0x7fd7280ac6c0 msgr2=0x7fd7280aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] conn(0x7fd7280ac6c0 0x7fd7280aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7280a2cb0 msgr2=0x7fd7280a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7280a2cb0 0x7fd7280a5170 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7440777c0 tx=0x7fd730009260 comp rx=0 tx=0).stop 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 msgr2=0x7fd74419f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 --2- 172.21.15.137:0/907905030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd744108860 0x7fd74419f100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd734000c00 tx=0x7fd734005590 comp rx=0 tx=0).stop 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd743200700 1 -- 172.21.15.137:0/907905030 reap_dead start 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 shutdown_connections 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 >> 172.21.15.137:0/907905030 conn(0x7fd744075a00 msgr2=0x7fd744075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 shutdown_connections 2024-04-25T02:08:01.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:01.139+0000 7fd749400700 1 -- 172.21.15.137:0/907905030 wait complete. 2024-04-25T02:08:01.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:01 smithi137 ceph-mon[28303]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:01.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:01 smithi163 ceph-mon[32577]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:01.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:01 smithi174 ceph-mon[33171]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:02.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 -- 172.21.15.137:0/2631354095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 msgr2=0x7fe92c106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 --2- 172.21.15.137:0/2631354095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c106e30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe918009990 tx=0x7fe918009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 -- 172.21.15.137:0/2631354095 shutdown_connections 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 --2- 172.21.15.137:0/2631354095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe92c107560 0x7fe92c10f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 --2- 172.21.15.137:0/2631354095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c06aa00 0x7fe92c06ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 --2- 172.21.15.137:0/2631354095 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c106e30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.625+0000 7fe92be00700 1 -- 172.21.15.137:0/2631354095 >> 172.21.15.137:0/2631354095 conn(0x7fe92c077f70 msgr2=0x7fe92c078380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.626+0000 7fe92be00700 1 -- 172.21.15.137:0/2631354095 shutdown_connections 2024-04-25T02:08:02.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.626+0000 7fe92be00700 1 -- 172.21.15.137:0/2631354095 wait complete. 2024-04-25T02:08:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 Processor -- start 2024-04-25T02:08:02.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 -- start start 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe92c06aa00 0x7fe92c1013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c101900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c107560 0x7fe92c101e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c112610 con 0x7fe92c06b3b0 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c112490 con 0x7fe92c06aa00 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.627+0000 7fe92be00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c112790 con 0x7fe92c107560 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c101900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c101900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53256/0 (socket says 172.21.15.137:53256) 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 -- 172.21.15.137:0/1539429010 learned_addr learned my addr 172.21.15.137:0/1539429010 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92aa00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe92c06aa00 0x7fe92c1013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92b400700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c107560 0x7fe92c101e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 -- 172.21.15.137:0/1539429010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c107560 msgr2=0x7fe92c101e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe92c107560 0x7fe92c101e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 -- 172.21.15.137:0/1539429010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe92c06aa00 msgr2=0x7fe92c1013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe92c06aa00 0x7fe92c1013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.628+0000 7fe92a000700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c1a6e80 con 0x7fe92c06b3b0 2024-04-25T02:08:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe92a000700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c101900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe918006010 tx=0x7fe918005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918027070 con 0x7fe92c06b3b0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe9180056c0 con 0x7fe92c06b3b0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c1a7110 con 0x7fe92c06b3b0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9180173f0 con 0x7fe92c06b3b0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.629+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c1a7560 con 0x7fe92c06b3b0 2024-04-25T02:08:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.630+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe92c0629c0 con 0x7fe92c06b3b0 2024-04-25T02:08:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.632+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe91802a070 con 0x7fe92c06b3b0 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe923400700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe9100a2cb0 0x7fe9100a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe9180d01c0 con 0x7fe92c06b3b0 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe92aa00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe9100a2cb0 0x7fe9100a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe923400700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] conn(0x7fe9100ac7f0 0x7fe9100aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe91802ee50 con 0x7fe9100ac7f0 2024-04-25T02:08:02.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe9180d0570 con 0x7fe92c06b3b0 2024-04-25T02:08:02.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.634+0000 7fe92b400700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] conn(0x7fe9100ac7f0 0x7fe9100aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.635+0000 7fe92aa00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe9100a2cb0 0x7fe9100a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009680 tx=0x7fe91c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.635+0000 7fe92b400700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] conn(0x7fe9100ac7f0 0x7fe9100aec90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.636+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== osd.6 v2:172.21.15.137:6818/2828658472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe91802ee50 con 0x7fe9100ac7f0 2024-04-25T02:08:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.655+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 --> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe92c062e40 con 0x7fe9100ac7f0 2024-04-25T02:08:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.655+0000 7fe923400700 1 -- 172.21.15.137:0/1539429010 <== osd.6 v2:172.21.15.137:6818/2828658472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe92c062e40 con 0x7fe9100ac7f0 2024-04-25T02:08:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] conn(0x7fe9100ac7f0 msgr2=0x7fe9100aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] conn(0x7fe9100ac7f0 0x7fe9100aec90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe9100a2cb0 msgr2=0x7fe9100a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe9100a2cb0 0x7fe9100a5170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009680 tx=0x7fe91c009260 comp rx=0 tx=0).stop 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 msgr2=0x7fe92c101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 --2- 172.21.15.137:0/1539429010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe92c06b3b0 0x7fe92c101900 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe918006010 tx=0x7fe918005590 comp rx=0 tx=0).stop 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92b400700 1 -- 172.21.15.137:0/1539429010 reap_dead start 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 shutdown_connections 2024-04-25T02:08:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 >> 172.21.15.137:0/1539429010 conn(0x7fe92c077f70 msgr2=0x7fe92c0ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.656+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 shutdown_connections 2024-04-25T02:08:02.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:02.657+0000 7fe92be00700 1 -- 172.21.15.137:0/1539429010 wait complete. 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 -- 172.21.15.137:0/2095674258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c1130c0 msgr2=0x7fd79c1154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/2095674258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c1130c0 0x7fd79c1154b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd79400b0a0 tx=0x7fd79400b3b0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 -- 172.21.15.137:0/2095674258 shutdown_connections 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/2095674258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c076760 0x7fd79c076b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/2095674258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c1130c0 0x7fd79c1154b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/2095674258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c077080 0x7fd79c112b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 -- 172.21.15.137:0/2095674258 >> 172.21.15.137:0/2095674258 conn(0x7fd79c0fff10 msgr2=0x7fd79c102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 -- 172.21.15.137:0/2095674258 shutdown_connections 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.658+0000 7fd7a0c00700 1 -- 172.21.15.137:0/2095674258 wait complete. 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.659+0000 7fd7a0c00700 1 Processor -- start 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.659+0000 7fd7a0c00700 1 -- start start 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 0x7fd79c19f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c077080 0x7fd79c19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c1130c0 0x7fd79c1a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c118d00 con 0x7fd79c077080 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c118b80 con 0x7fd79c1130c0 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd7a0c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c118e80 con 0x7fd79c076760 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c077080 0x7fd79c19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 0x7fd79c19f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 0x7fd79c19f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:46878/0 (socket says 172.21.15.137:46878) 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 -- 172.21.15.137:0/3484904685 learned_addr learned my addr 172.21.15.137:0/3484904685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd79a800700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c1130c0 0x7fd79c1a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 -- 172.21.15.137:0/3484904685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c1130c0 msgr2=0x7fd79c1a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd79c1130c0 0x7fd79c1a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 -- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c077080 msgr2=0x7fd79c19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd79c077080 0x7fd79c19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.660+0000 7fd799e00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c1a4180 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd799e00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 0x7fd79c19f170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00e9a0 tx=0x7fd78c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00ca10 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c1a4470 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd78c00cbb0 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c018710 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.661+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c1abcf0 con 0x7fd79c076760 2024-04-25T02:08:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.662+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd79c062900 con 0x7fd79c076760 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.664+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd78c010430 con 0x7fd79c076760 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.665+0000 7fd792a00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7800a2d30 0x7fd7800a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.665+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd78c0cfb30 con 0x7fd79c076760 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd799400700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7800a2d30 0x7fd7800a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd792a00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] conn(0x7fd7800ac870 0x7fd7800aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd78c023e50 con 0x7fd7800ac870 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd78c0cfee0 con 0x7fd79c076760 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd79a800700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] conn(0x7fd7800ac870 0x7fd7800aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.666+0000 7fd799400700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7800a2d30 0x7fd7800a51f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd79c103970 tx=0x7fd788009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.667+0000 7fd79a800700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] conn(0x7fd7800ac870 0x7fd7800aed10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.668+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== osd.5 v2:172.21.15.174:6808/586542310 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd78c023e50 con 0x7fd7800ac870 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.686+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 --> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd79c062d30 con 0x7fd7800ac870 2024-04-25T02:08:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd792a00700 1 -- 172.21.15.137:0/3484904685 <== osd.5 v2:172.21.15.174:6808/586542310 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd79c062d30 con 0x7fd7800ac870 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] conn(0x7fd7800ac870 msgr2=0x7fd7800aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] conn(0x7fd7800ac870 0x7fd7800aed10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7800a2d30 msgr2=0x7fd7800a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd7800a2d30 0x7fd7800a51f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd79c103970 tx=0x7fd788009260 comp rx=0 tx=0).stop 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 msgr2=0x7fd79c19f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 --2- 172.21.15.137:0/3484904685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd79c076760 0x7fd79c19f170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00e9a0 tx=0x7fd78c00ecb0 comp rx=0 tx=0).stop 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd79a800700 1 -- 172.21.15.137:0/3484904685 reap_dead start 2024-04-25T02:08:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 shutdown_connections 2024-04-25T02:08:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.687+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 >> 172.21.15.137:0/3484904685 conn(0x7fd79c0fff10 msgr2=0x7fd79c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.688+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 shutdown_connections 2024-04-25T02:08:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:07:56.688+0000 7fd7a0c00700 1 -- 172.21.15.137:0/3484904685 wait complete. 2024-04-25T02:08:03.671 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:03 smithi137 ceph-mon[28303]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 -- 172.21.15.137:0/243940939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 msgr2=0x7fc958106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 --2- 172.21.15.137:0/243940939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc958106e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc944009990 tx=0x7fc944009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 -- 172.21.15.137:0/243940939 shutdown_connections 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 --2- 172.21.15.137:0/243940939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 0x7fc95810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 --2- 172.21.15.137:0/243940939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9581024e0 0x7fc9581028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 --2- 172.21.15.137:0/243940939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc958106e90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.663+0000 7fc95d400700 1 -- 172.21.15.137:0/243940939 >> 172.21.15.137:0/243940939 conn(0x7fc958079390 msgr2=0x7fc9580797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.664+0000 7fc95d400700 1 -- 172.21.15.137:0/243940939 shutdown_connections 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.664+0000 7fc95d400700 1 -- 172.21.15.137:0/243940939 wait complete. 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 Processor -- start 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 -- start start 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9581024e0 0x7fc95819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc95819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 0x7fc958198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc958112670 con 0x7fc9581024e0 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9581124f0 con 0x7fc958107570 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.665+0000 7fc95d400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9581127f0 con 0x7fc958102e90 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc956800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9581024e0 0x7fc95819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc957200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 0x7fc958198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc95819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc957200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 0x7fc958198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43456/0 (socket says 172.21.15.137:43456) 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc957200700 1 -- 172.21.15.137:0/2643937716 learned_addr learned my addr 172.21.15.137:0/2643937716 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 -- 172.21.15.137:0/2643937716 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 msgr2=0x7fc958198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc958107570 0x7fc958198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 -- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9581024e0 msgr2=0x7fc95819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9581024e0 0x7fc95819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.666+0000 7fc955e00700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc958199070 con 0x7fc958102e90 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc955e00700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc95819ec40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9440059d0 tx=0x7fc944005590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944027070 con 0x7fc958102e90 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9440056c0 con 0x7fc958102e90 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc958199300 con 0x7fc958102e90 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440173f0 con 0x7fc958102e90 2024-04-25T02:08:03.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.667+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9581a55d0 con 0x7fc958102e90 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.668+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9580629c0 con 0x7fc958102e90 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.670+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc94402a070 con 0x7fc958102e90 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc94f400700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc93c0a2cb0 0x7fc93c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc9440d05d0 con 0x7fc958102e90 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc956800700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc93c0a2cb0 0x7fc93c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc94f400700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] conn(0x7fc93c0ac7f0 0x7fc93c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc93c0af360 con 0x7fc93c0ac7f0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.672+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc9440d0980 con 0x7fc958102e90 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.673+0000 7fc957200700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] conn(0x7fc93c0ac7f0 0x7fc93c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.673+0000 7fc956800700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc93c0a2cb0 0x7fc93c0a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc958107110 tx=0x7fc948009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.673+0000 7fc957200700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] conn(0x7fc93c0ac7f0 0x7fc93c0aec90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.674+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== osd.0 v2:172.21.15.137:6802/3540238189 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc93c0af360 con 0x7fc93c0ac7f0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.693+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 --> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc958062e40 con 0x7fc93c0ac7f0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.694+0000 7fc94f400700 1 -- 172.21.15.137:0/2643937716 <== osd.0 v2:172.21.15.137:6802/3540238189 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc958062e40 con 0x7fc93c0ac7f0 2024-04-25T02:08:03.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.694+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] conn(0x7fc93c0ac7f0 msgr2=0x7fc93c0aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.694+0000 7fc95d400700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] conn(0x7fc93c0ac7f0 0x7fc93c0aec90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc93c0a2cb0 msgr2=0x7fc93c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc93c0a2cb0 0x7fc93c0a5170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc958107110 tx=0x7fc948009260 comp rx=0 tx=0).stop 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 msgr2=0x7fc95819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 --2- 172.21.15.137:0/2643937716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc958102e90 0x7fc95819ec40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc9440059d0 tx=0x7fc944005590 comp rx=0 tx=0).stop 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc957200700 1 -- 172.21.15.137:0/2643937716 reap_dead start 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 shutdown_connections 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 >> 172.21.15.137:0/2643937716 conn(0x7fc958079390 msgr2=0x7fc9581002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 shutdown_connections 2024-04-25T02:08:03.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:03.695+0000 7fc95d400700 1 -- 172.21.15.137:0/2643937716 wait complete. 2024-04-25T02:08:03.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:03 smithi163 ceph-mon[32577]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:03.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:03 smithi174 ceph-mon[33171]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:04.659 INFO:teuthology.orchestra.run.smithi137.stdout:197568495666 2024-04-25T02:08:04.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 -- 172.21.15.137:0/1910174122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806a7d0 msgr2=0x7fe05806ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 --2- 172.21.15.137:0/1910174122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806a7d0 0x7fe05806ac30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe048009990 tx=0x7fe048009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 -- 172.21.15.137:0/1910174122 shutdown_connections 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 --2- 172.21.15.137:0/1910174122 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe05806b170 0x7fe05810f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 --2- 172.21.15.137:0/1910174122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0581082a0 0x7fe058108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 --2- 172.21.15.137:0/1910174122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806a7d0 0x7fe05806ac30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 -- 172.21.15.137:0/1910174122 >> 172.21.15.137:0/1910174122 conn(0x7fe0580780a0 msgr2=0x7fe0580784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 -- 172.21.15.137:0/1910174122 shutdown_connections 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.901+0000 7fe060800700 1 -- 172.21.15.137:0/1910174122 wait complete. 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.902+0000 7fe060800700 1 Processor -- start 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.902+0000 7fe060800700 1 -- start start 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe05806a7d0 0x7fe05810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 0x7fe05810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0581082a0 0x7fe05819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe058112670 con 0x7fe0581082a0 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581124f0 con 0x7fe05806b170 2024-04-25T02:08:05.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe060800700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581127f0 con 0x7fe05806a7d0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe05d400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 0x7fe05810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe05d400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 0x7fe05810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43474/0 (socket says 172.21.15.137:43474) 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe05d400700 1 -- 172.21.15.137:0/1316810037 learned_addr learned my addr 172.21.15.137:0/1316810037 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.903+0000 7fe05de00700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe05806a7d0 0x7fe05810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 -- 172.21.15.137:0/1316810037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe05806a7d0 msgr2=0x7fe05810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe05806a7d0 0x7fe05810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 -- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0581082a0 msgr2=0x7fe05819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0581082a0 0x7fe05819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05819b690 con 0x7fe05806b170 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe05d400700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 0x7fe05810d5c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe048005910 tx=0x7fe0480047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048027070 con 0x7fe05806b170 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05819b920 con 0x7fe05806b170 2024-04-25T02:08:05.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe04800b6c0 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.904+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048017650 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.905+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05819be50 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.906+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe058102590 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.908+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe04802a070 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.909+0000 7fe052a00700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0400a2d30 0x7fe0400a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.909+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe0480d0790 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe05de00700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0400a2d30 0x7fe0400a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe052a00700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] conn(0x7fe0400ac870 0x7fe0400aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0400af3e0 con 0x7fe0400ac870 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe0480d0b40 con 0x7fe05806b170 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe05e800700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] conn(0x7fe0400ac870 0x7fe0400aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.910+0000 7fe05de00700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0400a2d30 0x7fe0400a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009680 tx=0x7fe04c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.911+0000 7fe05e800700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] conn(0x7fe0400ac870 0x7fe0400aed10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.912+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== osd.1 v2:172.21.15.163:6800/1976154605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0400af3e0 con 0x7fe0400ac870 2024-04-25T02:08:05.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.931+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 --> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe058103950 con 0x7fe0400ac870 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.932+0000 7fe052a00700 1 -- 172.21.15.137:0/1316810037 <== osd.1 v2:172.21.15.163:6800/1976154605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe058103950 con 0x7fe0400ac870 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] conn(0x7fe0400ac870 msgr2=0x7fe0400aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] conn(0x7fe0400ac870 0x7fe0400aed10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0400a2d30 msgr2=0x7fe0400a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe0400a2d30 0x7fe0400a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009680 tx=0x7fe04c009260 comp rx=0 tx=0).stop 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 msgr2=0x7fe05810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 --2- 172.21.15.137:0/1316810037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe05806b170 0x7fe05810d5c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe048005910 tx=0x7fe0480047b0 comp rx=0 tx=0).stop 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe05e800700 1 -- 172.21.15.137:0/1316810037 reap_dead start 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 shutdown_connections 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 >> 172.21.15.137:0/1316810037 conn(0x7fe0580780a0 msgr2=0x7fe058101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 shutdown_connections 2024-04-25T02:08:05.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:04.933+0000 7fe060800700 1 -- 172.21.15.137:0/1316810037 wait complete. 2024-04-25T02:08:05.759 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:05 smithi137 ceph-mon[28303]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:05 smithi163 ceph-mon[32577]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:05.927 INFO:teuthology.orchestra.run.smithi137.stdout:163208757304 2024-04-25T02:08:05.927 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T02:08:05.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:05 smithi174 ceph-mon[33171]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:07.208 INFO:teuthology.orchestra.run.smithi137.stdout:34359738453 2024-04-25T02:08:07.208 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T02:08:07.732 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:07 smithi137 ceph-mon[28303]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:07.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 -- 172.21.15.137:0/710922638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 msgr2=0x7f5f1c108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 --2- 172.21.15.137:0/710922638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c108690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009990 tx=0x7f5f0c009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 -- 172.21.15.137:0/710922638 shutdown_connections 2024-04-25T02:08:07.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 --2- 172.21.15.137:0/710922638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c06a8e0 0x7f5f1c10f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 --2- 172.21.15.137:0/710922638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c108690 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 --2- 172.21.15.137:0/710922638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 0x7f5f1c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 -- 172.21.15.137:0/710922638 >> 172.21.15.137:0/710922638 conn(0x7f5f1c0780e0 msgr2=0x7f5f1c0784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 -- 172.21.15.137:0/710922638 shutdown_connections 2024-04-25T02:08:07.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.788+0000 7f5f22800700 1 -- 172.21.15.137:0/710922638 wait complete. 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.789+0000 7f5f22800700 1 Processor -- start 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 -- start start 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 0x7f5f1c101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c06a8e0 0x7f5f1c101740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c101c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c1126a0 con 0x7f5f1c1082b0 2024-04-25T02:08:07.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c112520 con 0x7f5f1c069f40 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f22800700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c112820 con 0x7f5f1c06a8e0 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f1be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c101c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f1b400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 0x7f5f1c101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f1aa00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c06a8e0 0x7f5f1c101740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f1be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c101c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53312/0 (socket says 172.21.15.137:53312) 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.790+0000 7f5f1be00700 1 -- 172.21.15.137:0/2570957664 learned_addr learned my addr 172.21.15.137:0/2570957664 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 -- 172.21.15.137:0/2570957664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c06a8e0 msgr2=0x7f5f1c101740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f1c06a8e0 0x7f5f1c101740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 -- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 msgr2=0x7f5f1c101c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f1c1082b0 0x7f5f1c101c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c1a7060 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f1b400700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 0x7f5f1c101200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098e0 tx=0x7f5f0c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c027070 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.791+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c1a72f0 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.792+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f0c00fd30 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.792+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1c1a77a0 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.792+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0173f0 con 0x7f5f1c069f40 2024-04-25T02:08:07.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.793+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f1c062940 con 0x7f5f1c069f40 2024-04-25T02:08:07.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.795+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5f0c02a070 con 0x7f5f1c069f40 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.796+0000 7f5f13e00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5f000a2cb0 0x7f5f000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.796+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f5f0c0d0390 con 0x7f5f1c069f40 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.796+0000 7f5f1aa00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5f000a2cb0 0x7f5f000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.797+0000 7f5f13e00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] conn(0x7f5f000ac7f0 0x7f5f000aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.797+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f0c00eea0 con 0x7f5f000ac7f0 2024-04-25T02:08:07.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.797+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f5f0c0d0740 con 0x7f5f1c069f40 2024-04-25T02:08:07.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.797+0000 7f5f1be00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] conn(0x7f5f000ac7f0 0x7f5f000aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:07.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.797+0000 7f5f1aa00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5f000a2cb0 0x7f5f000a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009680 tx=0x7f5f08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.798+0000 7f5f1be00700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] conn(0x7f5f000ac7f0 0x7f5f000aec90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:07.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.799+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== osd.9 v2:172.21.15.137:6826/2280455179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f0c00eea0 con 0x7f5f000ac7f0 2024-04-25T02:08:07.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.816+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 --> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f1c062dc0 con 0x7f5f000ac7f0 2024-04-25T02:08:07.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.817+0000 7f5f13e00700 1 -- 172.21.15.137:0/2570957664 <== osd.9 v2:172.21.15.137:6826/2280455179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5f1c062dc0 con 0x7f5f000ac7f0 2024-04-25T02:08:07.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.817+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] conn(0x7f5f000ac7f0 msgr2=0x7f5f000aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.817+0000 7f5f22800700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] conn(0x7f5f000ac7f0 0x7f5f000aec90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:07.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5f000a2cb0 msgr2=0x7f5f000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f5f000a2cb0 0x7f5f000a5170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009680 tx=0x7f5f08009260 comp rx=0 tx=0).stop 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 msgr2=0x7f5f1c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 --2- 172.21.15.137:0/2570957664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f1c069f40 0x7f5f1c101200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098e0 tx=0x7f5f0c00b840 comp rx=0 tx=0).stop 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f1be00700 1 -- 172.21.15.137:0/2570957664 reap_dead start 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 shutdown_connections 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 >> 172.21.15.137:0/2570957664 conn(0x7f5f1c0780e0 msgr2=0x7f5f1c0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 shutdown_connections 2024-04-25T02:08:07.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:07.818+0000 7f5f22800700 1 -- 172.21.15.137:0/2570957664 wait complete. 2024-04-25T02:08:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:07 smithi163 ceph-mon[32577]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:07 smithi174 ceph-mon[33171]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:08:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 -- 172.21.15.137:0/4220730187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff8074460 msgr2=0x7f6ff8074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 --2- 172.21.15.137:0/4220730187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff8074460 0x7f6ff8074840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009990 tx=0x7f6fe8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 -- 172.21.15.137:0/4220730187 shutdown_connections 2024-04-25T02:08:09.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 --2- 172.21.15.137:0/4220730187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff8074460 0x7f6ff8074840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 --2- 172.21.15.137:0/4220730187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff810ec30 0x7f6ff8111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 --2- 172.21.15.137:0/4220730187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 0x7f6ff810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 -- 172.21.15.137:0/4220730187 >> 172.21.15.137:0/4220730187 conn(0x7f6ff8079390 msgr2=0x7f6ff80797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 -- 172.21.15.137:0/4220730187 shutdown_connections 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.593+0000 7f6fff000700 1 -- 172.21.15.137:0/4220730187 wait complete. 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.594+0000 7f6fff000700 1 Processor -- start 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 -- start start 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 0x7f6ff81a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 0x7f6ff81a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff810ec30 0x7f6ff819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff8114870 con 0x7f6ff8074460 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81146f0 con 0x7f6ff810ec30 2024-04-25T02:08:09.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6fff000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff81149f0 con 0x7f6ff8074d80 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6ff7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 0x7f6ff81a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6ff7e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 0x7f6ff81a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53354/0 (socket says 172.21.15.137:53354) 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.595+0000 7f6ff7e00700 1 -- 172.21.15.137:0/3772597682 learned_addr learned my addr 172.21.15.137:0/3772597682 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7400700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 0x7f6ff81a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ffd000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff810ec30 0x7f6ff819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 -- 172.21.15.137:0/3772597682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 msgr2=0x7f6ff81a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 0x7f6ff81a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 -- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff810ec30 msgr2=0x7f6ff819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff810ec30 0x7f6ff819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff819b1d0 con 0x7f6ff8074460 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7400700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ff8074d80 0x7f6ff81a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.596+0000 7f6ff7e00700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 0x7f6ff81a0860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80095b0 tx=0x7f6fe8005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.597+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8026070 con 0x7f6ff8074460 2024-04-25T02:08:09.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.597+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff819b460 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.597+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fe800fe30 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.597+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe80173f0 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.597+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81a7730 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.598+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ff80ffd60 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.600+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6fe8029070 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.601+0000 7f6ff4c00700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6fdc0a2cb0 0x7f6fdc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f6fe80d0050 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff7400700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6fdc0a2cb0 0x7f6fdc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff4c00700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] conn(0x7f6fdc0ac6c0 0x7f6fdc0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fdc0af230 con 0x7f6fdc0ac6c0 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f6fe80d0400 con 0x7f6ff8074460 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ffd000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] conn(0x7f6fdc0ac6c0 0x7f6fdc0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.602+0000 7f6ff7400700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6fdc0a2cb0 0x7f6fdc0a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8110710 tx=0x7f6fe4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.603+0000 7f6ffd000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] conn(0x7f6fdc0ac6c0 0x7f6fdc0aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.604+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== osd.4 v2:172.21.15.163:6808/2824580331 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fdc0af230 con 0x7f6fdc0ac6c0 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.621+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 --> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ff8075b50 con 0x7f6fdc0ac6c0 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6ff4c00700 1 -- 172.21.15.137:0/3772597682 <== osd.4 v2:172.21.15.163:6808/2824580331 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ff8075b50 con 0x7f6fdc0ac6c0 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] conn(0x7f6fdc0ac6c0 msgr2=0x7f6fdc0aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] conn(0x7f6fdc0ac6c0 0x7f6fdc0aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6fdc0a2cb0 msgr2=0x7f6fdc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6fdc0a2cb0 0x7f6fdc0a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8110710 tx=0x7f6fe4009260 comp rx=0 tx=0).stop 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 msgr2=0x7f6ff81a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6fff000700 1 --2- 172.21.15.137:0/3772597682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ff8074460 0x7f6ff81a0860 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80095b0 tx=0x7f6fe8005590 comp rx=0 tx=0).stop 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.622+0000 7f6ffd000700 1 -- 172.21.15.137:0/3772597682 reap_dead start 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.623+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 shutdown_connections 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.623+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 >> 172.21.15.137:0/3772597682 conn(0x7f6ff8079390 msgr2=0x7f6ff80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.623+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 shutdown_connections 2024-04-25T02:08:09.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.623+0000 7f6fff000700 1 -- 172.21.15.137:0/3772597682 wait complete. 2024-04-25T02:08:09.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:09 smithi137 ceph-mon[28303]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:09 smithi163 ceph-mon[32577]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:09.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:09 smithi174 ceph-mon[33171]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-25T02:08:10.027 INFO:teuthology.orchestra.run.smithi137.stdout:77309411400 2024-04-25T02:08:10.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T02:08:10.194 INFO:teuthology.orchestra.run.smithi137.stdout:309237645339 2024-04-25T02:08:10.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-25T02:08:10.721 INFO:teuthology.orchestra.run.smithi137.stdout:141733920831 2024-04-25T02:08:10.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 -- 172.21.15.137:0/2280977561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 msgr2=0x7fb7781048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 --2- 172.21.15.137:0/2280977561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb7781048d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7640098f0 tx=0x7fb764009c00 comp rx=0 tx=0).stop 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 -- 172.21.15.137:0/2280977561 shutdown_connections 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 --2- 172.21.15.137:0/2280977561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb778104e10 0x7fb778111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 --2- 172.21.15.137:0/2280977561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb77810a4e0 0x7fb77810a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 --2- 172.21.15.137:0/2280977561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb7781048d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 -- 172.21.15.137:0/2280977561 >> 172.21.15.137:0/2280977561 conn(0x7fb7780fff60 msgr2=0x7fb778102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 -- 172.21.15.137:0/2280977561 shutdown_connections 2024-04-25T02:08:10.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.474+0000 7fb77d200700 1 -- 172.21.15.137:0/2280977561 wait complete. 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.475+0000 7fb77d200700 1 Processor -- start 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.475+0000 7fb77d200700 1 -- start start 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb77819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb778104e10 0x7fb77819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77810a4e0 0x7fb77819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781148b0 con 0x7fb778104e10 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb778114730 con 0x7fb77810a4e0 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb77d200700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb778114a30 con 0x7fb778104450 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb77819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb778104e10 0x7fb77819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb77819ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34674/0 (socket says 172.21.15.137:34674) 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 -- 172.21.15.137:0/1261405088 learned_addr learned my addr 172.21.15.137:0/1261405088 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:10.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb776800700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77810a4e0 0x7fb77819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 -- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77810a4e0 msgr2=0x7fb77819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77810a4e0 0x7fb77819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 -- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb778104e10 msgr2=0x7fb77819b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb778104e10 0x7fb77819b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.476+0000 7fb775e00700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77819fd90 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb775e00700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb77819ad80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ec10 tx=0x7fb76800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76800cc90 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb768004520 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768010690 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7781a0080 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.477+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7781a7900 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.478+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb778062940 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.481+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb768003ee0 con 0x7fb778104450 2024-04-25T02:08:10.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.483+0000 7fb76ea00700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb75c0a2d30 0x7fb75c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.483+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fb7680cf700 con 0x7fb778104450 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb775400700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb75c0a2d30 0x7fb75c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb76ea00700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] conn(0x7fb75c0ac870 0x7fb75c0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb76800be50 con 0x7fb75c0ac870 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fb7680cfab0 con 0x7fb778104450 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb776800700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] conn(0x7fb75c0ac870 0x7fb75c0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.484+0000 7fb775400700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb75c0a2d30 0x7fb75c0a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7640098c0 tx=0x7fb764019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.485+0000 7fb776800700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] conn(0x7fb75c0ac870 0x7fb75c0aed10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.486+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== osd.7 v2:172.21.15.163:6816/1494568625 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb76800be50 con 0x7fb75c0ac870 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.503+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 --> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb778062e10 con 0x7fb75c0ac870 2024-04-25T02:08:10.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.504+0000 7fb76ea00700 1 -- 172.21.15.137:0/1261405088 <== osd.7 v2:172.21.15.163:6816/1494568625 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb778062e10 con 0x7fb75c0ac870 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] conn(0x7fb75c0ac870 msgr2=0x7fb75c0aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] conn(0x7fb75c0ac870 0x7fb75c0aed10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb75c0a2d30 msgr2=0x7fb75c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb75c0a2d30 0x7fb75c0a51f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb7640098c0 tx=0x7fb764019040 comp rx=0 tx=0).stop 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 msgr2=0x7fb77819ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 --2- 172.21.15.137:0/1261405088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb778104450 0x7fb77819ad80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ec10 tx=0x7fb76800ef20 comp rx=0 tx=0).stop 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb776800700 1 -- 172.21.15.137:0/1261405088 reap_dead start 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 shutdown_connections 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 >> 172.21.15.137:0/1261405088 conn(0x7fb7780fff60 msgr2=0x7fb778100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 shutdown_connections 2024-04-25T02:08:10.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:09.505+0000 7fb77d200700 1 -- 172.21.15.137:0/1261405088 wait complete. 2024-04-25T02:08:11.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:11 smithi137 ceph-mon[28303]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:11.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:11 smithi163 ceph-mon[32577]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:11.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:11 smithi174 ceph-mon[33171]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:11.963 INFO:teuthology.orchestra.run.smithi137.stdout:55834574927 2024-04-25T02:08:11.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T02:08:12.238 INFO:teuthology.orchestra.run.smithi137.stdout:287762808866 2024-04-25T02:08:12.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-25T02:08:12.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.907+0000 7fc53aa00700 1 -- 172.21.15.137:0/1123433186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534102540 msgr2=0x7fc534102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.907+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1123433186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534102540 0x7fc534102920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc524009990 tx=0x7fc524009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 -- 172.21.15.137:0/1123433186 shutdown_connections 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1123433186 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5341075a0 0x7fc53410f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1123433186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc534102540 0x7fc534102920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1123433186 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 0x7fc534106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 -- 172.21.15.137:0/1123433186 >> 172.21.15.137:0/1123433186 conn(0x7fc5340792c0 msgr2=0x7fc5340796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 -- 172.21.15.137:0/1123433186 shutdown_connections 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.908+0000 7fc53aa00700 1 -- 172.21.15.137:0/1123433186 wait complete. 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 Processor -- start 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 -- start start 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 0x7fc53419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 0x7fc53419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 0x7fc53419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5341126e0 con 0x7fc5341075a0 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc534112560 con 0x7fc534102540 2024-04-25T02:08:12.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.909+0000 7fc53aa00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc534112860 con 0x7fc534102ef0 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc538a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 0x7fc53419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 0x7fc53419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 0x7fc53419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43984/0 (socket says 172.21.15.137:43984) 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533e00700 1 -- 172.21.15.137:0/1001602265 learned_addr learned my addr 172.21.15.137:0/1001602265 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc538a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 0x7fc53419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39686/0 (socket says 172.21.15.137:39686) 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 0x7fc53419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 -- 172.21.15.137:0/1001602265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 msgr2=0x7fc53419ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 0x7fc53419ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 -- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 msgr2=0x7fc53419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 0x7fc53419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533400700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53419fd20 con 0x7fc534102ef0 2024-04-25T02:08:12.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc538a00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5341075a0 0x7fc53419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.910+0000 7fc533e00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc534102540 0x7fc53419ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc533400700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 0x7fc53419b250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc52000e9c0 tx=0x7fc52000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520004220 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc520004d30 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5341a0010 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520005040 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.911+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5341a7890 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.912+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5340757c0 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.915+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc520004750 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.916+0000 7fc530c00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc5180a2cb0 0x7fc5180a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.916+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc5200cf450 con 0x7fc534102ef0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.916+0000 7fc533e00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc5180a2cb0 0x7fc5180a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.916+0000 7fc530c00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] conn(0x7fc5180ac7f0 0x7fc5180aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:12.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.917+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc520019e50 con 0x7fc5180ac7f0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.917+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc5200cf800 con 0x7fc534102ef0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.917+0000 7fc538a00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] conn(0x7fc5180ac7f0 0x7fc5180aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.917+0000 7fc533e00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc5180a2cb0 0x7fc5180a5170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc524006010 tx=0x7fc524009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.917+0000 7fc538a00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] conn(0x7fc5180ac7f0 0x7fc5180aec90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.918+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== osd.11 v2:172.21.15.174:6824/2420568301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc520019e50 con 0x7fc5180ac7f0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.936+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 --> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5341039a0 con 0x7fc5180ac7f0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.937+0000 7fc530c00700 1 -- 172.21.15.137:0/1001602265 <== osd.11 v2:172.21.15.174:6824/2420568301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc5341039a0 con 0x7fc5180ac7f0 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.937+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] conn(0x7fc5180ac7f0 msgr2=0x7fc5180aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.937+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] conn(0x7fc5180ac7f0 0x7fc5180aec90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc5180a2cb0 msgr2=0x7fc5180a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc5180a2cb0 0x7fc5180a5170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc524006010 tx=0x7fc524009590 comp rx=0 tx=0).stop 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 msgr2=0x7fc53419b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 --2- 172.21.15.137:0/1001602265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc534102ef0 0x7fc53419b250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc52000e9c0 tx=0x7fc52000ecd0 comp rx=0 tx=0).stop 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc538a00700 1 -- 172.21.15.137:0/1001602265 reap_dead start 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 shutdown_connections 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 >> 172.21.15.137:0/1001602265 conn(0x7fc5340792c0 msgr2=0x7fc534100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 shutdown_connections 2024-04-25T02:08:12.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:12.938+0000 7fc53aa00700 1 -- 172.21.15.137:0/1001602265 wait complete. 2024-04-25T02:08:13.520 INFO:teuthology.orchestra.run.smithi137.stdout:219043332142 2024-04-25T02:08:13.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-25T02:08:13.584 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:13 smithi137 ceph-mon[28303]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 -- 172.21.15.137:0/1462101357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f713006a8e0 msgr2=0x7f713010f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 --2- 172.21.15.137:0/1462101357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f713006a8e0 0x7f713010f0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f712800b0a0 tx=0x7f712800b3b0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 -- 172.21.15.137:0/1462101357 shutdown_connections 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 --2- 172.21.15.137:0/1462101357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f713006a8e0 0x7f713010f0f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 --2- 172.21.15.137:0/1462101357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71301082b0 0x7f7130108690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 --2- 172.21.15.137:0/1462101357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7130069f40 0x7f713006a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 -- 172.21.15.137:0/1462101357 >> 172.21.15.137:0/1462101357 conn(0x7f71300780e0 msgr2=0x7f71300784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 -- 172.21.15.137:0/1462101357 shutdown_connections 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.014+0000 7f7136400700 1 -- 172.21.15.137:0/1462101357 wait complete. 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.015+0000 7f7136400700 1 Processor -- start 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 -- start start 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130069f40 0x7f713019e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f713006a8e0 0x7f713019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:13.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 0x7f7130198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7130112690 con 0x7f71301082b0 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7130112510 con 0x7f713006a8e0 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.016+0000 7f7136400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7130112810 con 0x7f7130069f40 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 0x7f7130198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 0x7f7130198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39704/0 (socket says 172.21.15.137:39704) 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 -- 172.21.15.137:0/1392735586 learned_addr learned my addr 172.21.15.137:0/1392735586 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712f400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130069f40 0x7f713019e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:13.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f7126a00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f713006a8e0 0x7f713019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 -- 172.21.15.137:0/1392735586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130069f40 msgr2=0x7f713019e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7130069f40 0x7f713019e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 -- 172.21.15.137:0/1392735586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f713006a8e0 msgr2=0x7f713019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f713006a8e0 0x7f713019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71301990b0 con 0x7f71301082b0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f7126a00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f713006a8e0 0x7f713019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712fe00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 0x7f7130198950 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7128004c80 tx=0x7f7128004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.017+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128021070 con 0x7f71301082b0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.018+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7128007b80 con 0x7f71301082b0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.018+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7130199340 con 0x7f71301082b0 2024-04-25T02:08:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.018+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128005280 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.018+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71301a5660 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.019+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7130062900 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.022+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7128024070 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712cc00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f71140a2d30 0x7f71140a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f712800f020 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712f400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f71140a2d30 0x7f71140a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712cc00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] conn(0x7f71140ac870 0x7f71140aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71140af3e0 con 0x7f71140ac870 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.024+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f71280d0b90 con 0x7f71301082b0 2024-04-25T02:08:13.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.025+0000 7f7126a00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] conn(0x7f71140ac870 0x7f71140aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.025+0000 7f712f400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f71140a2d30 0x7f71140a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7120009680 tx=0x7f7120009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.025+0000 7f7126a00700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] conn(0x7f71140ac870 0x7f71140aed10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.026+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== osd.3 v2:172.21.15.137:6810/2967583331 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71140af3e0 con 0x7f71140ac870 2024-04-25T02:08:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.044+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 --> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7130062d00 con 0x7f71140ac870 2024-04-25T02:08:13.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.044+0000 7f712cc00700 1 -- 172.21.15.137:0/1392735586 <== osd.3 v2:172.21.15.137:6810/2967583331 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7130062d00 con 0x7f71140ac870 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] conn(0x7f71140ac870 msgr2=0x7f71140aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] conn(0x7f71140ac870 0x7f71140aed10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f71140a2d30 msgr2=0x7f71140a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f71140a2d30 0x7f71140a51f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7120009680 tx=0x7f7120009260 comp rx=0 tx=0).stop 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 msgr2=0x7f7130198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 --2- 172.21.15.137:0/1392735586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71301082b0 0x7f7130198950 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7128004c80 tx=0x7f7128004cb0 comp rx=0 tx=0).stop 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f712fe00700 1 -- 172.21.15.137:0/1392735586 reap_dead start 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 shutdown_connections 2024-04-25T02:08:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 >> 172.21.15.137:0/1392735586 conn(0x7f71300780e0 msgr2=0x7f71300ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:13.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 shutdown_connections 2024-04-25T02:08:13.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:13.045+0000 7f7136400700 1 -- 172.21.15.137:0/1392735586 wait complete. 2024-04-25T02:08:13.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:13 smithi163 ceph-mon[32577]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:13.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:13 smithi174 ceph-mon[33171]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:14.352 INFO:teuthology.orchestra.run.smithi137.stdout:107374182468 2024-04-25T02:08:14.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T02:08:14.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.585+0000 7f11efa00700 1 -- 172.21.15.137:0/2748620566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 msgr2=0x7f11e81028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.585+0000 7f11efa00700 1 --2- 172.21.15.137:0/2748620566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e81028c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009990 tx=0x7f11dc009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 -- 172.21.15.137:0/2748620566 shutdown_connections 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 --2- 172.21.15.137:0/2748620566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 0x7f11e810f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 --2- 172.21.15.137:0/2748620566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e81028c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 --2- 172.21.15.137:0/2748620566 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 0x7f11e8106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 -- 172.21.15.137:0/2748620566 >> 172.21.15.137:0/2748620566 conn(0x7f11e8079390 msgr2=0x7f11e80797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 -- 172.21.15.137:0/2748620566 shutdown_connections 2024-04-25T02:08:14.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.586+0000 7f11efa00700 1 -- 172.21.15.137:0/2748620566 wait complete. 2024-04-25T02:08:14.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.588+0000 7f11efa00700 1 Processor -- start 2024-04-25T02:08:14.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.588+0000 7f11efa00700 1 -- start start 2024-04-25T02:08:14.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e8076120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 0x7f11e8074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 0x7f11e8074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112700 con 0x7f11e81024e0 2024-04-25T02:08:14.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112580 con 0x7f11e8107570 2024-04-25T02:08:14.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11efa00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112880 con 0x7f11e8102e90 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.589+0000 7f11ed000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e8076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e8076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39726/0 (socket says 172.21.15.137:39726) 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 -- 172.21.15.137:0/3883233206 learned_addr learned my addr 172.21.15.137:0/3883233206 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11eda00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 0x7f11e8074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11e7e00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 0x7f11e8074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 -- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 msgr2=0x7f11e8074530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 0x7f11e8074530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 -- 172.21.15.137:0/3883233206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 msgr2=0x7f11e8074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 0x7f11e8074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11ed000700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e81ab4e0 con 0x7f11e81024e0 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11eda00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e8107570 0x7f11e8074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.590+0000 7f11e7e00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11e8102e90 0x7f11e8074530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:14.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.591+0000 7f11ed000700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e8076120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.591+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc038070 con 0x7f11e81024e0 2024-04-25T02:08:14.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.592+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11dc00be70 con 0x7f11e81024e0 2024-04-25T02:08:14.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.592+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc017650 con 0x7f11e81024e0 2024-04-25T02:08:14.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.592+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e806bc50 con 0x7f11e81024e0 2024-04-25T02:08:14.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.593+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e806c0e0 con 0x7f11e81024e0 2024-04-25T02:08:14.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.594+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11e8062940 con 0x7f11e81024e0 2024-04-25T02:08:14.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.597+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f11dc009d10 con 0x7f11e81024e0 2024-04-25T02:08:14.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.600+0000 7f11e5600700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f11d00a2d30 0x7f11d00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.600+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f11dc0e1180 con 0x7f11e81024e0 2024-04-25T02:08:14.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.601+0000 7f11e5600700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] conn(0x7f11d00ac870 0x7f11d00aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:14.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.601+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11d00af3e0 con 0x7f11d00ac870 2024-04-25T02:08:14.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.601+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f11dc0e1530 con 0x7f11e81024e0 2024-04-25T02:08:14.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.601+0000 7f11eda00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] conn(0x7f11d00ac870 0x7f11d00aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.602+0000 7f11eda00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] conn(0x7f11d00ac870 0x7f11d00aed10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.603+0000 7f11e7e00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f11d00a2d30 0x7f11d00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:14.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.603+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== osd.8 v2:172.21.15.174:6816/2804246192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11d00af3e0 con 0x7f11d00ac870 2024-04-25T02:08:14.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.605+0000 7f11e7e00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f11d00a2d30 0x7f11d00a51f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11e8075ca0 tx=0x7f11d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:14.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.640+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 --> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11e8062dc0 con 0x7f11d00ac870 2024-04-25T02:08:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.641+0000 7f11e5600700 1 -- 172.21.15.137:0/3883233206 <== osd.8 v2:172.21.15.174:6816/2804246192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f11e8062dc0 con 0x7f11d00ac870 2024-04-25T02:08:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.641+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] conn(0x7f11d00ac870 msgr2=0x7f11d00aed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.641+0000 7f11efa00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] conn(0x7f11d00ac870 0x7f11d00aed10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f11d00a2d30 msgr2=0x7f11d00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f11d00a2d30 0x7f11d00a51f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11e8075ca0 tx=0x7f11d400b410 comp rx=0 tx=0).stop 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 msgr2=0x7f11e8076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 --2- 172.21.15.137:0/3883233206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f11e81024e0 0x7f11e8076120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc0057c0 comp rx=0 tx=0).stop 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11eda00700 1 -- 172.21.15.137:0/3883233206 reap_dead start 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 shutdown_connections 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 >> 172.21.15.137:0/3883233206 conn(0x7f11e8079390 msgr2=0x7f11e8100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 shutdown_connections 2024-04-25T02:08:14.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:14.642+0000 7f11efa00700 1 -- 172.21.15.137:0/3883233206 wait complete. 2024-04-25T02:08:15.574 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:15 smithi137 ceph-mon[28303]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:15.578 INFO:teuthology.orchestra.run.smithi137.stdout:343597383706 2024-04-25T02:08:15.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-25T02:08:15.722 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:15.722 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:15.738 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:15.741 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:15.760 INFO:teuthology.orchestra.run.smithi137.stdout:253403070506 2024-04-25T02:08:15.760 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-25T02:08:15.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:15 smithi163 ceph-mon[32577]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:15.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:15 smithi174 ceph-mon[33171]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:16.178 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:17.642 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:17 smithi137 ceph-mon[28303]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:17.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:17 smithi163 ceph-mon[32577]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:17.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:17 smithi174 ceph-mon[33171]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:19.742 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:19 smithi137 ceph-mon[28303]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:19.742 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:19 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:08:19.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:19 smithi163 ceph-mon[32577]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:19.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:19 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:08:19.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:19 smithi174 ceph-mon[33171]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:19.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:19 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:08:20.544 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:20.545 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:20.551 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:20.553 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:21.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.403 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:21 smithi137 ceph-mon[28303]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:21.404 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:21 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:21 smithi163 ceph-mon[32577]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:21.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:21 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:21.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:21 smithi174 ceph-mon[33171]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:21.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:21 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.344+0000 7f7a52e00700 1 -- 172.21.15.137:0/2938018766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074d80 msgr2=0x7f7a4c10e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.344+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2938018766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074d80 0x7f7a4c10e750 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a340098f0 tx=0x7f7a34009c00 comp rx=0 tx=0).stop 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 -- 172.21.15.137:0/2938018766 shutdown_connections 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2938018766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c074460 0x7f7a4c074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2938018766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c10ec90 0x7f7a4c111080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2938018766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074d80 0x7f7a4c10e750 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 -- 172.21.15.137:0/2938018766 >> 172.21.15.137:0/2938018766 conn(0x7f7a4c079390 msgr2=0x7f7a4c0797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 -- 172.21.15.137:0/2938018766 shutdown_connections 2024-04-25T02:08:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.345+0000 7f7a52e00700 1 -- 172.21.15.137:0/2938018766 wait complete. 2024-04-25T02:08:22.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.346+0000 7f7a52e00700 1 Processor -- start 2024-04-25T02:08:22.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.346+0000 7f7a52e00700 1 -- start start 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 0x7f7a4c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c10ec90 0x7f7a4c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c114950 con 0x7f7a4c074460 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c1147d0 con 0x7f7a4c10ec90 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a52e00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c114ad0 con 0x7f7a4c074d80 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a4be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a4be00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55302/0 (socket says 172.21.15.137:55302) 2024-04-25T02:08:22.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a4be00700 1 -- 172.21.15.137:0/2119191392 learned_addr learned my addr 172.21.15.137:0/2119191392 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a43e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 0x7f7a4c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.347+0000 7f7a50e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c10ec90 0x7f7a4c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 -- 172.21.15.137:0/2119191392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c10ec90 msgr2=0x7f7a4c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c10ec90 0x7f7a4c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 -- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 msgr2=0x7f7a4c19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 -- 172.21.15.137:0/2119191392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c19fd60 con 0x7f7a4c074d80 2024-04-25T02:08:22.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a4be00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a43e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 0x7f7a4c19b2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c010 tx=0x7f7a34010f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400f560 con 0x7f7a4c074d80 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c19fff0 con 0x7f7a4c074d80 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a3400b560 con 0x7f7a4c074d80 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.348+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34003a40 con 0x7f7a4c074d80 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.349+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1a78d0 con 0x7f7a4c074d80 2024-04-25T02:08:22.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.350+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c068f20 con 0x7f7a4c074d80 2024-04-25T02:08:22.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.352+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7a3400bac0 con 0x7f7a4c074d80 2024-04-25T02:08:22.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.353+0000 7f7a49600700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 0x7f7a300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:22.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.353+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f7a340cff50 con 0x7f7a4c074d80 2024-04-25T02:08:22.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.353+0000 7f7a4be00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 0x7f7a300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:22.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.354+0000 7f7a4be00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 0x7f7a300a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e60 tx=0x7f7a3c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:22.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.358+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7a34013030 con 0x7f7a4c074d80 2024-04-25T02:08:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.592+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7a4c1a7aa0 con 0x7f7a4c074d80 2024-04-25T02:08:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.593+0000 7f7a49600700 1 -- 172.21.15.137:0/2119191392 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a34021380 con 0x7f7a4c074d80 2024-04-25T02:08:22.600 INFO:teuthology.orchestra.run.smithi137.stdout:34359738457 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 msgr2=0x7f7a300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 0x7f7a300a5170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009e60 tx=0x7f7a3c00b040 comp rx=0 tx=0).stop 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 msgr2=0x7f7a4c19b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 0x7f7a4c19b2e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c010 tx=0x7f7a34010f70 comp rx=0 tx=0).stop 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 shutdown_connections 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7a300a2cb0 0x7f7a300a5170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7a4c10ec90 0x7f7a4c19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4c074460 0x7f7a4c19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 --2- 172.21.15.137:0/2119191392 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a4c074d80 0x7f7a4c19b2e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.596+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 >> 172.21.15.137:0/2119191392 conn(0x7f7a4c079390 msgr2=0x7f7a4c0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.597+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 shutdown_connections 2024-04-25T02:08:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:22.597+0000 7f7a52e00700 1 -- 172.21.15.137:0/2119191392 wait complete. 2024-04-25T02:08:23.593 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:23 smithi137 ceph-mon[28303]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:23.594 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:23 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2119191392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T02:08:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:23 smithi163 ceph-mon[32577]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:23 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2119191392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T02:08:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:23 smithi174 ceph-mon[33171]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:23.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:23 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2119191392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T02:08:24.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:24 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1935689189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T02:08:24.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:24 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1935689189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T02:08:24.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:24 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1935689189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-25T02:08:25.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738457 for osd.0 2024-04-25T02:08:25.649 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:25.727 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:25 smithi137 ceph-mon[28303]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:25.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:25 smithi163 ceph-mon[32577]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:25.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:25 smithi174 ceph-mon[33171]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 -- 172.21.15.137:0/72484114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104e50 msgr2=0x7f7f8c111310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 --2- 172.21.15.137:0/72484114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104e50 0x7f7f8c111310 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009fc0 tx=0x7f7f8400b330 comp rx=0 tx=0).stop 2024-04-25T02:08:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 -- 172.21.15.137:0/72484114 shutdown_connections 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 --2- 172.21.15.137:0/72484114 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104e50 0x7f7f8c111310 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 --2- 172.21.15.137:0/72484114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 0x7f7f8c10a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 --2- 172.21.15.137:0/72484114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104490 0x7f7f8c104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 -- 172.21.15.137:0/72484114 >> 172.21.15.137:0/72484114 conn(0x7f7f8c0fff60 msgr2=0x7f7f8c102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 -- 172.21.15.137:0/72484114 shutdown_connections 2024-04-25T02:08:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.493+0000 7f7f91a00700 1 -- 172.21.15.137:0/72484114 wait complete. 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.494+0000 7f7f91a00700 1 Processor -- start 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 -- start start 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 0x7f7f8c1a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 0x7f7f8c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114910 con 0x7f7f8c104490 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114790 con 0x7f7f8c104e50 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f91a00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114a90 con 0x7f7f8c10a540 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f8aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 0x7f7f8c1a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f8a000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f8a000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58408/0 (socket says 172.21.15.137:58408) 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f8a000700 1 -- 172.21.15.137:0/1935689189 learned_addr learned my addr 172.21.15.137:0/1935689189 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.495+0000 7f7f8b400700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 0x7f7f8c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 -- 172.21.15.137:0/1935689189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 msgr2=0x7f7f8c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 0x7f7f8c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 -- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 msgr2=0x7f7f8c1a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 0x7f7f8c1a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 -- 172.21.15.137:0/1935689189 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c19b1b0 con 0x7f7f8c104e50 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8aa00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 0x7f7f8c1a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f8a000700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800ec10 tx=0x7f7f7800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800cc90 con 0x7f7f8c104e50 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.496+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c19b4a0 con 0x7f7f8c104e50 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.497+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f78004520 con 0x7f7f8c104e50 2024-04-25T02:08:26.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.497+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78010690 con 0x7f7f8c104e50 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.497+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a7710 con 0x7f7f8c104e50 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.498+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c068f20 con 0x7f7f8c104e50 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.500+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7f78003f20 con 0x7f7f8c104e50 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.502+0000 7f7f83400700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 0x7f7f700a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.502+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f7f780cf4b0 con 0x7f7f8c104e50 2024-04-25T02:08:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.502+0000 7f7f8aa00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 0x7f7f700a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.503+0000 7f7f8aa00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 0x7f7f700a51f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c109470 tx=0x7f7f7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.506+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7f7809c2c0 con 0x7f7f8c104e50 2024-04-25T02:08:26.090 INFO:teuthology.orchestra.run.smithi137.stdout:197568495670 2024-04-25T02:08:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.734+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7f8c19bf30 con 0x7f7f8c104e50 2024-04-25T02:08:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.734+0000 7f7f83400700 1 -- 172.21.15.137:0/1935689189 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f8c19bf30 con 0x7f7f8c104e50 2024-04-25T02:08:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 msgr2=0x7f7f700a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 0x7f7f700a51f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c109470 tx=0x7f7f7c009260 comp rx=0 tx=0).stop 2024-04-25T02:08:26.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 msgr2=0x7f7f8c1a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800ec10 tx=0x7f7f7800ef20 comp rx=0 tx=0).stop 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 shutdown_connections 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7f700a2d30 0x7f7f700a51f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f8c10a540 0x7f7f8c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f8c104490 0x7f7f8c1a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 --2- 172.21.15.137:0/1935689189 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7f8c104e50 0x7f7f8c1a0d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 >> 172.21.15.137:0/1935689189 conn(0x7f7f8c0fff60 msgr2=0x7f7f8c1013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 shutdown_connections 2024-04-25T02:08:26.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:23.738+0000 7f7f91a00700 1 -- 172.21.15.137:0/1935689189 wait complete. 2024-04-25T02:08:26.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:26 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3397668224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T02:08:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:26 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3397668224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T02:08:26.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:26 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3397668224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T02:08:27.012 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495666 got 197568495670 for osd.6 2024-04-25T02:08:27.012 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:27.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:27 smithi137 ceph-mon[28303]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:27 smithi163 ceph-mon[32577]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:27 smithi174 ceph-mon[33171]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:28.730 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2437981857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T02:08:28.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:28 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2437981857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T02:08:28.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.147+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2255679781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc102e90 msgr2=0x7fc0bc106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.147+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2255679781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc102e90 0x7fc0bc106ec0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40098f0 tx=0x7fc0a4009c00 comp rx=0 tx=0).stop 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2255679781 shutdown_connections 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2255679781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc10f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2255679781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2255679781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc102e90 0x7fc0bc106ec0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2255679781 >> 172.21.15.137:0/2255679781 conn(0x7fc0bc0793e0 msgr2=0x7fc0bc0797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2255679781 shutdown_connections 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.148+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2255679781 wait complete. 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.149+0000 7fc0c1a00700 1 Processor -- start 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.149+0000 7fc0c1a00700 1 -- start start 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 0x7fc0bc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc1126e0 con 0x7fc0bc102e90 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc112560 con 0x7fc0bc1075a0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0c1a00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc112860 con 0x7fc0bc1024e0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0baa00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0b3e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 0x7fc0bc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0baa00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc19e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45256/0 (socket says 172.21.15.137:45256) 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0baa00700 1 -- 172.21.15.137:0/2437981857 learned_addr learned my addr 172.21.15.137:0/2437981857 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.150+0000 7fc0bb400700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 -- 172.21.15.137:0/2437981857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 msgr2=0x7fc0bc19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 -- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 msgr2=0x7fc0bc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 0x7fc0bc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 -- 172.21.15.137:0/2437981857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc199100 con 0x7fc0bc1075a0 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0b3e00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 0x7fc0bc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:28.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0bb400700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc1989a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400efc0 tx=0x7fc0b400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40092e0 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0b4004bb0 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc199390 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4004280 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.151+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc1a56b0 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.152+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc068f20 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.155+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc0b401b030 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.156+0000 7fc0b3400700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 0x7fc0a00a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.156+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc0b40cef70 con 0x7fc0bc1075a0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.156+0000 7fc0baa00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 0x7fc0a00a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:28.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.157+0000 7fc0baa00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 0x7fc0a00a5270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc199ae0 tx=0x7fc0ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.158+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc0b4022020 con 0x7fc0bc1075a0 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.388+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc0bc02db30 con 0x7fc0bc1075a0 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stdout:77309411406 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.389+0000 7fc0b3400700 1 -- 172.21.15.137:0/2437981857 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0b4010040 con 0x7fc0bc1075a0 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 msgr2=0x7fc0a00a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 0x7fc0a00a5270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc199ae0 tx=0x7fc0ac009260 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 msgr2=0x7fc0bc1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc1989a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400efc0 tx=0x7fc0b400c3a0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 shutdown_connections 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc0a00a2db0 0x7fc0a00a5270 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0bc1075a0 0x7fc0bc1989a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0bc1024e0 0x7fc0bc19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 --2- 172.21.15.137:0/2437981857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0bc102e90 0x7fc0bc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 >> 172.21.15.137:0/2437981857 conn(0x7fc0bc0793e0 msgr2=0x7fc0bc101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 shutdown_connections 2024-04-25T02:08:28.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:28.392+0000 7fc0c1a00700 1 -- 172.21.15.137:0/2437981857 wait complete. 2024-04-25T02:08:28.933 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:28 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2437981857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 -- 172.21.15.137:0/1454824287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1080102d70 msgr2=0x7f1080106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 --2- 172.21.15.137:0/1454824287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1080102d70 0x7f1080106dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f106c009920 tx=0x7f106c009c30 comp rx=0 tx=0).stop 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 -- 172.21.15.137:0/1454824287 shutdown_connections 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 --2- 172.21.15.137:0/1454824287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f10801074a0 0x7f108010f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 --2- 172.21.15.137:0/1454824287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801023c0 0x7f10801027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 --2- 172.21.15.137:0/1454824287 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1080102d70 0x7f1080106dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.122+0000 7f1086400700 1 -- 172.21.15.137:0/1454824287 >> 172.21.15.137:0/1454824287 conn(0x7f10800fdcb0 msgr2=0x7f10801000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.123+0000 7f1086400700 1 -- 172.21.15.137:0/1454824287 shutdown_connections 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.123+0000 7f1086400700 1 -- 172.21.15.137:0/1454824287 wait complete. 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 Processor -- start 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 -- start start 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1080102d70 0x7f108019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801074a0 0x7f108019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1080112610 con 0x7f10801074a0 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1080112490 con 0x7f1080102d70 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1086400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1080112790 con 0x7f10801023c0 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1085000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1085000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45230/0 (socket says 172.21.15.137:45230) 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1085000700 1 -- 172.21.15.137:0/3397668224 learned_addr learned my addr 172.21.15.137:0/3397668224 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f107fe00700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1080102d70 0x7f108019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.124+0000 7f1085a00700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801074a0 0x7f108019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 -- 172.21.15.137:0/3397668224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1080102d70 msgr2=0x7f108019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1080102d70 0x7f108019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 -- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801074a0 msgr2=0x7f108019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801074a0 0x7f108019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 -- 172.21.15.137:0/3397668224 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108019fd70 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1085000700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f107400e9c0 tx=0x7f107400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074004a30 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f107400ccc0 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10801a0060 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.125+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074005660 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.126+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10801a78e0 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.127+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1080068f20 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.129+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1074004d60 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.130+0000 7f107d600700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 0x7f10680a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.130+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f10740cf510 con 0x7f10801023c0 2024-04-25T02:08:29.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.130+0000 7f107fe00700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 0x7f10680a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stdout:163208757309 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.131+0000 7f107fe00700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 0x7f10680a5170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f106c0098f0 tx=0x7f106c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.132+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f1074053740 con 0x7f10801023c0 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.363+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f108019c0c0 con 0x7f10801023c0 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.363+0000 7f107d600700 1 -- 172.21.15.137:0/3397668224 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f107409c2c0 con 0x7f10801023c0 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 msgr2=0x7f10680a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 0x7f10680a5170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f106c0098f0 tx=0x7f106c019040 comp rx=0 tx=0).stop 2024-04-25T02:08:29.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 msgr2=0x7f108019ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f107400e9c0 tx=0x7f107400ecd0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 shutdown_connections 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f10680a2cb0 0x7f10680a5170 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10801074a0 0x7f108019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10801023c0 0x7f108019ad60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 --2- 172.21.15.137:0/3397668224 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1080102d70 0x7f108019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 >> 172.21.15.137:0/3397668224 conn(0x7f10800fdcb0 msgr2=0x7f10800fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 shutdown_connections 2024-04-25T02:08:29.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:26.368+0000 7f1086400700 1 -- 172.21.15.137:0/3397668224 wait complete. 2024-04-25T02:08:29.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:29 smithi137 ceph-mon[28303]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:29.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:29 smithi163 ceph-mon[32577]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:29.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:29 smithi174 ceph-mon[33171]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:30.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 -- 172.21.15.137:0/3314807230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102f00 msgr2=0x7fd46c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 --2- 172.21.15.137:0/3314807230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102f00 0x7fd46c106e60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4540099c0 tx=0x7fd454009cd0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 -- 172.21.15.137:0/3314807230 shutdown_connections 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 --2- 172.21.15.137:0/3314807230 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102550 0x7fd46c102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 --2- 172.21.15.137:0/3314807230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 0x7fd46c10f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 --2- 172.21.15.137:0/3314807230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102f00 0x7fd46c106e60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 -- 172.21.15.137:0/3314807230 >> 172.21.15.137:0/3314807230 conn(0x7fd46c0793f0 msgr2=0x7fd46c079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 -- 172.21.15.137:0/3314807230 shutdown_connections 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.469+0000 7fd471a00700 1 -- 172.21.15.137:0/3314807230 wait complete. 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.470+0000 7fd471a00700 1 Processor -- start 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.470+0000 7fd471a00700 1 -- start start 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 0x7fd46c1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 0x7fd46c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c1125f0 con 0x7fd46c102550 2024-04-25T02:08:30.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c112470 con 0x7fd46c102f00 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd471a00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c112770 con 0x7fd46c107540 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd46aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd46aa00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55392/0 (socket says 172.21.15.137:55392) 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd463e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 0x7fd46c1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd46aa00700 1 -- 172.21.15.137:0/34691146 learned_addr learned my addr 172.21.15.137:0/34691146 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.471+0000 7fd46b400700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 0x7fd46c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 -- 172.21.15.137:0/34691146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 msgr2=0x7fd46c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 0x7fd46c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 -- 172.21.15.137:0/34691146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 msgr2=0x7fd46c1a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 0x7fd46c1a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 -- 172.21.15.137:0/34691146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c19b250 con 0x7fd46c102550 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd463e00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 0x7fd46c1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd46aa00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00e9a0 tx=0x7fd45c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00cbd0 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd45c00cd70 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c19b540 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0187c0 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.472+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c1a7800 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.474+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46c068f20 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.476+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd45c010430 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.477+0000 7fd463400700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 0x7fd4500a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.477+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd45c0cf410 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.477+0000 7fd463e00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 0x7fd4500a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.478+0000 7fd463e00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 0x7fd4500a51f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.482+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd45c09c1c0 con 0x7fd46c102550 2024-04-25T02:08:30.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.717+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd46c1a7a30 con 0x7fd46c102550 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stdout:107374182471 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.718+0000 7fd463400700 1 -- 172.21.15.137:0/34691146 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd45c09bac0 con 0x7fd46c102550 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.721+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 msgr2=0x7fd4500a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.721+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 0x7fd4500a51f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454005ab0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.721+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 msgr2=0x7fd46c1a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.721+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00e9a0 tx=0x7fd45c00ecb0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 shutdown_connections 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd4500a2d30 0x7fd4500a51f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd46c107540 0x7fd46c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd46c102550 0x7fd46c1a0930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 --2- 172.21.15.137:0/34691146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd46c102f00 0x7fd46c1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 >> 172.21.15.137:0/34691146 conn(0x7fd46c0793f0 msgr2=0x7fd46c10d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 shutdown_connections 2024-04-25T02:08:30.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:29.722+0000 7fd471a00700 1 -- 172.21.15.137:0/34691146 wait complete. 2024-04-25T02:08:30.760 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:30 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/34691146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T02:08:30.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:30 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/34691146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T02:08:30.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:30 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/34691146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T02:08:31.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:31 smithi137 ceph-mon[28303]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:31.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:31 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1477708313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T02:08:31.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:31 smithi163 ceph-mon[32577]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:31.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:31 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1477708313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T02:08:31.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:31 smithi174 ceph-mon[33171]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:31.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:31 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1477708313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.513+0000 7f8393c00700 1 -- 172.21.15.137:0/94639029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c1082b0 msgr2=0x7f838c108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.513+0000 7f8393c00700 1 --2- 172.21.15.137:0/94639029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c1082b0 0x7f838c108690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8380009990 tx=0x7f8380009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.513+0000 7f8393c00700 1 -- 172.21.15.137:0/94639029 shutdown_connections 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.513+0000 7f8393c00700 1 --2- 172.21.15.137:0/94639029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c06a8e0 0x7f838c10f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.513+0000 7f8393c00700 1 --2- 172.21.15.137:0/94639029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c1082b0 0x7f838c108690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.514+0000 7f8393c00700 1 --2- 172.21.15.137:0/94639029 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c069f40 0x7f838c06a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.514+0000 7f8393c00700 1 -- 172.21.15.137:0/94639029 >> 172.21.15.137:0/94639029 conn(0x7f838c0780e0 msgr2=0x7f838c0784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.514+0000 7f8393c00700 1 -- 172.21.15.137:0/94639029 shutdown_connections 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.514+0000 7f8393c00700 1 -- 172.21.15.137:0/94639029 wait complete. 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 Processor -- start 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 -- start start 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 0x7f838c1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 0x7f838c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f838c112680 con 0x7f838c069f40 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f838c112500 con 0x7f838c06a8e0 2024-04-25T02:08:32.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.515+0000 7f8393c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f838c112800 con 0x7f838c1082b0 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f838be00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 0x7f838c1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55406/0 (socket says 172.21.15.137:55406) 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 -- 172.21.15.137:0/1477708313 learned_addr learned my addr 172.21.15.137:0/1477708313 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 0x7f838c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 -- 172.21.15.137:0/1477708313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 msgr2=0x7f838c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 0x7f838c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 -- 172.21.15.137:0/1477708313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 msgr2=0x7f838c1a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 0x7f838c1a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 -- 172.21.15.137:0/1477708313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c19b1e0 con 0x7f838c069f40 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 0x7f838c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f838be00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 0x7f838c1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.516+0000 7f8391200700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8380000c00 tx=0x7f83800057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.517+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380027070 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.517+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8380022470 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.517+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380017650 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.517+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c19b470 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.517+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c1a7790 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.518+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c068f20 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.520+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f838002a070 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.521+0000 7f8389600700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 0x7f83740a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.522+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f83800cffc0 con 0x7f838c069f40 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.522+0000 7f838be00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 0x7f83740a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.522+0000 7f838be00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 0x7f83740a51f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f838c10f530 tx=0x7f8378009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.526+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f8380013070 con 0x7f838c069f40 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stdout:287762808870 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.753+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f838c1a7960 con 0x7f838c069f40 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.754+0000 7f8389600700 1 -- 172.21.15.137:0/1477708313 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f838009ce00 con 0x7f838c069f40 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 msgr2=0x7f83740a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 0x7f83740a51f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f838c10f530 tx=0x7f8378009260 comp rx=0 tx=0).stop 2024-04-25T02:08:32.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 msgr2=0x7f838c1a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8380000c00 tx=0x7f83800057c0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 shutdown_connections 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f83740a2d30 0x7f83740a51f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f838c1082b0 0x7f838c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838c069f40 0x7f838c1a08c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 --2- 172.21.15.137:0/1477708313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f838c06a8e0 0x7f838c1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 >> 172.21.15.137:0/1477708313 conn(0x7f838c0780e0 msgr2=0x7f838c0ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 shutdown_connections 2024-04-25T02:08:32.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:30.757+0000 7f8393c00700 1 -- 172.21.15.137:0/1477708313 wait complete. 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 -- 172.21.15.137:0/226914387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 msgr2=0x7fcdc4108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 --2- 172.21.15.137:0/226914387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc4108ce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009990 tx=0x7fcdb0009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 -- 172.21.15.137:0/226914387 shutdown_connections 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 --2- 172.21.15.137:0/226914387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 0x7fcdc4115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 --2- 172.21.15.137:0/226914387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 0x7fcdc410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 --2- 172.21.15.137:0/226914387 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc4108ce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 -- 172.21.15.137:0/226914387 >> 172.21.15.137:0/226914387 conn(0x7fcdc4075a00 msgr2=0x7fcdc4107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 -- 172.21.15.137:0/226914387 shutdown_connections 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.798+0000 7fcdca400700 1 -- 172.21.15.137:0/226914387 wait complete. 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.799+0000 7fcdca400700 1 Processor -- start 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 -- start start 2024-04-25T02:08:32.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 0x7fcdc419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 0x7fcdc41a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc4118d30 con 0x7fcdc4108860 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc4118bb0 con 0x7fcdc4109220 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdca400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc4118eb0 con 0x7fcdc410e860 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdc3400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdc3400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59146/0 (socket says 172.21.15.137:59146) 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdc3400700 1 -- 172.21.15.137:0/2123029860 learned_addr learned my addr 172.21.15.137:0/2123029860 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdc3e00700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 0x7fcdc41a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.800+0000 7fcdc2a00700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 0x7fcdc419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 -- 172.21.15.137:0/2123029860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 msgr2=0x7fcdc41a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 0x7fcdc41a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 -- 172.21.15.137:0/2123029860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 msgr2=0x7fcdc419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 0x7fcdc419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 -- 172.21.15.137:0/2123029860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc41a4140 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdc3400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e9c0 tx=0x7fcdb400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400cbd0 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcdb400ee60 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.801+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4010430 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.802+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc41a4430 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.802+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc41abcb0 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.803+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc4068f20 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.805+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcdb4004750 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.806+0000 7fcdbbe00700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 0x7fcda80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.807+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcdb40cf590 con 0x7fcdc4108860 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.807+0000 7fcdc2a00700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 0x7fcda80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:32.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.808+0000 7fcdc2a00700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 0x7fcda80a51f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4077820 tx=0x7fcdb000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stdout:309237645345 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:31.809+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fcdb4053740 con 0x7fcdc4108860 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.036+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fcdc41a0490 con 0x7fcdc4108860 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.037+0000 7fcdbbe00700 1 -- 172.21.15.137:0/2123029860 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcdb409c3a0 con 0x7fcdc4108860 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.040+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 msgr2=0x7fcda80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.040+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 0x7fcda80a51f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4077820 tx=0x7fcdb000b260 comp rx=0 tx=0).stop 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.040+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 msgr2=0x7fcdc419f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.040+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e9c0 tx=0x7fcdb400ecd0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 shutdown_connections 2024-04-25T02:08:32.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcda80a2d30 0x7fcda80a51f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdc410e860 0x7fcdc41a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdc4108860 0x7fcdc419f180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 --2- 172.21.15.137:0/2123029860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdc4109220 0x7fcdc419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 >> 172.21.15.137:0/2123029860 conn(0x7fcdc4075a00 msgr2=0x7fcdc4075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 shutdown_connections 2024-04-25T02:08:32.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:32.041+0000 7fcdca400700 1 -- 172.21.15.137:0/2123029860 wait complete. 2024-04-25T02:08:32.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:32 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2123029860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T02:08:32.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:32 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2123029860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T02:08:32.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:32 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2123029860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-25T02:08:33.700 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757304 got 163208757309 for osd.5 2024-04-25T02:08:33.700 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:33.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:33 smithi137 ceph-mon[28303]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:33.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:33 smithi163 ceph-mon[32577]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:33.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808866 got 287762808870 for osd.9 2024-04-25T02:08:33.908 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:33.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:33 smithi174 ceph-mon[33171]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 -- 172.21.15.137:0/4221942881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104450 msgr2=0x7fe2c81048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 --2- 172.21.15.137:0/4221942881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104450 0x7fe2c81048d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009990 tx=0x7fe2b4009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 -- 172.21.15.137:0/4221942881 shutdown_connections 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 --2- 172.21.15.137:0/4221942881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104e10 0x7fe2c8111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 --2- 172.21.15.137:0/4221942881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c810a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 --2- 172.21.15.137:0/4221942881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104450 0x7fe2c81048d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 -- 172.21.15.137:0/4221942881 >> 172.21.15.137:0/4221942881 conn(0x7fe2c80fff40 msgr2=0x7fe2c8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 -- 172.21.15.137:0/4221942881 shutdown_connections 2024-04-25T02:08:34.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.099+0000 7fe2cde00700 1 -- 172.21.15.137:0/4221942881 wait complete. 2024-04-25T02:08:34.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.100+0000 7fe2cde00700 1 Processor -- start 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 -- start start 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 0x7fe2c81a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c81148b0 con 0x7fe2c8104450 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8114730 con 0x7fe2c8104e10 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2cde00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8114a30 con 0x7fe2c810a4e0 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2c6a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2c7400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2c6a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59172/0 (socket says 172.21.15.137:59172) 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2c7400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:44534/0 (socket says 172.21.15.137:44534) 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.101+0000 7fe2c6a00700 1 -- 172.21.15.137:0/3907921949 learned_addr learned my addr 172.21.15.137:0/3907921949 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c6000700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 0x7fe2c81a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 -- 172.21.15.137:0/3907921949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 msgr2=0x7fe2c81a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 0x7fe2c81a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 -- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 msgr2=0x7fe2c81a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 -- 172.21.15.137:0/3907921949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c819b410 con 0x7fe2c810a4e0 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c6a00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c6000700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 0x7fe2c81a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:34.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2c7400700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000efc0 tx=0x7fe2c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.102+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00092e0 con 0x7fe2c810a4e0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.103+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2c0004bb0 con 0x7fe2c810a4e0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.103+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c819b6a0 con 0x7fe2c810a4e0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.103+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0004280 con 0x7fe2c810a4e0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.103+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a7810 con 0x7fe2c810a4e0 2024-04-25T02:08:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.104+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c8105b90 con 0x7fe2c810a4e0 2024-04-25T02:08:34.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.106+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe2c001b030 con 0x7fe2c810a4e0 2024-04-25T02:08:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.107+0000 7fe2cca00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 0x7fe2ac0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.107+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe2c00ced90 con 0x7fe2c810a4e0 2024-04-25T02:08:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.107+0000 7fe2c6a00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 0x7fe2ac0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.108+0000 7fe2c6a00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 0x7fe2ac0a5170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8005950 tx=0x7fe2b800b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.111+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe2c0022020 con 0x7fe2c810a4e0 2024-04-25T02:08:34.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.340+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe2c802db30 con 0x7fe2c810a4e0 2024-04-25T02:08:34.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.341+0000 7fe2cca00700 1 -- 172.21.15.137:0/3907921949 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe2c0010040 con 0x7fe2c810a4e0 2024-04-25T02:08:34.348 INFO:teuthology.orchestra.run.smithi137.stdout:141733920836 2024-04-25T02:08:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 msgr2=0x7fe2ac0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 0x7fe2ac0a5170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8005950 tx=0x7fe2b800b500 comp rx=0 tx=0).stop 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 msgr2=0x7fe2c819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000efc0 tx=0x7fe2c000c3a0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 shutdown_connections 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe2ac0a2cb0 0x7fe2ac0a5170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2c810a4e0 0x7fe2c819ab30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2c8104450 0x7fe2c81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 --2- 172.21.15.137:0/3907921949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8104e10 0x7fe2c81a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:34.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 >> 172.21.15.137:0/3907921949 conn(0x7fe2c80fff40 msgr2=0x7fe2c81004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:34.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 shutdown_connections 2024-04-25T02:08:34.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:34.344+0000 7fe2cde00700 1 -- 172.21.15.137:0/3907921949 wait complete. 2024-04-25T02:08:34.621 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3907921949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T02:08:34.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411406 for osd.2 2024-04-25T02:08:34.666 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:34.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3907921949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T02:08:34.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3907921949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T02:08:35.403 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645339 got 309237645345 for osd.10 2024-04-25T02:08:35.403 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:35.607 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:35 smithi137 ceph-mon[28303]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:35.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:35 smithi163 ceph-mon[32577]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:35.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:35 smithi174 ceph-mon[33171]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 -- 172.21.15.137:0/3361802739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae81082b0 msgr2=0x7f6ae8108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 --2- 172.21.15.137:0/3361802739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae81082b0 0x7f6ae8108690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009990 tx=0x7f6ad8009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 -- 172.21.15.137:0/3361802739 shutdown_connections 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 --2- 172.21.15.137:0/3361802739 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae806a8e0 0x7f6ae810f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 --2- 172.21.15.137:0/3361802739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae81082b0 0x7f6ae8108690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 --2- 172.21.15.137:0/3361802739 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae8069f40 0x7f6ae806a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.014+0000 7f6aeca00700 1 -- 172.21.15.137:0/3361802739 >> 172.21.15.137:0/3361802739 conn(0x7f6ae80780e0 msgr2=0x7f6ae80784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.015+0000 7f6aeca00700 1 -- 172.21.15.137:0/3361802739 shutdown_connections 2024-04-25T02:08:36.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.015+0000 7f6aeca00700 1 -- 172.21.15.137:0/3361802739 wait complete. 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 Processor -- start 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 -- start start 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 0x7f6ae819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae81082b0 0x7f6ae819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8112650 con 0x7f6ae81082b0 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81124d0 con 0x7f6ae8069f40 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6aeca00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81127d0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.016+0000 7f6ae5400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:44546/0 (socket says 172.21.15.137:44546) 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 -- 172.21.15.137:0/1483860380 learned_addr learned my addr 172.21.15.137:0/1483860380 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae6800700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae81082b0 0x7f6ae819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5e00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 0x7f6ae819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 -- 172.21.15.137:0/1483860380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 msgr2=0x7f6ae819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 0x7f6ae819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 -- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae81082b0 msgr2=0x7f6ae819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae81082b0 0x7f6ae819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 -- 172.21.15.137:0/1483860380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae819fd50 con 0x7f6ae806a8e0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5e00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 0x7f6ae819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.017+0000 7f6ae5400700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e9a0 tx=0x7f6ad400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.018+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400cbd0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.018+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ad400cd70 con 0x7f6ae806a8e0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.018+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81a0040 con 0x7f6ae806a8e0 2024-04-25T02:08:36.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.018+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40187c0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.018+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a78c0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.019+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8068f20 con 0x7f6ae806a8e0 2024-04-25T02:08:36.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.021+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6ad4010430 con 0x7f6ae806a8e0 2024-04-25T02:08:36.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.023+0000 7f6adea00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 0x7f6acc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:36.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.023+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f6ad40cf420 con 0x7f6ae806a8e0 2024-04-25T02:08:36.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.023+0000 7f6ae5e00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 0x7f6acc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:36.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.024+0000 7f6ae5e00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 0x7f6acc0a51f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800b2e0 tx=0x7f6ad801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:36.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.027+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6ad409c1d0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.254+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6ae81a7af0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.254+0000 7f6adea00700 1 -- 172.21.15.137:0/1483860380 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ad409bad0 con 0x7f6ae806a8e0 2024-04-25T02:08:36.261 INFO:teuthology.orchestra.run.smithi137.stdout:55834574933 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 msgr2=0x7f6acc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 0x7f6acc0a51f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800b2e0 tx=0x7f6ad801a040 comp rx=0 tx=0).stop 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 msgr2=0x7f6ae819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e9a0 tx=0x7f6ad400ecb0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 shutdown_connections 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f6acc0a2d30 0x7f6acc0a51f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae8069f40 0x7f6ae819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ae81082b0 0x7f6ae819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 --2- 172.21.15.137:0/1483860380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae806a8e0 0x7f6ae819b2d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:36.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 >> 172.21.15.137:0/1483860380 conn(0x7f6ae80780e0 msgr2=0x7f6ae80ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:36.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 shutdown_connections 2024-04-25T02:08:36.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7f6aeca00700 1 -- 172.21.15.137:0/1483860380 wait complete. 2024-04-25T02:08:36.728 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:36 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1483860380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T02:08:36.728 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:36 smithi137 ceph-mon[28303]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:36.729 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:36 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/359366164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T02:08:36.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182471 for osd.3 2024-04-25T02:08:36.799 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:36.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:36 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1483860380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T02:08:36.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:36 smithi163 ceph-mon[32577]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:36.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:36 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/359366164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T02:08:36.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:36 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1483860380' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T02:08:36.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:36 smithi174 ceph-mon[33171]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:36.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:36 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/359366164' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-25T02:08:37.286 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:37.335 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920831 got 141733920836 for osd.4 2024-04-25T02:08:37.335 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 -- 172.21.15.137:0/1163117675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c074460 msgr2=0x7ff76c074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 --2- 172.21.15.137:0/1163117675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c074460 0x7ff76c074840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff76000b0a0 tx=0x7ff76000b3b0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 -- 172.21.15.137:0/1163117675 shutdown_connections 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 --2- 172.21.15.137:0/1163117675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c10ec30 0x7ff76c111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 --2- 172.21.15.137:0/1163117675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c074460 0x7ff76c074840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 --2- 172.21.15.137:0/1163117675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 0x7ff76c10e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.256+0000 7ff774600700 1 -- 172.21.15.137:0/1163117675 >> 172.21.15.137:0/1163117675 conn(0x7ff76c079390 msgr2=0x7ff76c0797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7ff774600700 1 -- 172.21.15.137:0/1163117675 shutdown_connections 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.257+0000 7ff774600700 1 -- 172.21.15.137:0/1163117675 wait complete. 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 Processor -- start 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 -- start start 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 0x7ff76c1a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 0x7ff76c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1148e0 con 0x7ff76c10ec30 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c114760 con 0x7ff76c074d80 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.258+0000 7ff774600700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c114a60 con 0x7ff76c074460 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff771c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff771c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:44552/0 (socket says 172.21.15.137:44552) 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff771c00700 1 -- 172.21.15.137:0/359366164 learned_addr learned my addr 172.21.15.137:0/359366164 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 0x7ff76c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff771200700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 0x7ff76c1a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 -- 172.21.15.137:0/359366164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 msgr2=0x7ff76c1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 -- 172.21.15.137:0/359366164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 msgr2=0x7ff76c1a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 0x7ff76c1a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff772600700 1 -- 172.21.15.137:0/359366164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c19b240 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.259+0000 7ff771c00700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff772600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 0x7ff76c19aae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e940 tx=0x7ff76400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764004220 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff764004d30 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c19b530 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764010700 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.260+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1a77f0 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.261+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c068f20 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.263+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff764004750 con 0x7ff76c10ec30 2024-04-25T02:08:37.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.264+0000 7ff76a000700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 0x7ff7540a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.265+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff7640cee30 con 0x7ff76c10ec30 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.265+0000 7ff771c00700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 0x7ff7540a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.265+0000 7ff771c00700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 0x7ff7540a51f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff760009e60 tx=0x7ff76000ce70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.269+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff76409bbe0 con 0x7ff76c10ec30 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.498+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff76c1a7a80 con 0x7ff76c10ec30 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.499+0000 7ff76a000700 1 -- 172.21.15.137:0/359366164 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff76409b4e0 con 0x7ff76c10ec30 2024-04-25T02:08:37.450 INFO:teuthology.orchestra.run.smithi137.stdout:219043332147 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.501+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 msgr2=0x7ff7540a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.501+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 0x7ff7540a51f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff760009e60 tx=0x7ff76000ce70 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 msgr2=0x7ff76c19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 0x7ff76c19aae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff76400e940 tx=0x7ff76400ec50 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 shutdown_connections 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff7540a2d30 0x7ff7540a51f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff76c10ec30 0x7ff76c19aae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff76c074460 0x7ff76c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 --2- 172.21.15.137:0/359366164 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff76c074d80 0x7ff76c1a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 >> 172.21.15.137:0/359366164 conn(0x7ff76c079390 msgr2=0x7ff76c0ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:37.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 shutdown_connections 2024-04-25T02:08:37.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:36.502+0000 7ff774600700 1 -- 172.21.15.137:0/359366164 wait complete. 2024-04-25T02:08:37.662 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:38.083 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332142 got 219043332147 for osd.7 2024-04-25T02:08:38.083 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:38.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574933 for osd.1 2024-04-25T02:08:38.860 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:39.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:39 smithi137 ceph-mon[28303]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:39.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:39 smithi163 ceph-mon[32577]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:39.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:39 smithi174 ceph-mon[33171]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:41.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.451+0000 7f150b400700 1 -- 172.21.15.137:0/596525885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 msgr2=0x7f1504112ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.451+0000 7f150b400700 1 --2- 172.21.15.137:0/596525885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f1504112ba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009990 tx=0x7f14f4009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 -- 172.21.15.137:0/596525885 shutdown_connections 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 --2- 172.21.15.137:0/596525885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 0x7f15041154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 --2- 172.21.15.137:0/596525885 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 0x7f1504076b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 --2- 172.21.15.137:0/596525885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f1504112ba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 -- 172.21.15.137:0/596525885 >> 172.21.15.137:0/596525885 conn(0x7f15040fff10 msgr2=0x7f1504102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 -- 172.21.15.137:0/596525885 shutdown_connections 2024-04-25T02:08:41.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.453+0000 7f150b400700 1 -- 172.21.15.137:0/596525885 wait complete. 2024-04-25T02:08:41.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.454+0000 7f150b400700 1 Processor -- start 2024-04-25T02:08:41.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 -- start start 2024-04-25T02:08:41.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 0x7f150419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 0x7f15041a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1504118d50 con 0x7f1504076760 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1504118bd0 con 0x7f15041130e0 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f150b400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1504118ed0 con 0x7f1504077080 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f14fbe00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f1508a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 0x7f150419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f14fbe00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:54012/0 (socket says 172.21.15.137:54012) 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.455+0000 7f14fbe00700 1 -- 172.21.15.137:0/3768996431 learned_addr learned my addr 172.21.15.137:0/3768996431 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f1509400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 0x7f15041a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 -- 172.21.15.137:0/3768996431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 msgr2=0x7f15041a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 0x7f15041a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 -- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 msgr2=0x7f150419f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 0x7f150419f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 -- 172.21.15.137:0/3768996431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15041a4110 con 0x7f1504077080 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f14fbe00700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005910 tx=0x7f14f400b6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.456+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4027070 con 0x7f1504077080 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.457+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f14f4022470 con 0x7f1504077080 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.457+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15041a43a0 con 0x7f1504077080 2024-04-25T02:08:41.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.457+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4017650 con 0x7f1504077080 2024-04-25T02:08:41.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.457+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15041abc80 con 0x7f1504077080 2024-04-25T02:08:41.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.458+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1504068f20 con 0x7f1504077080 2024-04-25T02:08:41.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.461+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f14f402a070 con 0x7f1504077080 2024-04-25T02:08:41.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.462+0000 7f1502000700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 0x7f14e80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:41.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.462+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f14f40cff60 con 0x7f1504077080 2024-04-25T02:08:41.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.462+0000 7f1508a00700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 0x7f14e80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:41.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.463+0000 7f1508a00700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 0x7f14e80a51f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009bf0 tx=0x7f14ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:41.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.466+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f14f4013070 con 0x7f1504077080 2024-04-25T02:08:41.575 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:41 smithi137 ceph-mon[28303]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:41.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.695+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f15041abe50 con 0x7f1504077080 2024-04-25T02:08:41.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.695+0000 7f1502000700 1 -- 172.21.15.137:0/3768996431 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f14f409cda0 con 0x7f1504077080 2024-04-25T02:08:41.702 INFO:teuthology.orchestra.run.smithi137.stdout:253403070511 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 msgr2=0x7f14e80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 0x7f14e80a51f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009bf0 tx=0x7f14ec009260 comp rx=0 tx=0).stop 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 msgr2=0x7f150419f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005910 tx=0x7f14f400b6c0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 shutdown_connections 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f14e80a2d30 0x7f14e80a51f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15041130e0 0x7f15041a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1504076760 0x7f150419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 --2- 172.21.15.137:0/3768996431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1504077080 0x7f150419f640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:41.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.698+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 >> 172.21.15.137:0/3768996431 conn(0x7f15040fff10 msgr2=0x7f1504102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:41.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.699+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 shutdown_connections 2024-04-25T02:08:41.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:41.699+0000 7f150b400700 1 -- 172.21.15.137:0/3768996431 wait complete. 2024-04-25T02:08:41.840 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:41 smithi174 ceph-mon[33171]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:41.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:41 smithi163 ceph-mon[32577]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:42.611 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:42 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3768996431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T02:08:42.671 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070506 got 253403070511 for osd.8 2024-04-25T02:08:42.671 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:42.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:42 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3768996431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T02:08:42.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:42 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3768996431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 -- 172.21.15.137:0/2983173090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc107570 msgr2=0x7f76bc10f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 --2- 172.21.15.137:0/2983173090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc107570 0x7f76bc10f140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76b400b0a0 tx=0x7f76b400b3b0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 -- 172.21.15.137:0/2983173090 shutdown_connections 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 --2- 172.21.15.137:0/2983173090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 --2- 172.21.15.137:0/2983173090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc107570 0x7f76bc10f140 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 --2- 172.21.15.137:0/2983173090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc102e90 0x7f76bc106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 -- 172.21.15.137:0/2983173090 >> 172.21.15.137:0/2983173090 conn(0x7f76bc079390 msgr2=0x7f76bc0797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 -- 172.21.15.137:0/2983173090 shutdown_connections 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.198+0000 7f76c2400700 1 -- 172.21.15.137:0/2983173090 wait complete. 2024-04-25T02:08:43.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.199+0000 7f76c2400700 1 Processor -- start 2024-04-25T02:08:43.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.199+0000 7f76c2400700 1 -- start start 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 0x7f76bc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc107570 0x7f76bc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc112700 con 0x7f76bc102e90 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc112580 con 0x7f76bc1024e0 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76c2400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc112880 con 0x7f76bc107570 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bb400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bb400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:48372/0 (socket says 172.21.15.137:48372) 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bb400700 1 -- 172.21.15.137:0/3267062035 learned_addr learned my addr 172.21.15.137:0/3267062035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:43.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76baa00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 0x7f76bc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bbe00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc107570 0x7f76bc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bb400700 1 -- 172.21.15.137:0/3267062035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc107570 msgr2=0x7f76bc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.200+0000 7f76bb400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc107570 0x7f76bc198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76bb400700 1 -- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 msgr2=0x7f76bc19ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76bb400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 0x7f76bc19ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76bb400700 1 -- 172.21.15.137:0/3267062035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc1990c0 con 0x7f76bc1024e0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76baa00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 0x7f76bc19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76bb400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e9a0 tx=0x7f76ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00cbd0 con 0x7f76bc1024e0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc1993b0 con 0x7f76bc1024e0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76ac00cd70 con 0x7f76bc1024e0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0187c0 con 0x7f76bc1024e0 2024-04-25T02:08:43.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.201+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc074460 con 0x7f76bc1024e0 2024-04-25T02:08:43.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.202+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc068f20 con 0x7f76bc1024e0 2024-04-25T02:08:43.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.205+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f76ac010430 con 0x7f76bc1024e0 2024-04-25T02:08:43.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.206+0000 7f76b3e00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 0x7f76a00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:43.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.206+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f76ac0cf8d0 con 0x7f76bc1024e0 2024-04-25T02:08:43.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.207+0000 7f76baa00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 0x7f76a00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:43.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.207+0000 7f76baa00700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 0x7f76a00a5170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76bc108980 tx=0x7f76a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:43.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.208+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f76ac09c680 con 0x7f76bc1024e0 2024-04-25T02:08:43.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.455+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f76bc02db30 con 0x7f76bc1024e0 2024-04-25T02:08:43.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.456+0000 7f76b3e00700 1 -- 172.21.15.137:0/3267062035 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f76ac09bf80 con 0x7f76bc1024e0 2024-04-25T02:08:43.463 INFO:teuthology.orchestra.run.smithi137.stdout:343597383712 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 msgr2=0x7f76a00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 0x7f76a00a5170 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f76bc108980 tx=0x7f76a8009260 comp rx=0 tx=0).stop 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 msgr2=0x7f76bc19e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e9a0 tx=0x7f76ac00ecb0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 shutdown_connections 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76a00a2cb0 0x7f76a00a5170 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76bc1024e0 0x7f76bc19e750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76bc107570 0x7f76bc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 --2- 172.21.15.137:0/3267062035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76bc102e90 0x7f76bc19ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:43.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 >> 172.21.15.137:0/3267062035 conn(0x7f76bc079390 msgr2=0x7f76bc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:43.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 shutdown_connections 2024-04-25T02:08:43.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:43.460+0000 7f76c2400700 1 -- 172.21.15.137:0/3267062035 wait complete. 2024-04-25T02:08:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:43 smithi137 ceph-mon[28303]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:43 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3267062035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T02:08:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:43 smithi163 ceph-mon[32577]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:43 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3267062035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T02:08:43.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:43 smithi174 ceph-mon[33171]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:43.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:43 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3267062035' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-25T02:08:44.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383706 got 343597383712 for osd.11 2024-04-25T02:08:44.359 DEBUG:teuthology.parallel:result is None 2024-04-25T02:08:44.360 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T02:08:44.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T02:08:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:44.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:44 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:44.790 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:44.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:44.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:44 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:44.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:44.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:44 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:45 smithi137 ceph-mon[28303]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:45.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:08:45.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:08:45.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:45 smithi137 ceph-mon[28303]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:45 smithi163 ceph-mon[32577]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:08:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:08:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:45 smithi163 ceph-mon[32577]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:45.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:45 smithi174 ceph-mon[33171]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:45.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:08:45.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:08:45.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:45 smithi174 ceph-mon[33171]: from='mgr.14152 172.21.15.137:0/1343912781' entity='mgr.x' 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 -- 172.21.15.137:0/3930311268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef010e990 msgr2=0x7f7ef0110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 --2- 172.21.15.137:0/3930311268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef010e990 0x7f7ef0110e00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009f90 tx=0x7f7ee800b330 comp rx=0 tx=0).stop 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 -- 172.21.15.137:0/3930311268 shutdown_connections 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 --2- 172.21.15.137:0/3930311268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef010e990 0x7f7ef0110e00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 --2- 172.21.15.137:0/3930311268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074660 0x7f7ef0074a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 --2- 172.21.15.137:0/3930311268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef0074f80 0x7f7ef010e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 -- 172.21.15.137:0/3930311268 >> 172.21.15.137:0/3930311268 conn(0x7f7ef00fdc40 msgr2=0x7f7ef0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 -- 172.21.15.137:0/3930311268 shutdown_connections 2024-04-25T02:08:46.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.955+0000 7f7eef200700 1 -- 172.21.15.137:0/3930311268 wait complete. 2024-04-25T02:08:46.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 Processor -- start 2024-04-25T02:08:46.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 -- start start 2024-04-25T02:08:46.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef0074660 0x7f7ef01a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:46.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 0x7f7ef019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef01147d0 con 0x7f7ef0074f80 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0114650 con 0x7f7ef010e990 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eef200700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef0114950 con 0x7f7ef0074660 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.957+0000 7f7eed400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eed400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43450/0 (socket says 172.21.15.137:43450) 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eed400700 1 -- 172.21.15.137:0/3635494797 learned_addr learned my addr 172.21.15.137:0/3635494797 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 0x7f7ef019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eede00700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef0074660 0x7f7ef01a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 -- 172.21.15.137:0/3635494797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef0074660 msgr2=0x7f7ef01a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef0074660 0x7f7ef01a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 -- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 msgr2=0x7f7ef01a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 -- 172.21.15.137:0/3635494797 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef019b150 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eed400700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.958+0000 7f7eee800700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 0x7f7ef019a9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800d010 tx=0x7f7ee800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.959+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8021070 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.959+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef019b3e0 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.959+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ee801d450 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.959+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8005260 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.959+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef01a7700 con 0x7f7ef010e990 2024-04-25T02:08:46.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.960+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef0068f20 con 0x7f7ef010e990 2024-04-25T02:08:46.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.962+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7ee8024070 con 0x7f7ef010e990 2024-04-25T02:08:46.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.963+0000 7f7ee6a00700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 0x7f7ed40a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:46.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.963+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f7ee800f020 con 0x7f7ef010e990 2024-04-25T02:08:46.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.963+0000 7f7eede00700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 0x7f7ed40a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:46.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.964+0000 7f7eede00700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 0x7f7ed40a51f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ef019bb30 tx=0x7f7ee0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:46.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:46.967+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7ee802b020 con 0x7f7ef010e990 2024-04-25T02:08:47.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.187+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ef00ff8c0 con 0x7f7ed40a2d30 2024-04-25T02:08:47.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.196+0000 7f7ee6a00700 1 -- 172.21.15.137:0/3635494797 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7f7ef00ff8c0 con 0x7f7ed40a2d30 2024-04-25T02:08:47.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:47.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.201+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 msgr2=0x7f7ed40a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.201+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 0x7f7ed40a51f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ef019bb30 tx=0x7f7ee0009310 comp rx=0 tx=0).stop 2024-04-25T02:08:47.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.201+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 msgr2=0x7f7ef019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:47.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.201+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 0x7f7ef019a9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800d010 tx=0x7f7ee800bca0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 shutdown_connections 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7ed40a2d30 0x7f7ed40a51f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef010e990 0x7f7ef019a9f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ef0074660 0x7f7ef01a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 --2- 172.21.15.137:0/3635494797 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ef0074f80 0x7f7ef01a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 >> 172.21.15.137:0/3635494797 conn(0x7f7ef00fdc40 msgr2=0x7f7ef0110be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 shutdown_connections 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:47.202+0000 7f7eef200700 1 -- 172.21.15.137:0/3635494797 wait complete. 2024-04-25T02:08:47.212 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:08:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:47 smithi137 ceph-mon[28303]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:47.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:47 smithi163 ceph-mon[32577]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:47.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:47 smithi174 ceph-mon[33171]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:48.069 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-04-25T02:08:46.407868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655017,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":638,"num_read_kb":438,"num_write":342,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370660,"kb_used_data":13164,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571164,"statfs":{"total":1151940427776,"available":1151560871936,"internally_reserved":0,"allocated":13479936,"data_stored":7432431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004468"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447270+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:27.447270+0000","last_peered":"2024-04-25T02:07:27.447270+0000","last_clean":"2024-04-25T02:07:27.447270+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:27.447270+0000","last_undegraded":"2024-04-25T02:07:27.447270+0000","last_fullsized":"2024-04-25T02:07:27.447270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.446666+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:27.446666+0000","last_peered":"2024-04-25T02:07:27.446666+0000","last_clean":"2024-04-25T02:07:27.446666+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:27.446666+0000","last_undegraded":"2024-04-25T02:07:27.446666+0000","last_fullsized":"2024-04-25T02:07:27.446666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335780+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:28.335780+0000","last_peered":"2024-04-25T02:07:28.335780+0000","last_clean":"2024-04-25T02:07:28.335780+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:28.335780+0000","last_undegraded":"2024-04-25T02:07:28.335780+0000","last_fullsized":"2024-04-25T02:07:28.335780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439308+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:27.439308+0000","last_peered":"2024-04-25T02:07:27.439308+0000","last_clean":"2024-04-25T02:07:27.439308+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:27.439308+0000","last_undegraded":"2024-04-25T02:07:27.439308+0000","last_fullsized":"2024-04-25T02:07:27.439308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441104+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:27.441104+0000","last_peered":"2024-04-25T02:07:27.441104+0000","last_clean":"2024-04-25T02:07:27.441104+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:27.441104+0000","last_undegraded":"2024-04-25T02:07:27.441104+0000","last_fullsized":"2024-04-25T02:07:27.441104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452349+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:27.452349+0000","last_peered":"2024-04-25T02:07:27.452349+0000","last_clean":"2024-04-25T02:07:27.452349+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:27.452349+0000","last_undegraded":"2024-04-25T02:07:27.452349+0000","last_fullsized":"2024-04-25T02:07:27.452349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.162662+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:07:28.162662+0000","last_peered":"2024-04-25T02:07:28.162662+0000","last_clean":"2024-04-25T02:07:28.162662+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:07:28.162662+0000","last_undegraded":"2024-04-25T02:07:28.162662+0000","last_fullsized":"2024-04-25T02:07:28.162662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441483+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:27.441483+0000","last_peered":"2024-04-25T02:07:27.441483+0000","last_clean":"2024-04-25T02:07:27.441483+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:27.441483+0000","last_undegraded":"2024-04-25T02:07:27.441483+0000","last_fullsized":"2024-04-25T02:07:27.441483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335695+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:28.335695+0000","last_peered":"2024-04-25T02:07:28.335695+0000","last_clean":"2024-04-25T02:07:28.335695+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:28.335695+0000","last_undegraded":"2024-04-25T02:07:28.335695+0000","last_fullsized":"2024-04-25T02:07:28.335695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159865+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:28.159865+0000","last_peered":"2024-04-25T02:07:28.159865+0000","last_clean":"2024-04-25T02:07:28.159865+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:28.159865+0000","last_undegraded":"2024-04-25T02:07:28.159865+0000","last_fullsized":"2024-04-25T02:07:28.159865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445435+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:27.445435+0000","last_peered":"2024-04-25T02:07:27.445435+0000","last_clean":"2024-04-25T02:07:27.445435+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:27.445435+0000","last_undegraded":"2024-04-25T02:07:27.445435+0000","last_fullsized":"2024-04-25T02:07:27.445435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457403+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:07:27.457403+0000","last_peered":"2024-04-25T02:07:27.457403+0000","last_clean":"2024-04-25T02:07:27.457403+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:07:27.457403+0000","last_undegraded":"2024-04-25T02:07:27.457403+0000","last_fullsized":"2024-04-25T02:07:27.457403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437030+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:27.437030+0000","last_peered":"2024-04-25T02:07:27.437030+0000","last_clean":"2024-04-25T02:07:27.437030+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:27.437030+0000","last_undegraded":"2024-04-25T02:07:27.437030+0000","last_fullsized":"2024-04-25T02:07:27.437030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442889+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:27.442889+0000","last_peered":"2024-04-25T02:07:27.442889+0000","last_clean":"2024-04-25T02:07:27.442889+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:27.442889+0000","last_undegraded":"2024-04-25T02:07:27.442889+0000","last_fullsized":"2024-04-25T02:07:27.442889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444246+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:27.444246+0000","last_peered":"2024-04-25T02:07:27.444246+0000","last_clean":"2024-04-25T02:07:27.444246+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:27.444246+0000","last_undegraded":"2024-04-25T02:07:27.444246+0000","last_fullsized":"2024-04-25T02:07:27.444246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.345920+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:07:28.345920+0000","last_peered":"2024-04-25T02:07:28.345920+0000","last_clean":"2024-04-25T02:07:28.345920+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:07:28.345920+0000","last_undegraded":"2024-04-25T02:07:28.345920+0000","last_fullsized":"2024-04-25T02:07:28.345920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.455141+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:27.455141+0000","last_peered":"2024-04-25T02:07:27.455141+0000","last_clean":"2024-04-25T02:07:27.455141+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:27.455141+0000","last_undegraded":"2024-04-25T02:07:27.455141+0000","last_fullsized":"2024-04-25T02:07:27.455141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.458218+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:27.458218+0000","last_peered":"2024-04-25T02:07:27.458218+0000","last_clean":"2024-04-25T02:07:27.458218+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:27.458218+0000","last_undegraded":"2024-04-25T02:07:27.458218+0000","last_fullsized":"2024-04-25T02:07:27.458218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.448024+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:27.448024+0000","last_peered":"2024-04-25T02:07:27.448024+0000","last_clean":"2024-04-25T02:07:27.448024+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:27.448024+0000","last_undegraded":"2024-04-25T02:07:27.448024+0000","last_fullsized":"2024-04-25T02:07:27.448024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439635+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:27.439635+0000","last_peered":"2024-04-25T02:07:27.439635+0000","last_clean":"2024-04-25T02:07:27.439635+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:27.439635+0000","last_undegraded":"2024-04-25T02:07:27.439635+0000","last_fullsized":"2024-04-25T02:07:27.439635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437171+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:27.437171+0000","last_peered":"2024-04-25T02:07:27.437171+0000","last_clean":"2024-04-25T02:07:27.437171+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:27.437171+0000","last_undegraded":"2024-04-25T02:07:27.437171+0000","last_fullsized":"2024-04-25T02:07:27.437171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439586+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:27.439586+0000","last_peered":"2024-04-25T02:07:27.439586+0000","last_clean":"2024-04-25T02:07:27.439586+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:27.439586+0000","last_undegraded":"2024-04-25T02:07:27.439586+0000","last_fullsized":"2024-04-25T02:07:27.439586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409529+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:28.409529+0000","last_peered":"2024-04-25T02:07:28.409529+0000","last_clean":"2024-04-25T02:07:28.409529+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:28.409529+0000","last_undegraded":"2024-04-25T02:07:28.409529+0000","last_fullsized":"2024-04-25T02:07:28.409529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":109,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:43.520121+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:08:43.520121+0000","last_peered":"2024-04-25T02:08:43.520121+0000","last_clean":"2024-04-25T02:08:43.520121+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:08:43.520121+0000","last_undegraded":"2024-04-25T02:08:43.520121+0000","last_fullsized":"2024-04-25T02:08:43.520121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439297+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:27.439297+0000","last_peered":"2024-04-25T02:07:27.439297+0000","last_clean":"2024-04-25T02:07:27.439297+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:27.439297+0000","last_undegraded":"2024-04-25T02:07:27.439297+0000","last_fullsized":"2024-04-25T02:07:27.439297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441062+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:27.441062+0000","last_peered":"2024-04-25T02:07:27.441062+0000","last_clean":"2024-04-25T02:07:27.441062+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:27.441062+0000","last_undegraded":"2024-04-25T02:07:27.441062+0000","last_fullsized":"2024-04-25T02:07:27.441062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409368+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:28.409368+0000","last_peered":"2024-04-25T02:07:28.409368+0000","last_clean":"2024-04-25T02:07:28.409368+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:28.409368+0000","last_undegraded":"2024-04-25T02:07:28.409368+0000","last_fullsized":"2024-04-25T02:07:28.409368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159404+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:28.159404+0000","last_peered":"2024-04-25T02:07:28.159404+0000","last_clean":"2024-04-25T02:07:28.159404+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:28.159404+0000","last_undegraded":"2024-04-25T02:07:28.159404+0000","last_fullsized":"2024-04-25T02:07:28.159404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.163409+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:07:28.163409+0000","last_peered":"2024-04-25T02:07:28.163409+0000","last_clean":"2024-04-25T02:07:28.163409+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:07:28.163409+0000","last_undegraded":"2024-04-25T02:07:28.163409+0000","last_fullsized":"2024-04-25T02:07:28.163409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409204+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:28.409204+0000","last_peered":"2024-04-25T02:07:28.409204+0000","last_clean":"2024-04-25T02:07:28.409204+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:28.409204+0000","last_undegraded":"2024-04-25T02:07:28.409204+0000","last_fullsized":"2024-04-25T02:07:28.409204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442400+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:27.442400+0000","last_peered":"2024-04-25T02:07:27.442400+0000","last_clean":"2024-04-25T02:07:27.442400+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:27.442400+0000","last_undegraded":"2024-04-25T02:07:27.442400+0000","last_fullsized":"2024-04-25T02:07:27.442400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":100,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:40.514865+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:08:40.514865+0000","last_peered":"2024-04-25T02:08:40.514865+0000","last_clean":"2024-04-25T02:08:40.514865+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:08:40.514865+0000","last_undegraded":"2024-04-25T02:08:40.514865+0000","last_fullsized":"2024-04-25T02:08:40.514865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437496+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:27.437496+0000","last_peered":"2024-04-25T02:07:27.437496+0000","last_clean":"2024-04-25T02:07:27.437496+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:27.437496+0000","last_undegraded":"2024-04-25T02:07:27.437496+0000","last_fullsized":"2024-04-25T02:07:27.437496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447874+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:27.447874+0000","last_peered":"2024-04-25T02:07:27.447874+0000","last_clean":"2024-04-25T02:07:27.447874+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:27.447874+0000","last_undegraded":"2024-04-25T02:07:27.447874+0000","last_fullsized":"2024-04-25T02:07:27.447874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409638+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:28.409638+0000","last_peered":"2024-04-25T02:07:28.409638+0000","last_clean":"2024-04-25T02:07:28.409638+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:28.409638+0000","last_undegraded":"2024-04-25T02:07:28.409638+0000","last_fullsized":"2024-04-25T02:07:28.409638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437333+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:27.437333+0000","last_peered":"2024-04-25T02:07:27.437333+0000","last_clean":"2024-04-25T02:07:27.437333+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:27.437333+0000","last_undegraded":"2024-04-25T02:07:27.437333+0000","last_fullsized":"2024-04-25T02:07:27.437333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":214,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:41.527650+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:08:41.527650+0000","last_peered":"2024-04-25T02:08:41.527650+0000","last_clean":"2024-04-25T02:08:41.527650+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:08:41.527650+0000","last_undegraded":"2024-04-25T02:08:41.527650+0000","last_fullsized":"2024-04-25T02:08:41.527650+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60023,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":141,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439450+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:27.439450+0000","last_peered":"2024-04-25T02:07:27.439450+0000","last_clean":"2024-04-25T02:07:27.439450+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:27.439450+0000","last_undegraded":"2024-04-25T02:07:27.439450+0000","last_fullsized":"2024-04-25T02:07:27.439450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159268+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:28.159268+0000","last_peered":"2024-04-25T02:07:28.159268+0000","last_clean":"2024-04-25T02:07:28.159268+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:28.159268+0000","last_undegraded":"2024-04-25T02:07:28.159268+0000","last_fullsized":"2024-04-25T02:07:28.159268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409374+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:28.409374+0000","last_peered":"2024-04-25T02:07:28.409374+0000","last_clean":"2024-04-25T02:07:28.409374+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:28.409374+0000","last_undegraded":"2024-04-25T02:07:28.409374+0000","last_fullsized":"2024-04-25T02:07:28.409374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":104,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:40.534288+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:08:40.534288+0000","last_peered":"2024-04-25T02:08:40.534288+0000","last_clean":"2024-04-25T02:08:40.534288+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:08:40.534288+0000","last_undegraded":"2024-04-25T02:08:40.534288+0000","last_fullsized":"2024-04-25T02:08:40.534288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439210+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:27.439210+0000","last_peered":"2024-04-25T02:07:27.439210+0000","last_clean":"2024-04-25T02:07:27.439210+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:27.439210+0000","last_undegraded":"2024-04-25T02:07:27.439210+0000","last_fullsized":"2024-04-25T02:07:27.439210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409467+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:28.409467+0000","last_peered":"2024-04-25T02:07:28.409467+0000","last_clean":"2024-04-25T02:07:28.409467+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:28.409467+0000","last_undegraded":"2024-04-25T02:07:28.409467+0000","last_fullsized":"2024-04-25T02:07:28.409467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439644+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:27.439644+0000","last_peered":"2024-04-25T02:07:27.439644+0000","last_clean":"2024-04-25T02:07:27.439644+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:27.439644+0000","last_undegraded":"2024-04-25T02:07:27.439644+0000","last_fullsized":"2024-04-25T02:07:27.439644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457333+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:07:27.457333+0000","last_peered":"2024-04-25T02:07:27.457333+0000","last_clean":"2024-04-25T02:07:27.457333+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:07:27.457333+0000","last_undegraded":"2024-04-25T02:07:27.457333+0000","last_fullsized":"2024-04-25T02:07:27.457333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441250+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:27.441250+0000","last_peered":"2024-04-25T02:07:27.441250+0000","last_clean":"2024-04-25T02:07:27.441250+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:27.441250+0000","last_undegraded":"2024-04-25T02:07:27.441250+0000","last_fullsized":"2024-04-25T02:07:27.441250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.454152+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:07:27.454152+0000","last_peered":"2024-04-25T02:07:27.454152+0000","last_clean":"2024-04-25T02:07:27.454152+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:07:27.454152+0000","last_undegraded":"2024-04-25T02:07:27.454152+0000","last_fullsized":"2024-04-25T02:07:27.454152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409617+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:28.409617+0000","last_peered":"2024-04-25T02:07:28.409617+0000","last_clean":"2024-04-25T02:07:28.409617+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:28.409617+0000","last_undegraded":"2024-04-25T02:07:28.409617+0000","last_fullsized":"2024-04-25T02:07:28.409617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":103,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:42.537206+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:08:42.537206+0000","last_peered":"2024-04-25T02:08:42.537206+0000","last_clean":"2024-04-25T02:08:42.537206+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:08:42.537206+0000","last_undegraded":"2024-04-25T02:08:42.537206+0000","last_fullsized":"2024-04-25T02:08:42.537206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451462+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:27.451462+0000","last_peered":"2024-04-25T02:07:27.451462+0000","last_clean":"2024-04-25T02:07:27.451462+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:27.451462+0000","last_undegraded":"2024-04-25T02:07:27.451462+0000","last_fullsized":"2024-04-25T02:07:27.451462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335930+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:28.335930+0000","last_peered":"2024-04-25T02:07:28.335930+0000","last_clean":"2024-04-25T02:07:28.335930+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:28.335930+0000","last_undegraded":"2024-04-25T02:07:28.335930+0000","last_fullsized":"2024-04-25T02:07:28.335930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445142+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445142+0000","last_peered":"2024-04-25T02:07:27.445142+0000","last_clean":"2024-04-25T02:07:27.445142+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445142+0000","last_undegraded":"2024-04-25T02:07:27.445142+0000","last_fullsized":"2024-04-25T02:07:27.445142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159027+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:28.159027+0000","last_peered":"2024-04-25T02:07:28.159027+0000","last_clean":"2024-04-25T02:07:28.159027+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:28.159027+0000","last_undegraded":"2024-04-25T02:07:28.159027+0000","last_fullsized":"2024-04-25T02:07:28.159027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439510+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:27.439510+0000","last_peered":"2024-04-25T02:07:27.439510+0000","last_clean":"2024-04-25T02:07:27.439510+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:27.439510+0000","last_undegraded":"2024-04-25T02:07:27.439510+0000","last_fullsized":"2024-04-25T02:07:27.439510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159617+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:28.159617+0000","last_peered":"2024-04-25T02:07:28.159617+0000","last_clean":"2024-04-25T02:07:28.159617+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:28.159617+0000","last_undegraded":"2024-04-25T02:07:28.159617+0000","last_fullsized":"2024-04-25T02:07:28.159617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:31.406619+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:31.406619+0000","last_peered":"2024-04-25T02:07:31.406619+0000","last_clean":"2024-04-25T02:07:31.406619+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:31.406619+0000","last_undegraded":"2024-04-25T02:07:31.406619+0000","last_fullsized":"2024-04-25T02:07:31.406619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457822+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:27.457822+0000","last_peered":"2024-04-25T02:07:27.457822+0000","last_clean":"2024-04-25T02:07:27.457822+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:27.457822+0000","last_undegraded":"2024-04-25T02:07:27.457822+0000","last_fullsized":"2024-04-25T02:07:27.457822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.336281+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:28.336281+0000","last_peered":"2024-04-25T02:07:28.336281+0000","last_clean":"2024-04-25T02:07:28.336281+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:28.336281+0000","last_undegraded":"2024-04-25T02:07:28.336281+0000","last_fullsized":"2024-04-25T02:07:28.336281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447383+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:27.447383+0000","last_peered":"2024-04-25T02:07:27.447383+0000","last_clean":"2024-04-25T02:07:27.447383+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:27.447383+0000","last_undegraded":"2024-04-25T02:07:27.447383+0000","last_fullsized":"2024-04-25T02:07:27.447383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437102+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:27.437102+0000","last_peered":"2024-04-25T02:07:27.437102+0000","last_clean":"2024-04-25T02:07:27.437102+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:27.437102+0000","last_undegraded":"2024-04-25T02:07:27.437102+0000","last_fullsized":"2024-04-25T02:07:27.437102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439160+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:27.439160+0000","last_peered":"2024-04-25T02:07:27.439160+0000","last_clean":"2024-04-25T02:07:27.439160+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:27.439160+0000","last_undegraded":"2024-04-25T02:07:27.439160+0000","last_fullsized":"2024-04-25T02:07:27.439160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452101+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:27.452101+0000","last_peered":"2024-04-25T02:07:27.452101+0000","last_clean":"2024-04-25T02:07:27.452101+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:27.452101+0000","last_undegraded":"2024-04-25T02:07:27.452101+0000","last_fullsized":"2024-04-25T02:07:27.452101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443699+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:27.443699+0000","last_peered":"2024-04-25T02:07:27.443699+0000","last_clean":"2024-04-25T02:07:27.443699+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:27.443699+0000","last_undegraded":"2024-04-25T02:07:27.443699+0000","last_fullsized":"2024-04-25T02:07:27.443699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452950+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:27.452950+0000","last_peered":"2024-04-25T02:07:27.452950+0000","last_clean":"2024-04-25T02:07:27.452950+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:27.452950+0000","last_undegraded":"2024-04-25T02:07:27.452950+0000","last_fullsized":"2024-04-25T02:07:27.452950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439460+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:27.439460+0000","last_peered":"2024-04-25T02:07:27.439460+0000","last_clean":"2024-04-25T02:07:27.439460+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:27.439460+0000","last_undegraded":"2024-04-25T02:07:27.439460+0000","last_fullsized":"2024-04-25T02:07:27.439460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444042+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:27.444042+0000","last_peered":"2024-04-25T02:07:27.444042+0000","last_clean":"2024-04-25T02:07:27.444042+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:27.444042+0000","last_undegraded":"2024-04-25T02:07:27.444042+0000","last_fullsized":"2024-04-25T02:07:27.444042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409505+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:28.409505+0000","last_peered":"2024-04-25T02:07:28.409505+0000","last_clean":"2024-04-25T02:07:28.409505+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:28.409505+0000","last_undegraded":"2024-04-25T02:07:28.409505+0000","last_fullsized":"2024-04-25T02:07:28.409505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.160117+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:28.160117+0000","last_peered":"2024-04-25T02:07:28.160117+0000","last_clean":"2024-04-25T02:07:28.160117+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:28.160117+0000","last_undegraded":"2024-04-25T02:07:28.160117+0000","last_fullsized":"2024-04-25T02:07:28.160117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443677+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:27.443677+0000","last_peered":"2024-04-25T02:07:27.443677+0000","last_clean":"2024-04-25T02:07:27.443677+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:27.443677+0000","last_undegraded":"2024-04-25T02:07:27.443677+0000","last_fullsized":"2024-04-25T02:07:27.443677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443549+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:27.443549+0000","last_peered":"2024-04-25T02:07:27.443549+0000","last_clean":"2024-04-25T02:07:27.443549+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:27.443549+0000","last_undegraded":"2024-04-25T02:07:27.443549+0000","last_fullsized":"2024-04-25T02:07:27.443549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444582+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:27.444582+0000","last_peered":"2024-04-25T02:07:27.444582+0000","last_clean":"2024-04-25T02:07:27.444582+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:27.444582+0000","last_undegraded":"2024-04-25T02:07:27.444582+0000","last_fullsized":"2024-04-25T02:07:27.444582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159864+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:28.159864+0000","last_peered":"2024-04-25T02:07:28.159864+0000","last_clean":"2024-04-25T02:07:28.159864+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:28.159864+0000","last_undegraded":"2024-04-25T02:07:28.159864+0000","last_fullsized":"2024-04-25T02:07:28.159864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444698+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:27.444698+0000","last_peered":"2024-04-25T02:07:27.444698+0000","last_clean":"2024-04-25T02:07:27.444698+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:27.444698+0000","last_undegraded":"2024-04-25T02:07:27.444698+0000","last_fullsized":"2024-04-25T02:07:27.444698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457698+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:27.457698+0000","last_peered":"2024-04-25T02:07:27.457698+0000","last_clean":"2024-04-25T02:07:27.457698+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:27.457698+0000","last_undegraded":"2024-04-25T02:07:27.457698+0000","last_fullsized":"2024-04-25T02:07:27.457698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409458+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:28.409458+0000","last_peered":"2024-04-25T02:07:28.409458+0000","last_clean":"2024-04-25T02:07:28.409458+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:28.409458+0000","last_undegraded":"2024-04-25T02:07:28.409458+0000","last_fullsized":"2024-04-25T02:07:28.409458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451968+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:27.451968+0000","last_peered":"2024-04-25T02:07:27.451968+0000","last_clean":"2024-04-25T02:07:27.451968+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:27.451968+0000","last_undegraded":"2024-04-25T02:07:27.451968+0000","last_fullsized":"2024-04-25T02:07:27.451968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437218+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:27.437218+0000","last_peered":"2024-04-25T02:07:27.437218+0000","last_clean":"2024-04-25T02:07:27.437218+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:27.437218+0000","last_undegraded":"2024-04-25T02:07:27.437218+0000","last_fullsized":"2024-04-25T02:07:27.437218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159757+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:28.159757+0000","last_peered":"2024-04-25T02:07:28.159757+0000","last_clean":"2024-04-25T02:07:28.159757+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:28.159757+0000","last_undegraded":"2024-04-25T02:07:28.159757+0000","last_fullsized":"2024-04-25T02:07:28.159757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64415,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":502,"num_read_kb":319,"num_write":159,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":456231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645348,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1638400,"data_stored":1108092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":455771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332149,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":455822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1007616,"data_stored":515638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":966656,"data_stored":457093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":517345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":457232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1564672,"data_stored":1047967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:48.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T02:08:48.533 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:48.800 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:48 smithi137 ceph-mon[28303]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:48.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:48 smithi163 ceph-mon[32577]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:48.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:48 smithi174 ceph-mon[33171]: from='client.24899 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:49.678 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:49 smithi137 ceph-mon[28303]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:49.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:49 smithi163 ceph-mon[32577]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:49.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:49 smithi174 ceph-mon[33171]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:50.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 -- 172.21.15.137:0/1697893483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154074d80 msgr2=0x7fe154112ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 --2- 172.21.15.137:0/1697893483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154074d80 0x7fe154112ec0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe140009990 tx=0x7fe140009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 -- 172.21.15.137:0/1697893483 shutdown_connections 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 --2- 172.21.15.137:0/1697893483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074460 0x7fe154074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 --2- 172.21.15.137:0/1697893483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154113400 0x7fe1541157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.500+0000 7fe15c000700 1 --2- 172.21.15.137:0/1697893483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154074d80 0x7fe154112ec0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.501+0000 7fe15c000700 1 -- 172.21.15.137:0/1697893483 >> 172.21.15.137:0/1697893483 conn(0x7fe154079390 msgr2=0x7fe1540797a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.501+0000 7fe15c000700 1 -- 172.21.15.137:0/1697893483 shutdown_connections 2024-04-25T02:08:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.501+0000 7fe15c000700 1 -- 172.21.15.137:0/1697893483 wait complete. 2024-04-25T02:08:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 Processor -- start 2024-04-25T02:08:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 -- start start 2024-04-25T02:08:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 0x7fe1541a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe154118cb0 con 0x7fe154074460 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe154118b30 con 0x7fe154074d80 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.502+0000 7fe15c000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe154118e30 con 0x7fe154113400 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe159600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe158c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe159600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43480/0 (socket says 172.21.15.137:43480) 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe158c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:48408/0 (socket says 172.21.15.137:48408) 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe159600700 1 -- 172.21.15.137:0/2068893541 learned_addr learned my addr 172.21.15.137:0/2068893541 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 0x7fe1541a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 -- 172.21.15.137:0/2068893541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 msgr2=0x7fe15419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 -- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 msgr2=0x7fe15419f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 -- 172.21.15.137:0/2068893541 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1541a40d0 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe158c00700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe159600700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.503+0000 7fe15a000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 0x7fe1541a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00ef90 tx=0x7fe14c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.504+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0092e0 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.504+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe14c004bb0 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.504+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1541a4360 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.504+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c004260 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.504+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1541abc40 con 0x7fe154113400 2024-04-25T02:08:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.505+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe154068f20 con 0x7fe154113400 2024-04-25T02:08:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.507+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe14c01b030 con 0x7fe154113400 2024-04-25T02:08:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.508+0000 7fe152000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 0x7fe13c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.508+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe14c0ceca0 con 0x7fe154113400 2024-04-25T02:08:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.509+0000 7fe159600700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 0x7fe13c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.509+0000 7fe159600700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 0x7fe13c0a51f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe148011590 tx=0x7fe148009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:50.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.513+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe14c022020 con 0x7fe154113400 2024-04-25T02:08:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.733+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1541128d0 con 0x7fe13c0a2d30 2024-04-25T02:08:50.741 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:50 smithi137 ceph-mon[28303]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:50.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.755+0000 7fe152000700 1 -- 172.21.15.137:0/2068893541 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258721 (secure 0 0 0) 0x7fe1541128d0 con 0x7fe13c0a2d30 2024-04-25T02:08:50.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 msgr2=0x7fe13c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 0x7fe13c0a51f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe148011590 tx=0x7fe148009260 comp rx=0 tx=0).stop 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 msgr2=0x7fe1541a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 0x7fe1541a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00ef90 tx=0x7fe14c00c3a0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 shutdown_connections 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe13c0a2d30 0x7fe13c0a51f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe154113400 0x7fe1541a3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe154074460 0x7fe15419f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 --2- 172.21.15.137:0/2068893541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe154074d80 0x7fe15419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 >> 172.21.15.137:0/2068893541 conn(0x7fe154079390 msgr2=0x7fe1541121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 shutdown_connections 2024-04-25T02:08:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:50.761+0000 7fe15c000700 1 -- 172.21.15.137:0/2068893541 wait complete. 2024-04-25T02:08:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:08:50.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:50 smithi163 ceph-mon[32577]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:50.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:50 smithi174 ceph-mon[33171]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:51.557 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-04-25T02:08:50.409055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655017,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":668,"num_read_kb":453,"num_write":342,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370660,"kb_used_data":13164,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571164,"statfs":{"total":1151940427776,"available":1151560871936,"internally_reserved":0,"allocated":13479936,"data_stored":7432431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004247"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441967+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:07:27.441967+0000","last_peered":"2024-04-25T02:07:27.441967+0000","last_clean":"2024-04-25T02:07:27.441967+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:07:27.441967+0000","last_undegraded":"2024-04-25T02:07:27.441967+0000","last_fullsized":"2024-04-25T02:07:27.441967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447270+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:07:27.447270+0000","last_peered":"2024-04-25T02:07:27.447270+0000","last_clean":"2024-04-25T02:07:27.447270+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:07:27.447270+0000","last_undegraded":"2024-04-25T02:07:27.447270+0000","last_fullsized":"2024-04-25T02:07:27.447270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.446666+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:07:27.446666+0000","last_peered":"2024-04-25T02:07:27.446666+0000","last_clean":"2024-04-25T02:07:27.446666+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:07:27.446666+0000","last_undegraded":"2024-04-25T02:07:27.446666+0000","last_fullsized":"2024-04-25T02:07:27.446666+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335780+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:07:28.335780+0000","last_peered":"2024-04-25T02:07:28.335780+0000","last_clean":"2024-04-25T02:07:28.335780+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:07:28.335780+0000","last_undegraded":"2024-04-25T02:07:28.335780+0000","last_fullsized":"2024-04-25T02:07:28.335780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439308+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:07:27.439308+0000","last_peered":"2024-04-25T02:07:27.439308+0000","last_clean":"2024-04-25T02:07:27.439308+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:07:27.439308+0000","last_undegraded":"2024-04-25T02:07:27.439308+0000","last_fullsized":"2024-04-25T02:07:27.439308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441104+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:07:27.441104+0000","last_peered":"2024-04-25T02:07:27.441104+0000","last_clean":"2024-04-25T02:07:27.441104+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:07:27.441104+0000","last_undegraded":"2024-04-25T02:07:27.441104+0000","last_fullsized":"2024-04-25T02:07:27.441104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444740+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:07:27.444740+0000","last_peered":"2024-04-25T02:07:27.444740+0000","last_clean":"2024-04-25T02:07:27.444740+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:07:27.444740+0000","last_undegraded":"2024-04-25T02:07:27.444740+0000","last_fullsized":"2024-04-25T02:07:27.444740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452349+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:07:27.452349+0000","last_peered":"2024-04-25T02:07:27.452349+0000","last_clean":"2024-04-25T02:07:27.452349+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:07:27.452349+0000","last_undegraded":"2024-04-25T02:07:27.452349+0000","last_fullsized":"2024-04-25T02:07:27.452349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.162662+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:07:28.162662+0000","last_peered":"2024-04-25T02:07:28.162662+0000","last_clean":"2024-04-25T02:07:28.162662+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:07:28.162662+0000","last_undegraded":"2024-04-25T02:07:28.162662+0000","last_fullsized":"2024-04-25T02:07:28.162662+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441483+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:07:27.441483+0000","last_peered":"2024-04-25T02:07:27.441483+0000","last_clean":"2024-04-25T02:07:27.441483+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:07:27.441483+0000","last_undegraded":"2024-04-25T02:07:27.441483+0000","last_fullsized":"2024-04-25T02:07:27.441483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445154+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:07:27.445154+0000","last_peered":"2024-04-25T02:07:27.445154+0000","last_clean":"2024-04-25T02:07:27.445154+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:07:27.445154+0000","last_undegraded":"2024-04-25T02:07:27.445154+0000","last_fullsized":"2024-04-25T02:07:27.445154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335695+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:07:28.335695+0000","last_peered":"2024-04-25T02:07:28.335695+0000","last_clean":"2024-04-25T02:07:28.335695+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:07:28.335695+0000","last_undegraded":"2024-04-25T02:07:28.335695+0000","last_fullsized":"2024-04-25T02:07:28.335695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159865+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:07:28.159865+0000","last_peered":"2024-04-25T02:07:28.159865+0000","last_clean":"2024-04-25T02:07:28.159865+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:07:28.159865+0000","last_undegraded":"2024-04-25T02:07:28.159865+0000","last_fullsized":"2024-04-25T02:07:28.159865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445435+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:07:27.445435+0000","last_peered":"2024-04-25T02:07:27.445435+0000","last_clean":"2024-04-25T02:07:27.445435+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:07:27.445435+0000","last_undegraded":"2024-04-25T02:07:27.445435+0000","last_fullsized":"2024-04-25T02:07:27.445435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457403+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:07:27.457403+0000","last_peered":"2024-04-25T02:07:27.457403+0000","last_clean":"2024-04-25T02:07:27.457403+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:07:27.457403+0000","last_undegraded":"2024-04-25T02:07:27.457403+0000","last_fullsized":"2024-04-25T02:07:27.457403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437030+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:07:27.437030+0000","last_peered":"2024-04-25T02:07:27.437030+0000","last_clean":"2024-04-25T02:07:27.437030+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:07:27.437030+0000","last_undegraded":"2024-04-25T02:07:27.437030+0000","last_fullsized":"2024-04-25T02:07:27.437030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442092+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:07:27.442092+0000","last_peered":"2024-04-25T02:07:27.442092+0000","last_clean":"2024-04-25T02:07:27.442092+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:07:27.442092+0000","last_undegraded":"2024-04-25T02:07:27.442092+0000","last_fullsized":"2024-04-25T02:07:27.442092+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442889+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:07:27.442889+0000","last_peered":"2024-04-25T02:07:27.442889+0000","last_clean":"2024-04-25T02:07:27.442889+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:07:27.442889+0000","last_undegraded":"2024-04-25T02:07:27.442889+0000","last_fullsized":"2024-04-25T02:07:27.442889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444246+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:07:27.444246+0000","last_peered":"2024-04-25T02:07:27.444246+0000","last_clean":"2024-04-25T02:07:27.444246+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:07:27.444246+0000","last_undegraded":"2024-04-25T02:07:27.444246+0000","last_fullsized":"2024-04-25T02:07:27.444246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.345920+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:07:28.345920+0000","last_peered":"2024-04-25T02:07:28.345920+0000","last_clean":"2024-04-25T02:07:28.345920+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:07:28.345920+0000","last_undegraded":"2024-04-25T02:07:28.345920+0000","last_fullsized":"2024-04-25T02:07:28.345920+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.455141+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:07:27.455141+0000","last_peered":"2024-04-25T02:07:27.455141+0000","last_clean":"2024-04-25T02:07:27.455141+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:07:27.455141+0000","last_undegraded":"2024-04-25T02:07:27.455141+0000","last_fullsized":"2024-04-25T02:07:27.455141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.458218+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:07:27.458218+0000","last_peered":"2024-04-25T02:07:27.458218+0000","last_clean":"2024-04-25T02:07:27.458218+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:07:27.458218+0000","last_undegraded":"2024-04-25T02:07:27.458218+0000","last_fullsized":"2024-04-25T02:07:27.458218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.448024+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:07:27.448024+0000","last_peered":"2024-04-25T02:07:27.448024+0000","last_clean":"2024-04-25T02:07:27.448024+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:07:27.448024+0000","last_undegraded":"2024-04-25T02:07:27.448024+0000","last_fullsized":"2024-04-25T02:07:27.448024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439635+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:07:27.439635+0000","last_peered":"2024-04-25T02:07:27.439635+0000","last_clean":"2024-04-25T02:07:27.439635+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:07:27.439635+0000","last_undegraded":"2024-04-25T02:07:27.439635+0000","last_fullsized":"2024-04-25T02:07:27.439635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437171+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:07:27.437171+0000","last_peered":"2024-04-25T02:07:27.437171+0000","last_clean":"2024-04-25T02:07:27.437171+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:07:27.437171+0000","last_undegraded":"2024-04-25T02:07:27.437171+0000","last_fullsized":"2024-04-25T02:07:27.437171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439586+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:07:27.439586+0000","last_peered":"2024-04-25T02:07:27.439586+0000","last_clean":"2024-04-25T02:07:27.439586+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:07:27.439586+0000","last_undegraded":"2024-04-25T02:07:27.439586+0000","last_fullsized":"2024-04-25T02:07:27.439586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409529+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:07:28.409529+0000","last_peered":"2024-04-25T02:07:28.409529+0000","last_clean":"2024-04-25T02:07:28.409529+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:07:28.409529+0000","last_undegraded":"2024-04-25T02:07:28.409529+0000","last_fullsized":"2024-04-25T02:07:28.409529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:48.526867+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:08:48.526867+0000","last_peered":"2024-04-25T02:08:48.526867+0000","last_clean":"2024-04-25T02:08:48.526867+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:08:48.526867+0000","last_undegraded":"2024-04-25T02:08:48.526867+0000","last_fullsized":"2024-04-25T02:08:48.526867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439297+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:07:27.439297+0000","last_peered":"2024-04-25T02:07:27.439297+0000","last_clean":"2024-04-25T02:07:27.439297+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:07:27.439297+0000","last_undegraded":"2024-04-25T02:07:27.439297+0000","last_fullsized":"2024-04-25T02:07:27.439297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441062+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:07:27.441062+0000","last_peered":"2024-04-25T02:07:27.441062+0000","last_clean":"2024-04-25T02:07:27.441062+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:07:27.441062+0000","last_undegraded":"2024-04-25T02:07:27.441062+0000","last_fullsized":"2024-04-25T02:07:27.441062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409368+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:07:28.409368+0000","last_peered":"2024-04-25T02:07:28.409368+0000","last_clean":"2024-04-25T02:07:28.409368+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:07:28.409368+0000","last_undegraded":"2024-04-25T02:07:28.409368+0000","last_fullsized":"2024-04-25T02:07:28.409368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159404+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:07:28.159404+0000","last_peered":"2024-04-25T02:07:28.159404+0000","last_clean":"2024-04-25T02:07:28.159404+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:07:28.159404+0000","last_undegraded":"2024-04-25T02:07:28.159404+0000","last_fullsized":"2024-04-25T02:07:28.159404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.163409+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:07:28.163409+0000","last_peered":"2024-04-25T02:07:28.163409+0000","last_clean":"2024-04-25T02:07:28.163409+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:07:28.163409+0000","last_undegraded":"2024-04-25T02:07:28.163409+0000","last_fullsized":"2024-04-25T02:07:28.163409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409204+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:07:28.409204+0000","last_peered":"2024-04-25T02:07:28.409204+0000","last_clean":"2024-04-25T02:07:28.409204+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:07:28.409204+0000","last_undegraded":"2024-04-25T02:07:28.409204+0000","last_fullsized":"2024-04-25T02:07:28.409204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.442400+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:07:27.442400+0000","last_peered":"2024-04-25T02:07:27.442400+0000","last_clean":"2024-04-25T02:07:27.442400+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:07:27.442400+0000","last_undegraded":"2024-04-25T02:07:27.442400+0000","last_fullsized":"2024-04-25T02:07:27.442400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":105,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:45.522411+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:08:45.522411+0000","last_peered":"2024-04-25T02:08:45.522411+0000","last_clean":"2024-04-25T02:08:45.522411+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:08:45.522411+0000","last_undegraded":"2024-04-25T02:08:45.522411+0000","last_fullsized":"2024-04-25T02:08:45.522411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437496+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:07:27.437496+0000","last_peered":"2024-04-25T02:07:27.437496+0000","last_clean":"2024-04-25T02:07:27.437496+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:07:27.437496+0000","last_undegraded":"2024-04-25T02:07:27.437496+0000","last_fullsized":"2024-04-25T02:07:27.437496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445110+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:07:27.445110+0000","last_peered":"2024-04-25T02:07:27.445110+0000","last_clean":"2024-04-25T02:07:27.445110+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:07:27.445110+0000","last_undegraded":"2024-04-25T02:07:27.445110+0000","last_fullsized":"2024-04-25T02:07:27.445110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447874+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:07:27.447874+0000","last_peered":"2024-04-25T02:07:27.447874+0000","last_clean":"2024-04-25T02:07:27.447874+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:07:27.447874+0000","last_undegraded":"2024-04-25T02:07:27.447874+0000","last_fullsized":"2024-04-25T02:07:27.447874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409638+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:07:28.409638+0000","last_peered":"2024-04-25T02:07:28.409638+0000","last_clean":"2024-04-25T02:07:28.409638+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:07:28.409638+0000","last_undegraded":"2024-04-25T02:07:28.409638+0000","last_fullsized":"2024-04-25T02:07:28.409638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437333+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:07:27.437333+0000","last_peered":"2024-04-25T02:07:27.437333+0000","last_clean":"2024-04-25T02:07:27.437333+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:07:27.437333+0000","last_undegraded":"2024-04-25T02:07:27.437333+0000","last_fullsized":"2024-04-25T02:07:27.437333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":224,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:46.535373+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:08:46.535373+0000","last_peered":"2024-04-25T02:08:46.535373+0000","last_clean":"2024-04-25T02:08:46.535373+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:08:46.535373+0000","last_undegraded":"2024-04-25T02:08:46.535373+0000","last_fullsized":"2024-04-25T02:08:46.535373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60023,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":146,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439450+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:07:27.439450+0000","last_peered":"2024-04-25T02:07:27.439450+0000","last_clean":"2024-04-25T02:07:27.439450+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:07:27.439450+0000","last_undegraded":"2024-04-25T02:07:27.439450+0000","last_fullsized":"2024-04-25T02:07:27.439450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.465744+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:07:27.465744+0000","last_peered":"2024-04-25T02:07:27.465744+0000","last_clean":"2024-04-25T02:07:27.465744+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:07:27.465744+0000","last_undegraded":"2024-04-25T02:07:27.465744+0000","last_fullsized":"2024-04-25T02:07:27.465744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159268+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:07:28.159268+0000","last_peered":"2024-04-25T02:07:28.159268+0000","last_clean":"2024-04-25T02:07:28.159268+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:07:28.159268+0000","last_undegraded":"2024-04-25T02:07:28.159268+0000","last_fullsized":"2024-04-25T02:07:28.159268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409374+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:07:28.409374+0000","last_peered":"2024-04-25T02:07:28.409374+0000","last_clean":"2024-04-25T02:07:28.409374+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:07:28.409374+0000","last_undegraded":"2024-04-25T02:07:28.409374+0000","last_fullsized":"2024-04-25T02:07:28.409374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444978+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:07:27.444978+0000","last_peered":"2024-04-25T02:07:27.444978+0000","last_clean":"2024-04-25T02:07:27.444978+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:07:27.444978+0000","last_undegraded":"2024-04-25T02:07:27.444978+0000","last_fullsized":"2024-04-25T02:07:27.444978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":109,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:45.543054+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:08:45.543054+0000","last_peered":"2024-04-25T02:08:45.543054+0000","last_clean":"2024-04-25T02:08:45.543054+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:08:45.543054+0000","last_undegraded":"2024-04-25T02:08:45.543054+0000","last_fullsized":"2024-04-25T02:08:45.543054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":87,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444671+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:07:27.444671+0000","last_peered":"2024-04-25T02:07:27.444671+0000","last_clean":"2024-04-25T02:07:27.444671+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:07:27.444671+0000","last_undegraded":"2024-04-25T02:07:27.444671+0000","last_fullsized":"2024-04-25T02:07:27.444671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439210+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:07:27.439210+0000","last_peered":"2024-04-25T02:07:27.439210+0000","last_clean":"2024-04-25T02:07:27.439210+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:07:27.439210+0000","last_undegraded":"2024-04-25T02:07:27.439210+0000","last_fullsized":"2024-04-25T02:07:27.439210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409467+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:07:28.409467+0000","last_peered":"2024-04-25T02:07:28.409467+0000","last_clean":"2024-04-25T02:07:28.409467+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:07:28.409467+0000","last_undegraded":"2024-04-25T02:07:28.409467+0000","last_fullsized":"2024-04-25T02:07:28.409467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439644+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:07:27.439644+0000","last_peered":"2024-04-25T02:07:27.439644+0000","last_clean":"2024-04-25T02:07:27.439644+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:07:27.439644+0000","last_undegraded":"2024-04-25T02:07:27.439644+0000","last_fullsized":"2024-04-25T02:07:27.439644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441600+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:07:27.441600+0000","last_peered":"2024-04-25T02:07:27.441600+0000","last_clean":"2024-04-25T02:07:27.441600+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:07:27.441600+0000","last_undegraded":"2024-04-25T02:07:27.441600+0000","last_fullsized":"2024-04-25T02:07:27.441600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457333+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:07:27.457333+0000","last_peered":"2024-04-25T02:07:27.457333+0000","last_clean":"2024-04-25T02:07:27.457333+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:07:27.457333+0000","last_undegraded":"2024-04-25T02:07:27.457333+0000","last_fullsized":"2024-04-25T02:07:27.457333+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441250+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:07:27.441250+0000","last_peered":"2024-04-25T02:07:27.441250+0000","last_clean":"2024-04-25T02:07:27.441250+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:07:27.441250+0000","last_undegraded":"2024-04-25T02:07:27.441250+0000","last_fullsized":"2024-04-25T02:07:27.441250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445004+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:07:27.445004+0000","last_peered":"2024-04-25T02:07:27.445004+0000","last_clean":"2024-04-25T02:07:27.445004+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:07:27.445004+0000","last_undegraded":"2024-04-25T02:07:27.445004+0000","last_fullsized":"2024-04-25T02:07:27.445004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.454152+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:07:27.454152+0000","last_peered":"2024-04-25T02:07:27.454152+0000","last_clean":"2024-04-25T02:07:27.454152+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:07:27.454152+0000","last_undegraded":"2024-04-25T02:07:27.454152+0000","last_fullsized":"2024-04-25T02:07:27.454152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409617+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:07:28.409617+0000","last_peered":"2024-04-25T02:07:28.409617+0000","last_clean":"2024-04-25T02:07:28.409617+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:07:28.409617+0000","last_undegraded":"2024-04-25T02:07:28.409617+0000","last_fullsized":"2024-04-25T02:07:28.409617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:08:47.546142+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:08:47.546142+0000","last_peered":"2024-04-25T02:08:47.546142+0000","last_clean":"2024-04-25T02:08:47.546142+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:08:47.546142+0000","last_undegraded":"2024-04-25T02:08:47.546142+0000","last_fullsized":"2024-04-25T02:08:47.546142+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451462+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:07:27.451462+0000","last_peered":"2024-04-25T02:07:27.451462+0000","last_clean":"2024-04-25T02:07:27.451462+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:07:27.451462+0000","last_undegraded":"2024-04-25T02:07:27.451462+0000","last_fullsized":"2024-04-25T02:07:27.451462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.335930+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:07:28.335930+0000","last_peered":"2024-04-25T02:07:28.335930+0000","last_clean":"2024-04-25T02:07:28.335930+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:07:28.335930+0000","last_undegraded":"2024-04-25T02:07:28.335930+0000","last_fullsized":"2024-04-25T02:07:28.335930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445142+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:07:27.445142+0000","last_peered":"2024-04-25T02:07:27.445142+0000","last_clean":"2024-04-25T02:07:27.445142+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:07:27.445142+0000","last_undegraded":"2024-04-25T02:07:27.445142+0000","last_fullsized":"2024-04-25T02:07:27.445142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159027+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:07:28.159027+0000","last_peered":"2024-04-25T02:07:28.159027+0000","last_clean":"2024-04-25T02:07:28.159027+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:07:28.159027+0000","last_undegraded":"2024-04-25T02:07:28.159027+0000","last_fullsized":"2024-04-25T02:07:28.159027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444994+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:07:27.444994+0000","last_peered":"2024-04-25T02:07:27.444994+0000","last_clean":"2024-04-25T02:07:27.444994+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:07:27.444994+0000","last_undegraded":"2024-04-25T02:07:27.444994+0000","last_fullsized":"2024-04-25T02:07:27.444994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439510+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:07:27.439510+0000","last_peered":"2024-04-25T02:07:27.439510+0000","last_clean":"2024-04-25T02:07:27.439510+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:07:27.439510+0000","last_undegraded":"2024-04-25T02:07:27.439510+0000","last_fullsized":"2024-04-25T02:07:27.439510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159617+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:07:28.159617+0000","last_peered":"2024-04-25T02:07:28.159617+0000","last_clean":"2024-04-25T02:07:28.159617+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:07:28.159617+0000","last_undegraded":"2024-04-25T02:07:28.159617+0000","last_fullsized":"2024-04-25T02:07:28.159617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:31.406619+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:07:31.406619+0000","last_peered":"2024-04-25T02:07:31.406619+0000","last_clean":"2024-04-25T02:07:31.406619+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:07:31.406619+0000","last_undegraded":"2024-04-25T02:07:31.406619+0000","last_fullsized":"2024-04-25T02:07:31.406619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457822+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:07:27.457822+0000","last_peered":"2024-04-25T02:07:27.457822+0000","last_clean":"2024-04-25T02:07:27.457822+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:07:27.457822+0000","last_undegraded":"2024-04-25T02:07:27.457822+0000","last_fullsized":"2024-04-25T02:07:27.457822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.336281+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:07:28.336281+0000","last_peered":"2024-04-25T02:07:28.336281+0000","last_clean":"2024-04-25T02:07:28.336281+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:07:28.336281+0000","last_undegraded":"2024-04-25T02:07:28.336281+0000","last_fullsized":"2024-04-25T02:07:28.336281+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447383+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:07:27.447383+0000","last_peered":"2024-04-25T02:07:27.447383+0000","last_clean":"2024-04-25T02:07:27.447383+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:07:27.447383+0000","last_undegraded":"2024-04-25T02:07:27.447383+0000","last_fullsized":"2024-04-25T02:07:27.447383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437102+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:07:27.437102+0000","last_peered":"2024-04-25T02:07:27.437102+0000","last_clean":"2024-04-25T02:07:27.437102+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:07:27.437102+0000","last_undegraded":"2024-04-25T02:07:27.437102+0000","last_fullsized":"2024-04-25T02:07:27.437102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439160+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:07:27.439160+0000","last_peered":"2024-04-25T02:07:27.439160+0000","last_clean":"2024-04-25T02:07:27.439160+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:07:27.439160+0000","last_undegraded":"2024-04-25T02:07:27.439160+0000","last_fullsized":"2024-04-25T02:07:27.439160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452101+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:07:27.452101+0000","last_peered":"2024-04-25T02:07:27.452101+0000","last_clean":"2024-04-25T02:07:27.452101+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:07:27.452101+0000","last_undegraded":"2024-04-25T02:07:27.452101+0000","last_fullsized":"2024-04-25T02:07:27.452101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441118+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:07:27.441118+0000","last_peered":"2024-04-25T02:07:27.441118+0000","last_clean":"2024-04-25T02:07:27.441118+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:07:27.441118+0000","last_undegraded":"2024-04-25T02:07:27.441118+0000","last_fullsized":"2024-04-25T02:07:27.441118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443699+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:07:27.443699+0000","last_peered":"2024-04-25T02:07:27.443699+0000","last_clean":"2024-04-25T02:07:27.443699+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:07:27.443699+0000","last_undegraded":"2024-04-25T02:07:27.443699+0000","last_fullsized":"2024-04-25T02:07:27.443699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.452950+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:07:27.452950+0000","last_peered":"2024-04-25T02:07:27.452950+0000","last_clean":"2024-04-25T02:07:27.452950+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:07:27.452950+0000","last_undegraded":"2024-04-25T02:07:27.452950+0000","last_fullsized":"2024-04-25T02:07:27.452950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.439460+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:07:27.439460+0000","last_peered":"2024-04-25T02:07:27.439460+0000","last_clean":"2024-04-25T02:07:27.439460+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:07:27.439460+0000","last_undegraded":"2024-04-25T02:07:27.439460+0000","last_fullsized":"2024-04-25T02:07:27.439460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445108+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:07:27.445108+0000","last_peered":"2024-04-25T02:07:27.445108+0000","last_clean":"2024-04-25T02:07:27.445108+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:07:27.445108+0000","last_undegraded":"2024-04-25T02:07:27.445108+0000","last_fullsized":"2024-04-25T02:07:27.445108+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444042+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:07:27.444042+0000","last_peered":"2024-04-25T02:07:27.444042+0000","last_clean":"2024-04-25T02:07:27.444042+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:07:27.444042+0000","last_undegraded":"2024-04-25T02:07:27.444042+0000","last_fullsized":"2024-04-25T02:07:27.444042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445197+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:07:27.445197+0000","last_peered":"2024-04-25T02:07:27.445197+0000","last_clean":"2024-04-25T02:07:27.445197+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:07:27.445197+0000","last_undegraded":"2024-04-25T02:07:27.445197+0000","last_fullsized":"2024-04-25T02:07:27.445197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409505+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:07:28.409505+0000","last_peered":"2024-04-25T02:07:28.409505+0000","last_clean":"2024-04-25T02:07:28.409505+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:07:28.409505+0000","last_undegraded":"2024-04-25T02:07:28.409505+0000","last_fullsized":"2024-04-25T02:07:28.409505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444844+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:07:27.444844+0000","last_peered":"2024-04-25T02:07:27.444844+0000","last_clean":"2024-04-25T02:07:27.444844+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:07:27.444844+0000","last_undegraded":"2024-04-25T02:07:27.444844+0000","last_fullsized":"2024-04-25T02:07:27.444844+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.160117+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:07:28.160117+0000","last_peered":"2024-04-25T02:07:28.160117+0000","last_clean":"2024-04-25T02:07:28.160117+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:07:28.160117+0000","last_undegraded":"2024-04-25T02:07:28.160117+0000","last_fullsized":"2024-04-25T02:07:28.160117+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.445336+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:07:27.445336+0000","last_peered":"2024-04-25T02:07:27.445336+0000","last_clean":"2024-04-25T02:07:27.445336+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:07:27.445336+0000","last_undegraded":"2024-04-25T02:07:27.445336+0000","last_fullsized":"2024-04-25T02:07:27.445336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441301+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:07:27.441301+0000","last_peered":"2024-04-25T02:07:27.441301+0000","last_clean":"2024-04-25T02:07:27.441301+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:07:27.441301+0000","last_undegraded":"2024-04-25T02:07:27.441301+0000","last_fullsized":"2024-04-25T02:07:27.441301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443677+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:07:27.443677+0000","last_peered":"2024-04-25T02:07:27.443677+0000","last_clean":"2024-04-25T02:07:27.443677+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:07:27.443677+0000","last_undegraded":"2024-04-25T02:07:27.443677+0000","last_fullsized":"2024-04-25T02:07:27.443677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.443549+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:07:27.443549+0000","last_peered":"2024-04-25T02:07:27.443549+0000","last_clean":"2024-04-25T02:07:27.443549+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:07:27.443549+0000","last_undegraded":"2024-04-25T02:07:27.443549+0000","last_fullsized":"2024-04-25T02:07:27.443549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444582+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:07:27.444582+0000","last_peered":"2024-04-25T02:07:27.444582+0000","last_clean":"2024-04-25T02:07:27.444582+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:07:27.444582+0000","last_undegraded":"2024-04-25T02:07:27.444582+0000","last_fullsized":"2024-04-25T02:07:27.444582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159864+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:07:28.159864+0000","last_peered":"2024-04-25T02:07:28.159864+0000","last_clean":"2024-04-25T02:07:28.159864+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:07:28.159864+0000","last_undegraded":"2024-04-25T02:07:28.159864+0000","last_fullsized":"2024-04-25T02:07:28.159864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.441622+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:07:27.441622+0000","last_peered":"2024-04-25T02:07:27.441622+0000","last_clean":"2024-04-25T02:07:27.441622+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:07:27.441622+0000","last_undegraded":"2024-04-25T02:07:27.441622+0000","last_fullsized":"2024-04-25T02:07:27.441622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.444698+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:07:27.444698+0000","last_peered":"2024-04-25T02:07:27.444698+0000","last_clean":"2024-04-25T02:07:27.444698+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:07:27.444698+0000","last_undegraded":"2024-04-25T02:07:27.444698+0000","last_fullsized":"2024-04-25T02:07:27.444698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.457698+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:07:27.457698+0000","last_peered":"2024-04-25T02:07:27.457698+0000","last_clean":"2024-04-25T02:07:27.457698+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:07:27.457698+0000","last_undegraded":"2024-04-25T02:07:27.457698+0000","last_fullsized":"2024-04-25T02:07:27.457698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.409458+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:07:28.409458+0000","last_peered":"2024-04-25T02:07:28.409458+0000","last_clean":"2024-04-25T02:07:28.409458+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:07:28.409458+0000","last_undegraded":"2024-04-25T02:07:28.409458+0000","last_fullsized":"2024-04-25T02:07:28.409458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.451968+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:07:27.451968+0000","last_peered":"2024-04-25T02:07:27.451968+0000","last_clean":"2024-04-25T02:07:27.451968+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:07:27.451968+0000","last_undegraded":"2024-04-25T02:07:27.451968+0000","last_fullsized":"2024-04-25T02:07:27.451968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.437218+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:07:27.437218+0000","last_peered":"2024-04-25T02:07:27.437218+0000","last_clean":"2024-04-25T02:07:27.437218+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:07:27.437218+0000","last_undegraded":"2024-04-25T02:07:27.437218+0000","last_fullsized":"2024-04-25T02:07:27.437218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:28.159757+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:07:28.159757+0000","last_peered":"2024-04-25T02:07:28.159757+0000","last_clean":"2024-04-25T02:07:28.159757+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:07:28.159757+0000","last_undegraded":"2024-04-25T02:07:28.159757+0000","last_fullsized":"2024-04-25T02:07:28.159757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T02:07:27.447491+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:07:27.447491+0000","last_peered":"2024-04-25T02:07:27.447491+0000","last_clean":"2024-04-25T02:07:27.447491+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:07:27.447491+0000","last_undegraded":"2024-04-25T02:07:27.447491+0000","last_fullsized":"2024-04-25T02:07:27.447491+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64415,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":532,"num_read_kb":334,"num_write":159,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383714,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":456231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1638400,"data_stored":1108092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":456433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":455771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1552384,"data_stored":1048674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495676,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":455822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":1007616,"data_stored":515638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":966656,"data_stored":457093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1028096,"data_stored":517345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":457232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1564672,"data_stored":1047967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:08:51.561 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T02:08:51.561 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:08:51.561 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:08:51.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T02:08:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:51 smithi174 ceph-mon[33171]: from='client.24943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:51 smithi137 ceph-mon[28303]: from='client.24943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:51 smithi163 ceph-mon[32577]: from='client.24943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:08:52.044 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:08:52.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:52 smithi137 ceph-mon[28303]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:52 smithi163 ceph-mon[32577]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:52.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:52 smithi174 ceph-mon[33171]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:08:54.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 -- 172.21.15.137:0/3996399477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 msgr2=0x7fbb1c108ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 --2- 172.21.15.137:0/3996399477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c108ce0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009990 tx=0x7fbb04009ca0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 -- 172.21.15.137:0/3996399477 shutdown_connections 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 --2- 172.21.15.137:0/3996399477 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c10e860 0x7fbb1c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 --2- 172.21.15.137:0/3996399477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c109220 0x7fbb1c115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 --2- 172.21.15.137:0/3996399477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c108ce0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.997+0000 7fbb21a00700 1 -- 172.21.15.137:0/3996399477 >> 172.21.15.137:0/3996399477 conn(0x7fbb1c075a00 msgr2=0x7fbb1c107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.998+0000 7fbb21a00700 1 -- 172.21.15.137:0/3996399477 shutdown_connections 2024-04-25T02:08:54.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.998+0000 7fbb21a00700 1 -- 172.21.15.137:0/3996399477 wait complete. 2024-04-25T02:08:54.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.999+0000 7fbb21a00700 1 Processor -- start 2024-04-25T02:08:54.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.999+0000 7fbb21a00700 1 -- start start 2024-04-25T02:08:54.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.999+0000 7fbb21a00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c19f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:54.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.999+0000 7fbb21a00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:53.999+0000 7fbb21a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 0x7fbb1c1a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb21a00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c118d60 con 0x7fbb1c10e860 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb21a00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c118be0 con 0x7fbb1c109220 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb21a00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c118ee0 con 0x7fbb1c108860 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb1b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 0x7fbb1c1a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:40082/0 (socket says 172.21.15.137:40082) 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 -- 172.21.15.137:0/272706238 learned_addr learned my addr 172.21.15.137:0/272706238 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:54.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb1aa00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c19f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 -- 172.21.15.137:0/272706238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 msgr2=0x7fbb1c19f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c19f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 -- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 msgr2=0x7fbb1c1a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 0x7fbb1c1a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb13e00700 1 -- 172.21.15.137:0/272706238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c1a4110 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.000+0000 7fbb1b400700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 0x7fbb1c1a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb13e00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb04000c00 tx=0x7fbb04005590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04027070 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1a43a0 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb0400fdc0 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb040173f0 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.001+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1abc80 con 0x7fbb1c109220 2024-04-25T02:08:54.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.002+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c068f20 con 0x7fbb1c109220 2024-04-25T02:08:54.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.004+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbb0402a070 con 0x7fbb1c109220 2024-04-25T02:08:54.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.005+0000 7fbb13400700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 0x7fbb000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:54.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.006+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fbb040cfed0 con 0x7fbb1c109220 2024-04-25T02:08:54.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.006+0000 7fbb1aa00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 0x7fbb000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:54.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.006+0000 7fbb1aa00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 0x7fbb000a5170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009be0 tx=0x7fbb0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:54.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.008+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fbb04013070 con 0x7fbb1c109220 2024-04-25T02:08:54.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.278+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb1c1a0460 con 0x7fbb1c109220 2024-04-25T02:08:54.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.278+0000 7fbb13400700 1 -- 172.21.15.137:0/272706238 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbb0409cd10 con 0x7fbb1c109220 2024-04-25T02:08:54.286 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:54.287 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:08:54.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.281+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 msgr2=0x7fbb000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:54.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.281+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 0x7fbb000a5170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009be0 tx=0x7fbb0c009260 comp rx=0 tx=0).stop 2024-04-25T02:08:54.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.281+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 msgr2=0x7fbb1c19f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:54.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.281+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb04000c00 tx=0x7fbb04005590 comp rx=0 tx=0).stop 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 shutdown_connections 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fbb000a2cb0 0x7fbb000a5170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb1c10e860 0x7fbb1c1a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb1c108860 0x7fbb1c19f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 --2- 172.21.15.137:0/272706238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb1c109220 0x7fbb1c19f690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 >> 172.21.15.137:0/272706238 conn(0x7fbb1c075a00 msgr2=0x7fbb1c075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 shutdown_connections 2024-04-25T02:08:54.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:54.282+0000 7fbb21a00700 1 -- 172.21.15.137:0/272706238 wait complete. 2024-04-25T02:08:54.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:54 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/272706238' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T02:08:54.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:54 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/272706238' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T02:08:54.698 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:54 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/272706238' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T02:08:55.212 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:08:55.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:55.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 -- 172.21.15.137:0/1066026371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0841039c0 msgr2=0x7ff084103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 --2- 172.21.15.137:0/1066026371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0841039c0 0x7ff084103de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff074009ca0 tx=0x7ff07402a8c0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 -- 172.21.15.137:0/1066026371 shutdown_connections 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 --2- 172.21.15.137:0/1066026371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff084105570 0x7ff08410be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 --2- 172.21.15.137:0/1066026371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084104bb0 0x7ff084105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 --2- 172.21.15.137:0/1066026371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0841039c0 0x7ff084103de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.420+0000 7ff08a600640 1 -- 172.21.15.137:0/1066026371 >> 172.21.15.137:0/1066026371 conn(0x7ff0840fef30 msgr2=0x7ff084101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.421+0000 7ff08a600640 1 -- 172.21.15.137:0/1066026371 shutdown_connections 2024-04-25T02:08:55.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.421+0000 7ff08a600640 1 -- 172.21.15.137:0/1066026371 wait complete. 2024-04-25T02:08:55.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.421+0000 7ff08a600640 1 Processor -- start 2024-04-25T02:08:55.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 -- start start 2024-04-25T02:08:55.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff084104bb0 0x7ff08419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 0x7ff0841a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f7c0 con 0x7ff084104bb0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f640 con 0x7ff0841039c0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff08a600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410f940 con 0x7ff084105570 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff083400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff083400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:40112/0 (socket says 172.21.15.137:40112) 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff083400640 1 -- 172.21.15.137:0/3757732211 learned_addr learned my addr 172.21.15.137:0/3757732211 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff07aa00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff084104bb0 0x7ff08419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.422+0000 7ff083e00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 0x7ff0841a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 -- 172.21.15.137:0/3757732211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 msgr2=0x7ff0841a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 0x7ff0841a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 -- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff084104bb0 msgr2=0x7ff08419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff084104bb0 0x7ff08419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 -- 172.21.15.137:0/3757732211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0841a19d0 con 0x7ff0841039c0 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083e00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 0x7ff0841a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:55.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff083400640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff074000f80 tx=0x7ff0740319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074003b70 con 0x7ff0841039c0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0841a1c60 con 0x7ff0841039c0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff074003d10 con 0x7ff0841039c0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07402fd50 con 0x7ff0841039c0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.423+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0841a21b0 con 0x7ff0841039c0 2024-04-25T02:08:55.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.425+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08410ac80 con 0x7ff0841039c0 2024-04-25T02:08:55.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.426+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff074004040 con 0x7ff0841039c0 2024-04-25T02:08:55.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.428+0000 7ff080c00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 0x7ff0680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.428+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff0740f06e0 con 0x7ff0841039c0 2024-04-25T02:08:55.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.428+0000 7ff07aa00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 0x7ff0680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.429+0000 7ff07aa00640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 0x7ff0680a50e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff08419b2c0 tx=0x7ff06c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:55.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.432+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff0740bd5a0 con 0x7ff0841039c0 2024-04-25T02:08:55.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:55 smithi137 ceph-mon[28303]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:55.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:55 smithi163 ceph-mon[32577]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:55.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.636+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff08402d320 con 0x7ff0841039c0 2024-04-25T02:08:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.640+0000 7ff080c00640 1 -- 172.21.15.137:0/3757732211 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7ff0740bcea0 con 0x7ff0841039c0 2024-04-25T02:08:55.647 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:55.647 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:55.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 msgr2=0x7ff0680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 0x7ff0680a50e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff08419b2c0 tx=0x7ff06c005f90 comp rx=0 tx=0).stop 2024-04-25T02:08:55.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 msgr2=0x7ff084199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff074000f80 tx=0x7ff0740319f0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 shutdown_connections 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff0680a2c20 0x7ff0680a50e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff084105570 0x7ff0841a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff084104bb0 0x7ff08419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 --2- 172.21.15.137:0/3757732211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff0841039c0 0x7ff084199db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 >> 172.21.15.137:0/3757732211 conn(0x7ff0840fef30 msgr2=0x7ff084107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.642+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 shutdown_connections 2024-04-25T02:08:55.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.643+0000 7ff08a600640 1 -- 172.21.15.137:0/3757732211 wait complete. 2024-04-25T02:08:55.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:55.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:55.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:55 smithi174 ceph-mon[33171]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 -- 172.21.15.137:0/2620354998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58101650 msgr2=0x7f7e58101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 --2- 172.21.15.137:0/2620354998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58101650 0x7f7e58101a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009ca0 tx=0x7f7e4802a8b0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 -- 172.21.15.137:0/2620354998 shutdown_connections 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 --2- 172.21.15.137:0/2620354998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58103200 0x7f7e58109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 --2- 172.21.15.137:0/2620354998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58102840 0x7f7e58102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 --2- 172.21.15.137:0/2620354998 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58101650 0x7f7e58101a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 -- 172.21.15.137:0/2620354998 >> 172.21.15.137:0/2620354998 conn(0x7f7e580fcbe0 msgr2=0x7f7e580ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 -- 172.21.15.137:0/2620354998 shutdown_connections 2024-04-25T02:08:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.873+0000 7f7e5d000640 1 -- 172.21.15.137:0/2620354998 wait complete. 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.874+0000 7f7e5d000640 1 Processor -- start 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.874+0000 7f7e5d000640 1 -- start start 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58102840 0x7f7e58197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d450 con 0x7f7e58103200 2024-04-25T02:08:55.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d2d0 con 0x7f7e58102840 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e5d000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d5d0 con 0x7f7e58101650 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41858/0 (socket says 172.21.15.137:41858) 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 -- 172.21.15.137:0/467071482 learned_addr learned my addr 172.21.15.137:0/467071482 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39360/0 (socket says 172.21.15.137:39360) 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e4ea00640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58102840 0x7f7e58197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 -- 172.21.15.137:0/467071482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58102840 msgr2=0x7f7e58197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58102840 0x7f7e58197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 -- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 msgr2=0x7f7e5819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57400640 1 -- 172.21.15.137:0/467071482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5819f670 con 0x7f7e58101650 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.875+0000 7f7e57e00640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e57400640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000f80 tx=0x7f7e480093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48004040 con 0x7f7e58101650 2024-04-25T02:08:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e58073970 con 0x7f7e58101650 2024-04-25T02:08:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7e48040070 con 0x7f7e58101650 2024-04-25T02:08:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48045c40 con 0x7f7e58101650 2024-04-25T02:08:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.876+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e58073f10 con 0x7f7e58101650 2024-04-25T02:08:55.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.877+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58108910 con 0x7f7e58101650 2024-04-25T02:08:55.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.879+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7e48045470 con 0x7f7e58101650 2024-04-25T02:08:55.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.881+0000 7f7e54c00640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 0x7f7e3c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:55.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.881+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f7e480f0530 con 0x7f7e58101650 2024-04-25T02:08:55.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.881+0000 7f7e4ea00640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 0x7f7e3c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:55.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.882+0000 7f7e4ea00640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 0x7f7e3c0a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e400095f0 tx=0x7f7e40005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:55.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:55.883+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7e480bd480 con 0x7f7e58101650 2024-04-25T02:08:56.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.084+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e580753b0 con 0x7f7e58101650 2024-04-25T02:08:56.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.085+0000 7f7e54c00640 1 -- 172.21.15.137:0/467071482 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f7e480bcd80 con 0x7f7e58101650 2024-04-25T02:08:56.092 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:08:56.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 msgr2=0x7f7e3c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 0x7f7e3c0a5160 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e400095f0 tx=0x7f7e40005f90 comp rx=0 tx=0).stop 2024-04-25T02:08:56.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 msgr2=0x7f7e58197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e48000f80 tx=0x7f7e480093d0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 shutdown_connections 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f7e3c0a2ca0 0x7f7e3c0a5160 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.087+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e58103200 0x7f7e5819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.088+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7e58102840 0x7f7e58197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.088+0000 7f7e5d000640 1 --2- 172.21.15.137:0/467071482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e58101650 0x7f7e58197a50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.088+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 >> 172.21.15.137:0/467071482 conn(0x7f7e580fcbe0 msgr2=0x7f7e58105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.088+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 shutdown_connections 2024-04-25T02:08:56.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.088+0000 7f7e5d000640 1 -- 172.21.15.137:0/467071482 wait complete. 2024-04-25T02:08:56.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 -- 172.21.15.137:0/4258995672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8102860 msgr2=0x7fdbf8102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 --2- 172.21.15.137:0/4258995672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8102860 0x7fdbf8102ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009900 tx=0x7fdbe802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 -- 172.21.15.137:0/4258995672 shutdown_connections 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 --2- 172.21.15.137:0/4258995672 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8103220 0x7fdbf8109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 --2- 172.21.15.137:0/4258995672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8102860 0x7fdbf8102ce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 --2- 172.21.15.137:0/4258995672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 -- 172.21.15.137:0/4258995672 >> 172.21.15.137:0/4258995672 conn(0x7fdbf80fcbe0 msgr2=0x7fdbf80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.312+0000 7fdbff200640 1 -- 172.21.15.137:0/4258995672 shutdown_connections 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.313+0000 7fdbff200640 1 -- 172.21.15.137:0/4258995672 wait complete. 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.313+0000 7fdbff200640 1 Processor -- start 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 -- start start 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8102860 0x7fdbf819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8103220 0x7fdbf81a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf810d470 con 0x7fdbf8102860 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf810d2f0 con 0x7fdbf8101670 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbff200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf810d5f0 con 0x7fdbf8103220 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbfde00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbfde00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:40130/0 (socket says 172.21.15.137:40130) 2024-04-25T02:08:56.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbfde00640 1 -- 172.21.15.137:0/1507525120 learned_addr learned my addr 172.21.15.137:0/1507525120 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbfd400640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8102860 0x7fdbf819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.314+0000 7fdbfe800640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8103220 0x7fdbf81a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 -- 172.21.15.137:0/1507525120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8103220 msgr2=0x7fdbf81a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8103220 0x7fdbf81a11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 -- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8102860 msgr2=0x7fdbf819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8102860 0x7fdbf819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 -- 172.21.15.137:0/1507525120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf81a1880 con 0x7fdbf8101670 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbfde00640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9c0 tx=0x7fdbec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00cd80 con 0x7fdbf8101670 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbec0035f0 con 0x7fdbf8101670 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81a1b70 con 0x7fdbf8101670 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec010690 con 0x7fdbf8101670 2024-04-25T02:08:56.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.315+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a20c0 con 0x7fdbf8101670 2024-04-25T02:08:56.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.316+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf81a2290 con 0x7fdbf8101670 2024-04-25T02:08:56.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.319+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdbec0037a0 con 0x7fdbf8101670 2024-04-25T02:08:56.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.320+0000 7fdbf2a00640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 0x7fdbe00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.320+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fdbec0cf710 con 0x7fdbf8101670 2024-04-25T02:08:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.320+0000 7fdbfd400640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 0x7fdbe00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.321+0000 7fdbfd400640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 0x7fdbe00a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005ab0 tx=0x7fdbe8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.322+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fdbec09c4c0 con 0x7fdbf8101670 2024-04-25T02:08:56.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3757732211' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:56.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/467071482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:56.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.557+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdbf81a2460 con 0x7fdbf8101670 2024-04-25T02:08:56.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.558+0000 7fdbf2a00640 1 -- 172.21.15.137:0/1507525120 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fdbec09bdc0 con 0x7fdbf8101670 2024-04-25T02:08:56.566 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:08:56.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 msgr2=0x7fdbe00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 0x7fdbe00a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005ab0 tx=0x7fdbe8005a20 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 msgr2=0x7fdbf8199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9c0 tx=0x7fdbec00ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 shutdown_connections 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fdbe00a2c20 0x7fdbe00a50e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbf8103220 0x7fdbf81a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdbf8102860 0x7fdbf819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 --2- 172.21.15.137:0/1507525120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbf8101670 0x7fdbf8199c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 >> 172.21.15.137:0/1507525120 conn(0x7fdbf80fcbe0 msgr2=0x7fdbf8073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 shutdown_connections 2024-04-25T02:08:56.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.561+0000 7fdbff200640 1 -- 172.21.15.137:0/1507525120 wait complete. 2024-04-25T02:08:56.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:56.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3757732211' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:56.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/467071482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:56.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3757732211' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:56.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/467071482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:56.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 -- 172.21.15.137:0/1911101632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac4102830 msgr2=0x7feac4104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 --2- 172.21.15.137:0/1911101632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac4102830 0x7feac4104ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feab4009900 tx=0x7feab402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 -- 172.21.15.137:0/1911101632 shutdown_connections 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 --2- 172.21.15.137:0/1911101632 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac41051e0 0x7feac4105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 --2- 172.21.15.137:0/1911101632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac4102830 0x7feac4104ca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 --2- 172.21.15.137:0/1911101632 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac41022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 -- 172.21.15.137:0/1911101632 >> 172.21.15.137:0/1911101632 conn(0x7feac40fbae0 msgr2=0x7feac40fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 -- 172.21.15.137:0/1911101632 shutdown_connections 2024-04-25T02:08:56.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.782+0000 7feacb200640 1 -- 172.21.15.137:0/1911101632 wait complete. 2024-04-25T02:08:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.783+0000 7feacb200640 1 Processor -- start 2024-04-25T02:08:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 -- start start 2024-04-25T02:08:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac41051e0 0x7feac41a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feac4113a10 con 0x7feac4102830 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7feac4113890 con 0x7feac40ffec0 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feacb200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feac4113b90 con 0x7feac41051e0 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feac9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feac9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39408/0 (socket says 172.21.15.137:39408) 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feac9400640 1 -- 172.21.15.137:0/1849374039 learned_addr learned my addr 172.21.15.137:0/1849374039 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feaca800640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac41051e0 0x7feac41a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.784+0000 7feac9e00640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 -- 172.21.15.137:0/1849374039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac41051e0 msgr2=0x7feac41a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac41051e0 0x7feac41a5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 -- 172.21.15.137:0/1849374039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 msgr2=0x7feac419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac419dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:56.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 -- 172.21.15.137:0/1849374039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac41a5c00 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9e00640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feac9400640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feab4009a20 tx=0x7feab40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab403f030 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feab4003d00 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.785+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac41a5e90 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.786+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4035070 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.786+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac41a62f0 con 0x7feac4102830 2024-04-25T02:08:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.787+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac40fd5d0 con 0x7feac4102830 2024-04-25T02:08:56.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.789+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7feab4042030 con 0x7feac4102830 2024-04-25T02:08:56.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.791+0000 7feabaa00640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 0x7feab00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.791+0000 7feac9e00640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 0x7feab00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:56.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.792+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7feab40ef700 con 0x7feac4102830 2024-04-25T02:08:56.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.792+0000 7feac9e00640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 0x7feab00a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feabc005fd0 tx=0x7feabc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:56.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.798+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7feab40bbe60 con 0x7feac4102830 2024-04-25T02:08:57.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.998+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feac402d3c0 con 0x7feac4102830 2024-04-25T02:08:57.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:56.999+0000 7feabaa00640 1 -- 172.21.15.137:0/1849374039 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7feab40c0160 con 0x7feac4102830 2024-04-25T02:08:57.007 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 msgr2=0x7feab00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 0x7feab00a50e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feabc005fd0 tx=0x7feabc009500 comp rx=0 tx=0).stop 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 msgr2=0x7feac419e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feab4009a20 tx=0x7feab40042f0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 shutdown_connections 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7feab00a2c20 0x7feab00a50e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feac41051e0 0x7feac41a5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feac4102830 0x7feac419e520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 --2- 172.21.15.137:0/1849374039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feac40ffec0 0x7feac419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 >> 172.21.15.137:0/1849374039 conn(0x7feac40fbae0 msgr2=0x7feac4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 shutdown_connections 2024-04-25T02:08:57.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.002+0000 7feacb200640 1 -- 172.21.15.137:0/1849374039 wait complete. 2024-04-25T02:08:57.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 -- 172.21.15.137:0/732389609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 msgr2=0x7f8860100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 --2- 172.21.15.137:0/732389609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f8860100bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f884c009be0 tx=0x7f884c02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 -- 172.21.15.137:0/732389609 shutdown_connections 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 --2- 172.21.15.137:0/732389609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8860101130 0x7f88601015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 --2- 172.21.15.137:0/732389609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f8860100bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 --2- 172.21.15.137:0/732389609 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88600ffe30 0x7f8860100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 -- 172.21.15.137:0/732389609 >> 172.21.15.137:0/732389609 conn(0x7f88600fba10 msgr2=0x7f88600fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 -- 172.21.15.137:0/732389609 shutdown_connections 2024-04-25T02:08:57.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.225+0000 7f8866800640 1 -- 172.21.15.137:0/732389609 wait complete. 2024-04-25T02:08:57.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 Processor -- start 2024-04-25T02:08:57.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 -- start start 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f886019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101130 0x7f88601a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f886010f580 con 0x7f8860101130 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f886010f400 con 0x7f8860100790 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.226+0000 7f8866800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f886010f700 con 0x7f88600ffe30 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41926/0 (socket says 172.21.15.137:41926) 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 -- 172.21.15.137:0/2082047165 learned_addr learned my addr 172.21.15.137:0/2082047165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8864a00640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f886019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865e00640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101130 0x7f88601a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 -- 172.21.15.137:0/2082047165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 msgr2=0x7f886019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f886019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 -- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101130 msgr2=0x7f88601a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101130 0x7f88601a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 -- 172.21.15.137:0/2082047165 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88601a17a0 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.227+0000 7f8865400640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f885800e9c0 tx=0x7f885800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.228+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885800cde0 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.228+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88601a1a90 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.228+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88580035f0 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.228+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858010670 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.228+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a2000 con 0x7f88600ffe30 2024-04-25T02:08:57.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.229+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886010ab80 con 0x7f88600ffe30 2024-04-25T02:08:57.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.231+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f88580037a0 con 0x7f88600ffe30 2024-04-25T02:08:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.232+0000 7f885e000640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 0x7f88440a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.232+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f88580cf490 con 0x7f88600ffe30 2024-04-25T02:08:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.232+0000 7f8864a00640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 0x7f88440a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.233+0000 7f8864a00640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 0x7f88440a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f884c006010 tx=0x7f884c030a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.236+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f885809c240 con 0x7f88600ffe30 2024-04-25T02:08:57.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.367+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f88580981b0 con 0x7f88600ffe30 2024-04-25T02:08:57.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.486+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f886002d3d0 con 0x7f88600ffe30 2024-04-25T02:08:57.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.487+0000 7f885e000640 1 -- 172.21.15.137:0/2082047165 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f8858046670 con 0x7f88600ffe30 2024-04-25T02:08:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:57.496 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:08:57.496 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 msgr2=0x7f88440a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 0x7f88440a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f884c006010 tx=0x7f884c030a90 comp rx=0 tx=0).stop 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 msgr2=0x7f8860199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f885800e9c0 tx=0x7f885800ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 shutdown_connections 2024-04-25T02:08:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f88440a2ca0 0x7f88440a5160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8860101130 0x7f88601a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8860100790 0x7f886019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 --2- 172.21.15.137:0/2082047165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88600ffe30 0x7f8860199b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 >> 172.21.15.137:0/2082047165 conn(0x7f88600fba10 msgr2=0x7f88600fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.490+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 shutdown_connections 2024-04-25T02:08:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.491+0000 7f8866800640 1 -- 172.21.15.137:0/2082047165 wait complete. 2024-04-25T02:08:57.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:57.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:57 smithi163 ceph-mon[32577]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:57.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:57 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1507525120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:57 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1849374039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:57 smithi174 ceph-mon[33171]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:57.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:57 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1507525120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:57 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1849374039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.709+0000 7f69fe200640 1 -- 172.21.15.137:0/1497978772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 msgr2=0x7f69f8103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.709+0000 7f69fe200640 1 --2- 172.21.15.137:0/1497978772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8103de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 -- 172.21.15.137:0/1497978772 shutdown_connections 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 --2- 172.21.15.137:0/1497978772 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8105570 0x7f69f810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 --2- 172.21.15.137:0/1497978772 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8104bb0 0x7f69f8105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 --2- 172.21.15.137:0/1497978772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8103de0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 -- 172.21.15.137:0/1497978772 >> 172.21.15.137:0/1497978772 conn(0x7f69f80fef30 msgr2=0x7f69f8101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 -- 172.21.15.137:0/1497978772 shutdown_connections 2024-04-25T02:08:57.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.710+0000 7f69fe200640 1 -- 172.21.15.137:0/1497978772 wait complete. 2024-04-25T02:08:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 Processor -- start 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 -- start start 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 0x7f69f819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 0x7f69f81a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810f7b0 con 0x7f69f81039c0 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810f630 con 0x7f69f8104bb0 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69fe200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810f930 con 0x7f69f8105570 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69f7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39440/0 (socket says 172.21.15.137:39440) 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69f6a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 0x7f69f819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.711+0000 7f69f7400640 1 -- 172.21.15.137:0/1573764779 learned_addr learned my addr 172.21.15.137:0/1573764779 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f7e00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 0x7f69f81a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 -- 172.21.15.137:0/1573764779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 msgr2=0x7f69f81a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 0x7f69f81a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 -- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 msgr2=0x7f69f8199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 -- 172.21.15.137:0/1573764779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f81a19e0 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f7e00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 0x7f69f81a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69f6a00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 0x7f69f819a300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.712+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400ccc0 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.713+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f81a1cd0 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.713+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69e4010930 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.713+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e40189f0 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.713+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81a2210 con 0x7f69f8104bb0 2024-04-25T02:08:57.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.714+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f810ace0 con 0x7f69f8104bb0 2024-04-25T02:08:57.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.716+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f69e4010ae0 con 0x7f69f8104bb0 2024-04-25T02:08:57.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.718+0000 7f69efe00640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 0x7f69dc0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:57.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.718+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f69e40cf780 con 0x7f69f8104bb0 2024-04-25T02:08:57.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.718+0000 7f69f7400640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 0x7f69dc0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:57.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.718+0000 7f69f7400640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 0x7f69dc0a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:57.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.719+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f69e409c690 con 0x7f69f8104bb0 2024-04-25T02:08:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:57 smithi137 ceph-mon[28303]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:08:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:57 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1507525120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:57 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1849374039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.919+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69f802d2f0 con 0x7f69f8104bb0 2024-04-25T02:08:57.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.921+0000 7f69efe00640 1 -- 172.21.15.137:0/1573764779 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7f69e409bf90 con 0x7f69f8104bb0 2024-04-25T02:08:57.929 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:57.930 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 msgr2=0x7f69dc0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 0x7f69dc0a5050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69e8006010 tx=0x7f69e8005a20 comp rx=0 tx=0).stop 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 msgr2=0x7f69f819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 0x7f69f819a300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 shutdown_connections 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f69dc0a2b90 0x7f69dc0a5050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69f8105570 0x7f69f81a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69f8104bb0 0x7f69f819a300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 --2- 172.21.15.137:0/1573764779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f69f81039c0 0x7f69f8199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 >> 172.21.15.137:0/1573764779 conn(0x7f69f80fef30 msgr2=0x7f69f8107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 shutdown_connections 2024-04-25T02:08:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:57.924+0000 7f69fe200640 1 -- 172.21.15.137:0/1573764779 wait complete. 2024-04-25T02:08:57.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:08:57.952 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 -- 172.21.15.137:0/2283288366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 msgr2=0x7ff124078580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 --2- 172.21.15.137:0/2283288366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff124078580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009be0 tx=0x7ff11c02a6c0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 -- 172.21.15.137:0/2283288366 shutdown_connections 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 --2- 172.21.15.137:0/2283288366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff124078580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 --2- 172.21.15.137:0/2283288366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124077340 0x7ff1240777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 --2- 172.21.15.137:0/2283288366 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124076100 0x7ff124076520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 -- 172.21.15.137:0/2283288366 >> 172.21.15.137:0/2283288366 conn(0x7ff1240fedf0 msgr2=0x7ff124101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 -- 172.21.15.137:0/2283288366 shutdown_connections 2024-04-25T02:08:58.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.153+0000 7ff129e00640 1 -- 172.21.15.137:0/2283288366 wait complete. 2024-04-25T02:08:58.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 Processor -- start 2024-04-25T02:08:58.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 -- start start 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124077340 0x7ff12419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff1241a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff124113a30 con 0x7ff124077ce0 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241138b0 con 0x7ff124077340 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.154+0000 7ff129e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff124113bb0 con 0x7ff124076100 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff123e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124077340 0x7ff12419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff129400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff1241a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41966/0 (socket says 172.21.15.137:41966) 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 -- 172.21.15.137:0/260964619 learned_addr learned my addr 172.21.15.137:0/260964619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 -- 172.21.15.137:0/260964619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124077340 msgr2=0x7ff12419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124077340 0x7ff12419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 -- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 msgr2=0x7ff1241a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff1241a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 -- 172.21.15.137:0/260964619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1241a5bb0 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.155+0000 7ff128a00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff11400e9c0 tx=0x7ff11400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.156+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11400ccc0 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.156+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff114005520 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.156+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1241a5ea0 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.156+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114010690 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.156+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1241a6310 con 0x7ff124076100 2024-04-25T02:08:58.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.157+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1241101f0 con 0x7ff124076100 2024-04-25T02:08:58.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.159+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff1140046c0 con 0x7ff124076100 2024-04-25T02:08:58.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.160+0000 7ff121600640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 0x7ff10c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.160+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff1140cf300 con 0x7ff124076100 2024-04-25T02:08:58.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.160+0000 7ff123e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 0x7ff10c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.161+0000 7ff123e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 0x7ff10c0a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1180095f0 tx=0x7ff118005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:58.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.164+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff11409c210 con 0x7ff124076100 2024-04-25T02:08:58.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.357+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff124062370 con 0x7ff124076100 2024-04-25T02:08:58.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.364+0000 7ff121600640 1 -- 172.21.15.137:0/260964619 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7ff11409bb10 con 0x7ff124076100 2024-04-25T02:08:58.372 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 msgr2=0x7ff10c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 0x7ff10c0a5050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff1180095f0 tx=0x7ff118005f90 comp rx=0 tx=0).stop 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 msgr2=0x7ff12419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff11400e9c0 tx=0x7ff11400ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 shutdown_connections 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff10c0a2b90 0x7ff10c0a5050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff124077ce0 0x7ff1241a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff124077340 0x7ff12419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 --2- 172.21.15.137:0/260964619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff124076100 0x7ff12419df90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.367+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 >> 172.21.15.137:0/260964619 conn(0x7ff1240fedf0 msgr2=0x7ff1241008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.368+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 shutdown_connections 2024-04-25T02:08:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.368+0000 7ff129e00640 1 -- 172.21.15.137:0/260964619 wait complete. 2024-04-25T02:08:58.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 -- 172.21.15.137:0/2057283088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e01020d0 msgr2=0x7fa5e01044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 --2- 172.21.15.137:0/2057283088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e01020d0 0x7fa5e01044c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009900 tx=0x7fa5d002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 -- 172.21.15.137:0/2057283088 shutdown_connections 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 --2- 172.21.15.137:0/2057283088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e0107330 0x7fa5e0109780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 --2- 172.21.15.137:0/2057283088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0104a00 0x7fa5e0106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 --2- 172.21.15.137:0/2057283088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e01020d0 0x7fa5e01044c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 -- 172.21.15.137:0/2057283088 >> 172.21.15.137:0/2057283088 conn(0x7fa5e00fbae0 msgr2=0x7fa5e00fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 -- 172.21.15.137:0/2057283088 shutdown_connections 2024-04-25T02:08:58.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.583+0000 7fa5df200640 1 -- 172.21.15.137:0/2057283088 wait complete. 2024-04-25T02:08:58.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 Processor -- start 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 -- start start 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e01020d0 0x7fa5e0199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0107330 0x7fa5e01a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e010d470 con 0x7fa5e0104a00 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e010d2f0 con 0x7fa5e0107330 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.584+0000 7fa5df200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e010d5f0 con 0x7fa5e01020d0 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39480/0 (socket says 172.21.15.137:39480) 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 -- 172.21.15.137:0/45099233 learned_addr learned my addr 172.21.15.137:0/45099233 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5dde00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e01020d0 0x7fa5e0199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5de800640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0107330 0x7fa5e01a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 -- 172.21.15.137:0/45099233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e01020d0 msgr2=0x7fa5e0199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e01020d0 0x7fa5e0199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 -- 172.21.15.137:0/45099233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0107330 msgr2=0x7fa5e01a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0107330 0x7fa5e01a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 -- 172.21.15.137:0/45099233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e01a1890 con 0x7fa5e0104a00 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.585+0000 7fa5d7e00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e9c0 tx=0x7fa5c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.586+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800cd80 con 0x7fa5e0104a00 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.586+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5c8005520 con 0x7fa5e0104a00 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.586+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8010690 con 0x7fa5e0104a00 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.586+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e01a1b80 con 0x7fa5e0104a00 2024-04-25T02:08:58.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.586+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e01a2050 con 0x7fa5e0104a00 2024-04-25T02:08:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.587+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e0108e80 con 0x7fa5e0104a00 2024-04-25T02:08:58.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.589+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa5c80046c0 con 0x7fa5e0104a00 2024-04-25T02:08:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.590+0000 7fa5d6a00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 0x7fa5c40a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.590+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fa5c80cf4d0 con 0x7fa5e0104a00 2024-04-25T02:08:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.591+0000 7fa5dde00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 0x7fa5c40a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:58.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.591+0000 7fa5dde00640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 0x7fa5c40a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005ab0 tx=0x7fa5d0005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:58.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.595+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa5c809c3e0 con 0x7fa5e0104a00 2024-04-25T02:08:58.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:58 smithi163 ceph-mon[32577]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-04-25T02:08:58.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:58 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2082047165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:58 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1573764779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:58 smithi174 ceph-mon[33171]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-04-25T02:08:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:58 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2082047165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:58 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1573764779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:58 smithi137 ceph-mon[28303]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-04-25T02:08:58.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:58 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2082047165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:58 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1573764779' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:08:58.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.795+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa5e0062340 con 0x7fa5e0104a00 2024-04-25T02:08:58.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.797+0000 7fa5d6a00640 1 -- 172.21.15.137:0/45099233 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fa5c809bce0 con 0x7fa5e0104a00 2024-04-25T02:08:58.804 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 msgr2=0x7fa5c40a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 0x7fa5c40a5050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0005ab0 tx=0x7fa5d0005a20 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 msgr2=0x7fa5e019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e9c0 tx=0x7fa5c800ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 shutdown_connections 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa5c40a2b90 0x7fa5c40a5050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5e0107330 0x7fa5e01a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5e0104a00 0x7fa5e019a1c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 --2- 172.21.15.137:0/45099233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5e01020d0 0x7fa5e0199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 >> 172.21.15.137:0/45099233 conn(0x7fa5e00fbae0 msgr2=0x7fa5e01017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 shutdown_connections 2024-04-25T02:08:58.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:58.800+0000 7fa5df200640 1 -- 172.21.15.137:0/45099233 wait complete. 2024-04-25T02:08:58.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:08:59.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 -- 172.21.15.137:0/4032661398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 msgr2=0x7f4d441092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 --2- 172.21.15.137:0/4032661398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d441092f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d3002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 -- 172.21.15.137:0/4032661398 shutdown_connections 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 --2- 172.21.15.137:0/4032661398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 --2- 172.21.15.137:0/4032661398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d441092f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 --2- 172.21.15.137:0/4032661398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d441080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.017+0000 7f4d43e00640 1 -- 172.21.15.137:0/4032661398 >> 172.21.15.137:0/4032661398 conn(0x7f4d44076c10 msgr2=0x7f4d44079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.018+0000 7f4d43e00640 1 -- 172.21.15.137:0/4032661398 shutdown_connections 2024-04-25T02:08:59.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.018+0000 7f4d43e00640 1 -- 172.21.15.137:0/4032661398 wait complete. 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.018+0000 7f4d43e00640 1 Processor -- start 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 -- start start 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d4419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d4419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44113a30 con 0x7f4d44109830 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4d441138b0 con 0x7f4d44108e70 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44113bb0 con 0x7f4d44107c80 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d42a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d4419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39484/0 (socket says 172.21.15.137:39484) 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d43400640 1 -- 172.21.15.137:0/2970420645 learned_addr learned my addr 172.21.15.137:0/2970420645 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.019+0000 7f4d42000640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d4419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 -- 172.21.15.137:0/2970420645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 msgr2=0x7f4d4419e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d4419e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 -- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 msgr2=0x7f4d441a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 -- 172.21.15.137:0/2970420645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d441a5c90 con 0x7f4d44107c80 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d43400640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d42a00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d4419e070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9c0 tx=0x7f4d3400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400ccc0 con 0x7f4d44107c80 2024-04-25T02:08:59.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d441a5f80 con 0x7f4d44107c80 2024-04-25T02:08:59.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4d340035f0 con 0x7f4d44107c80 2024-04-25T02:08:59.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400ce60 con 0x7f4d44107c80 2024-04-25T02:08:59.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.020+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d441a6390 con 0x7f4d44107c80 2024-04-25T02:08:59.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.021+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4410ef40 con 0x7f4d44107c80 2024-04-25T02:08:59.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.023+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f4d340037a0 con 0x7f4d44107c80 2024-04-25T02:08:59.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.025+0000 7f4d3b400640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 0x7f4d280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.025+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f4d340cf400 con 0x7f4d44107c80 2024-04-25T02:08:59.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.025+0000 7f4d42000640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 0x7f4d280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.026+0000 7f4d42000640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 0x7f4d280a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006010 tx=0x7f4d30031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.029+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4d3409c310 con 0x7f4d44107c80 2024-04-25T02:08:59.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.213+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d44062340 con 0x7f4d44107c80 2024-04-25T02:08:59.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.214+0000 7f4d3b400640 1 -- 172.21.15.137:0/2970420645 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f4d3409bc10 con 0x7f4d44107c80 2024-04-25T02:08:59.222 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 msgr2=0x7f4d280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 0x7f4d280a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006010 tx=0x7f4d30031640 comp rx=0 tx=0).stop 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 msgr2=0x7f4d4419e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d4419e070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400e9c0 tx=0x7f4d3400ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 shutdown_connections 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f4d280a2c10 0x7f4d280a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d44109830 0x7f4d441a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d44108e70 0x7f4d4419e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 --2- 172.21.15.137:0/2970420645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d44107c80 0x7f4d4419e070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 >> 172.21.15.137:0/2970420645 conn(0x7f4d44076c10 msgr2=0x7f4d4410c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:59.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 shutdown_connections 2024-04-25T02:08:59.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.217+0000 7f4d43e00640 1 -- 172.21.15.137:0/2970420645 wait complete. 2024-04-25T02:08:59.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 -- 172.21.15.137:0/2321385684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718109770 msgr2=0x7fd718110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 --2- 172.21.15.137:0/2321385684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718109770 0x7fd718110000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd710009ca0 tx=0x7fd71002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 -- 172.21.15.137:0/2321385684 shutdown_connections 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 --2- 172.21.15.137:0/2321385684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718109770 0x7fd718110000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 --2- 172.21.15.137:0/2321385684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718108db0 0x7fd718109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 --2- 172.21.15.137:0/2321385684 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718107bc0 0x7fd718107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 -- 172.21.15.137:0/2321385684 >> 172.21.15.137:0/2321385684 conn(0x7fd718076b80 msgr2=0x7fd718078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:59.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 -- 172.21.15.137:0/2321385684 shutdown_connections 2024-04-25T02:08:59.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.439+0000 7fd71e600640 1 -- 172.21.15.137:0/2321385684 wait complete. 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 Processor -- start 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 -- start start 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718108db0 0x7fd71819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718109770 0x7fd7181a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd718113970 con 0x7fd718107bc0 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd7181137f0 con 0x7fd718108db0 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.440+0000 7fd71e600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd718113af0 con 0x7fd718109770 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39508/0 (socket says 172.21.15.137:39508) 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 -- 172.21.15.137:0/3954226660 learned_addr learned my addr 172.21.15.137:0/3954226660 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71dc00640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718109770 0x7fd7181a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd70fe00640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718108db0 0x7fd71819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 -- 172.21.15.137:0/3954226660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718109770 msgr2=0x7fd7181a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718109770 0x7fd7181a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 -- 172.21.15.137:0/3954226660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718108db0 msgr2=0x7fd71819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718108db0 0x7fd71819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 -- 172.21.15.137:0/3954226660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181a5b10 con 0x7fd718107bc0 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.441+0000 7fd71d200640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd70800e9c0 tx=0x7fd70800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.442+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70800cd80 con 0x7fd718107bc0 2024-04-25T02:08:59.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.442+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7080035f0 con 0x7fd718107bc0 2024-04-25T02:08:59.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.442+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708010690 con 0x7fd718107bc0 2024-04-25T02:08:59.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.442+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7181a5e00 con 0x7fd718107bc0 2024-04-25T02:08:59.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.442+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181a6210 con 0x7fd718107bc0 2024-04-25T02:08:59.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.443+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71810ee10 con 0x7fd718107bc0 2024-04-25T02:08:59.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.445+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fd7080037a0 con 0x7fd718107bc0 2024-04-25T02:08:59.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.446+0000 7fd716000640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 0x7fd6fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.446+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fd7080cf430 con 0x7fd718107bc0 2024-04-25T02:08:59.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.447+0000 7fd70fe00640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 0x7fd6fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.447+0000 7fd70fe00640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 0x7fd6fc0a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd71819f400 tx=0x7fd700005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.450+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd70809c340 con 0x7fd718107bc0 2024-04-25T02:08:59.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:59 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/260964619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:59 smithi137 ceph-mon[28303]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T02:08:59.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:59 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/45099233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:08:59 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2970420645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:59 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/260964619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:59 smithi163 ceph-mon[32577]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T02:08:59.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:59 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/45099233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:08:59 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2970420645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:59 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/260964619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:59 smithi174 ceph-mon[33171]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-25T02:08:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:59 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/45099233' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:08:59 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2970420645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:08:59.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.690+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd71802d170 con 0x7fd718107bc0 2024-04-25T02:08:59.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.692+0000 7fd716000640 1 -- 172.21.15.137:0/3954226660 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7fd70809bc40 con 0x7fd718107bc0 2024-04-25T02:08:59.700 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:08:59.700 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:08:59.700 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:08:59.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.694+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 msgr2=0x7fd6fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.694+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 0x7fd6fc0a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd71819f400 tx=0x7fd700005f90 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.694+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 msgr2=0x7fd71819def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.694+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd70800e9c0 tx=0x7fd70800ee80 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 shutdown_connections 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fd6fc0a2c10 0x7fd6fc0a50d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd718109770 0x7fd7181a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd718108db0 0x7fd71819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 --2- 172.21.15.137:0/3954226660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd718107bc0 0x7fd71819def0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 >> 172.21.15.137:0/3954226660 conn(0x7fd718076b80 msgr2=0x7fd71810bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 shutdown_connections 2024-04-25T02:08:59.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.695+0000 7fd71e600640 1 -- 172.21.15.137:0/3954226660 wait complete. 2024-04-25T02:08:59.722 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:08:59.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 -- 172.21.15.137:0/1474823592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 msgr2=0x7ff138105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 --2- 172.21.15.137:0/1474823592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff138105030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff120009900 tx=0x7ff12002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 -- 172.21.15.137:0/1474823592 shutdown_connections 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 --2- 172.21.15.137:0/1474823592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff138105570 0x7ff13810be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 --2- 172.21.15.137:0/1474823592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff138105030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 --2- 172.21.15.137:0/1474823592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff1381039c0 0x7ff138103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.917+0000 7ff13ee00640 1 -- 172.21.15.137:0/1474823592 >> 172.21.15.137:0/1474823592 conn(0x7ff1380fef30 msgr2=0x7ff138101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.918+0000 7ff13ee00640 1 -- 172.21.15.137:0/1474823592 shutdown_connections 2024-04-25T02:08:59.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.918+0000 7ff13ee00640 1 -- 172.21.15.137:0/1474823592 wait complete. 2024-04-25T02:08:59.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.918+0000 7ff13ee00640 1 Processor -- start 2024-04-25T02:08:59.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 -- start start 2024-04-25T02:08:59.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 0x7ff138199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 0x7ff1381a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff13810f7c0 con 0x7ff138104bb0 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff13810f640 con 0x7ff1381039c0 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ee00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff13810f940 con 0x7ff138105570 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff12f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff12f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39524/0 (socket says 172.21.15.137:39524) 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff12f400640 1 -- 172.21.15.137:0/4038051583 learned_addr learned my addr 172.21.15.137:0/4038051583 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff137e00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 0x7ff138199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.919+0000 7ff13ce00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 0x7ff1381a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 -- 172.21.15.137:0/4038051583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 msgr2=0x7ff1381a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 0x7ff1381a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 -- 172.21.15.137:0/4038051583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 msgr2=0x7ff138199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:08:59.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 0x7ff138199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 -- 172.21.15.137:0/4038051583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1381a19b0 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff13ce00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 0x7ff1381a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff137e00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 0x7ff138199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff12f400640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1200316a0 tx=0x7ff120032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12003f030 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff120003d00 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120035070 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1381a1c40 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.920+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1381a2180 con 0x7ff138104bb0 2024-04-25T02:08:59.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.922+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13810ac80 con 0x7ff138104bb0 2024-04-25T02:08:59.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.924+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff120042030 con 0x7ff138104bb0 2024-04-25T02:08:59.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.926+0000 7ff135600640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 0x7ff11c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:08:59.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.926+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff1200ef1a0 con 0x7ff138104bb0 2024-04-25T02:08:59.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.926+0000 7ff137e00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 0x7ff11c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:08:59.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.927+0000 7ff137e00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 0x7ff11c0a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff13819b270 tx=0x7ff128005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:08:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:08:59.930+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff1200bbac0 con 0x7ff138104bb0 2024-04-25T02:09:00.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.131+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff138062370 con 0x7ff138104bb0 2024-04-25T02:09:00.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.134+0000 7ff135600640 1 -- 172.21.15.137:0/4038051583 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7ff1200bfdc0 con 0x7ff138104bb0 2024-04-25T02:09:00.142 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:00.142 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 msgr2=0x7ff11c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 0x7ff11c0a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff13819b270 tx=0x7ff128005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 msgr2=0x7ff13819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1200316a0 tx=0x7ff120032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 shutdown_connections 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff11c0a2c10 0x7ff11c0a50d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff138105570 0x7ff1381a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff138104bb0 0x7ff13819a2e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 --2- 172.21.15.137:0/4038051583 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1381039c0 0x7ff138199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.136+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 >> 172.21.15.137:0/4038051583 conn(0x7ff1380fef30 msgr2=0x7ff138107e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.137+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 shutdown_connections 2024-04-25T02:09:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.137+0000 7ff13ee00640 1 -- 172.21.15.137:0/4038051583 wait complete. 2024-04-25T02:09:00.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 -- 172.21.15.137:0/3302929595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030105550 msgr2=0x7f603010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 --2- 172.21.15.137:0/3302929595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030105550 0x7f603010bde0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6028009be0 tx=0x7f602802a6c0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 -- 172.21.15.137:0/3302929595 shutdown_connections 2024-04-25T02:09:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 --2- 172.21.15.137:0/3302929595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030105550 0x7f603010bde0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 --2- 172.21.15.137:0/3302929595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6030104b90 0x7f6030105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 --2- 172.21.15.137:0/3302929595 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f60301039a0 0x7f6030103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 -- 172.21.15.137:0/3302929595 >> 172.21.15.137:0/3302929595 conn(0x7f60300fef30 msgr2=0x7f6030101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 -- 172.21.15.137:0/3302929595 shutdown_connections 2024-04-25T02:09:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.351+0000 7f6035a00640 1 -- 172.21.15.137:0/3302929595 wait complete. 2024-04-25T02:09:00.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.352+0000 7f6035a00640 1 Processor -- start 2024-04-25T02:09:00.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.352+0000 7f6035a00640 1 -- start start 2024-04-25T02:09:00.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030104b90 0x7f603019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6030105550 0x7f60301a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f603010f750 con 0x7f6030104b90 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f603010f5d0 con 0x7f6030105550 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6035a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f603010f8d0 con 0x7f60301039a0 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f6026000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030104b90 0x7f603019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f602ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f602ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:42070/0 (socket says 172.21.15.137:42070) 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f602f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6030105550 0x7f60301a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.353+0000 7f602ea00640 1 -- 172.21.15.137:0/2231470112 learned_addr learned my addr 172.21.15.137:0/2231470112 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 -- 172.21.15.137:0/2231470112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6030105550 msgr2=0x7f60301a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6030105550 0x7f60301a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 -- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030104b90 msgr2=0x7f603019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030104b90 0x7f603019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 -- 172.21.15.137:0/2231470112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60301a1910 con 0x7f60301039a0 2024-04-25T02:09:00.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f602ea00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f602000e9f0 tx=0x7f602000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602000ccc0 con 0x7f60301039a0 2024-04-25T02:09:00.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60301a1c00 con 0x7f60301039a0 2024-04-25T02:09:00.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f60200035f0 con 0x7f60301039a0 2024-04-25T02:09:00.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602000ce60 con 0x7f60301039a0 2024-04-25T02:09:00.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.354+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60301a21a0 con 0x7f60301039a0 2024-04-25T02:09:00.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.355+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603010abf0 con 0x7f60301039a0 2024-04-25T02:09:00.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.358+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f60200037a0 con 0x7f60301039a0 2024-04-25T02:09:00.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.359+0000 7f6027e00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 0x7f60140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.359+0000 7f6026000640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 0x7f60140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.359+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f60200cf320 con 0x7f60301039a0 2024-04-25T02:09:00.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.360+0000 7f6026000640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 0x7f60140a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6018009bd0 tx=0x7f6018005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.363+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f602009c230 con 0x7f60301039a0 2024-04-25T02:09:00.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:00 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3954226660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:00 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4038051583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.606+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f603002d170 con 0x7f60301039a0 2024-04-25T02:09:00.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.608+0000 7f6027e00640 1 -- 172.21.15.137:0/2231470112 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f602009bb30 con 0x7f60301039a0 2024-04-25T02:09:00.616 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:00.616 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:09:00.616 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 msgr2=0x7f60140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 0x7f60140a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6018009bd0 tx=0x7f6018005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 msgr2=0x7f6030199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f602000e9f0 tx=0x7f602000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 shutdown_connections 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f60140a2c10 0x7f60140a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6030105550 0x7f60301a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6030104b90 0x7f603019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 --2- 172.21.15.137:0/2231470112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60301039a0 0x7f6030199d00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 >> 172.21.15.137:0/2231470112 conn(0x7f60300fef30 msgr2=0x7f6030107dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 shutdown_connections 2024-04-25T02:09:00.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.611+0000 7f6035a00640 1 -- 172.21.15.137:0/2231470112 wait complete. 2024-04-25T02:09:00.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T02:07:18.852775+0000', 'modified': '2024-04-25T02:07:24.393065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24559, 'mds_2': 24538}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6835/2970303147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6834', 'nonce': 2970303147}, {'type': 'v1', 'addr': '172.21.15.163:6835', 'nonce': 2970303147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6837/432820443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6836', 'nonce': 432820443}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 432820443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/1300618267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 1300618267}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 1300618267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6837/1033703342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 1033703342}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 1033703342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.174:6839/695835924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 695835924}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 695835924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6839/2170091547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6838', 'nonce': 2170091547}, {'type': 'v1', 'addr': '172.21.15.163:6839', 'nonce': 2170091547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24560, 24538, 24559]} 2024-04-25T02:09:00.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T02:09:00.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T02:09:00.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:00 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3954226660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:00 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4038051583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:00 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3954226660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:00 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4038051583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 -- 172.21.15.137:0/645642734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc1039a0 msgr2=0x7f30dc103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 --2- 172.21.15.137:0/645642734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc1039a0 0x7f30dc103dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009900 tx=0x7f30cc02a410 comp rx=0 tx=0).stop 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 -- 172.21.15.137:0/645642734 shutdown_connections 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 --2- 172.21.15.137:0/645642734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc105550 0x7f30dc10bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 --2- 172.21.15.137:0/645642734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc105010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 --2- 172.21.15.137:0/645642734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc1039a0 0x7f30dc103dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 -- 172.21.15.137:0/645642734 >> 172.21.15.137:0/645642734 conn(0x7f30dc0fef30 msgr2=0x7f30dc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 -- 172.21.15.137:0/645642734 shutdown_connections 2024-04-25T02:09:00.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.836+0000 7f30e1200640 1 -- 172.21.15.137:0/645642734 wait complete. 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.837+0000 7f30e1200640 1 Processor -- start 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.837+0000 7f30e1200640 1 -- start start 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc105550 0x7f30dc1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc10f7a0 con 0x7f30dc104b90 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc10f620 con 0x7f30dc1039a0 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30e1200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc10f920 con 0x7f30dc105550 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:57168/0 (socket says 172.21.15.137:57168) 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 -- 172.21.15.137:0/3249830399 learned_addr learned my addr 172.21.15.137:0/3249830399 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30da800640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc105550 0x7f30dc1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 -- 172.21.15.137:0/3249830399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc105550 msgr2=0x7f30dc1a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc105550 0x7f30dc1a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 -- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 msgr2=0x7f30dc19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d9e00640 1 -- 172.21.15.137:0/3249830399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc1a19e0 con 0x7f30dc1039a0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.838+0000 7f30d1400640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0316a0 tx=0x7f30cc032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30d3400640 1 -- 172.21.15.137:0/3249830399 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc03f030 con 0x7f30dc1039a0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30d3400640 1 -- 172.21.15.137:0/3249830399 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30cc003d00 con 0x7f30dc1039a0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1a1c70 con 0x7f30dc1039a0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30d3400640 1 -- 172.21.15.137:0/3249830399 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc035070 con 0x7f30dc1039a0 2024-04-25T02:09:00.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.839+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc1a21b0 con 0x7f30dc1039a0 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.842+0000 7f30d3400640 1 -- 172.21.15.137:0/3249830399 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f30cc042030 con 0x7f30dc1039a0 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 Processor -- start 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 -- start start 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 0x55ebf0444c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf0447750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ebf033fed0 con 0x55ebf043f760 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55ebf03a2df0 con 0x55ebf0440150 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30e3d22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ebf034b8d0 con 0x55ebf04452c0 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42362/0 (socket says 172.21.15.137:42362) 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30da800640 1 -- 172.21.15.137:0/3926156120 learned_addr learned my addr 172.21.15.137:0/3926156120 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30d1400640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf0447750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.843+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 0x55ebf0444c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 -- 172.21.15.137:0/3926156120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 msgr2=0x55ebf0444c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 0x55ebf0444c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 -- 172.21.15.137:0/3926156120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 msgr2=0x55ebf043fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 -- 172.21.15.137:0/3926156120 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf00b72d0 con 0x55ebf04452c0 2024-04-25T02:09:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30da800640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 0x55ebf0444c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d1400640 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf0447750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fa0 tx=0x7f30c40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be8711b83142fea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d3400640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 0x7f30c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30cb400640 1 -- 172.21.15.137:0/3926156120 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004030 con 0x55ebf04452c0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30cb400640 1 -- 172.21.15.137:0/3926156120 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30c4005520 con 0x55ebf04452c0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30cb400640 1 -- 172.21.15.137:0/3926156120 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4004dd0 con 0x55ebf04452c0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30d3400640 1 -- 172.21.15.137:0/3249830399 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f30cc0ef360 con 0x7f30dc1039a0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.844+0000 7f30da800640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 0x7f30c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 -- 172.21.15.137:0/3926156120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 msgr2=0x55ebf0447750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf0447750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fa0 tx=0x7f30c40118d0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 -- 172.21.15.137:0/3926156120 shutdown_connections 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf0447750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf0440150 0x55ebf0444c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3926156120 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf043f760 0x55ebf043fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 -- 172.21.15.137:0/3926156120 >> 172.21.15.137:0/3926156120 conn(0x55ebf043add0 msgr2=0x55ebf043b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30da800640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 0x7f30c00a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ebf04409b0 tx=0x7f30d4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 -- 172.21.15.137:0/3926156120 shutdown_connections 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.845+0000 7f30e3d22740 1 -- 172.21.15.137:0/3926156120 wait complete. 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 -- start start 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 Processor -- start 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0449a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0449fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ebf035ed20 con 0x55ebf04452c0 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55ebf039edb0 con 0x55ebf043f760 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0448270 con 0x55ebf0440150 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.846+0000 7f30e3d22740 10 client.0 _ll_register_callbacks cb 0x55ebf0399f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42378/0 (socket says 172.21.15.137:42378) 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 -- 172.21.15.137:0/3761026173 learned_addr learned my addr 172.21.15.137:0/3761026173 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30d1400640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0449fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0449a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 -- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 msgr2=0x55ebf0449fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0449fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 -- 172.21.15.137:0/3761026173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 msgr2=0x55ebf0449a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0449a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 -- 172.21.15.137:0/3761026173 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf01816b0 con 0x55ebf04452c0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30d1400640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0449fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30da800640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f30d4003bc0 tx=0x7f30d4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b800d1dd9ba721f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.847+0000 7f30bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4004310 con 0x55ebf04452c0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f30d40044b0 con 0x55ebf04452c0 2024-04-25T02:09:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c4005520 con 0x55ebf04452c0 2024-04-25T02:09:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f30d40046b0 con 0x55ebf04452c0 2024-04-25T02:09:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30e3d22740 10 client.14907 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ebf0454430 con 0x55ebf04452c0 2024-04-25T02:09:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.848+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30c4005520 con 0x55ebf04452c0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f30d4026070 con 0x55ebf04452c0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 10 client.14907 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 10 client.14907 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 20 client.14907 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf0456ce0 0x55ebf0458150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 4 client.14907 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebf03b0330 con 0x55ebf0456ce0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.849+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf0456ce0 0x55ebf0458150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.850+0000 7f30d9e00640 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf0456ce0 0x55ebf0458150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d937cbca576cf756 server_cookie=c404ba3494aa0a3b in_seq=0 out_seq=0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.850+0000 7f30bfe00640 10 client.14907 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.850+0000 7f30bfe00640 1 -- 172.21.15.137:0/3761026173 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ebf03b0330 con 0x55ebf0456ce0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.850+0000 7f30bfe00640 10 client.14907 handle_command_reply: tid=0 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.850+0000 7f30e3d22740 1 client.14907 shutdown 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 msgr2=0x55ebf0450fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f30d4003bc0 tx=0x7f30d4004ab0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 shutdown_connections 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf0450fa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf0456ce0 0x55ebf0458150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0449fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 --2- 172.21.15.137:0/3761026173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0449a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 >> 172.21.15.137:0/3761026173 conn(0x55ebf043add0 msgr2=0x55ebf0439f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30bfe00640 0 client.14907 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 shutdown_connections 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 1 -- 172.21.15.137:0/3761026173 wait complete. 2024-04-25T02:09:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.851+0000 7f30e3d22740 20 client.14907 trim_cache size 0 max 16384 2024-04-25T02:09:00.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.870+0000 7f30e3d22740 1 Processor -- start 2024-04-25T02:09:00.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.870+0000 7f30e3d22740 1 -- start start 2024-04-25T02:09:00.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0440bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf043b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0456490 con 0x55ebf04452c0 2024-04-25T02:09:00.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0456b60 con 0x55ebf043f760 2024-04-25T02:09:00.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30e3d22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0457230 con 0x55ebf0440150 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30d1400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30d1400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37278/0 (socket says 172.21.15.137:37278) 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30d1400640 1 -- 172.21.15.137:0/4079226685 learned_addr learned my addr 172.21.15.137:0/4079226685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30da800640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf043b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.871+0000 7f30d9e00640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0440bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 -- 172.21.15.137:0/4079226685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 msgr2=0x55ebf0440bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0440bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 -- 172.21.15.137:0/4079226685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 msgr2=0x55ebf043b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf043b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 -- 172.21.15.137:0/4079226685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf0444830 con 0x55ebf0440150 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30da800640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf043b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30d1400640 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009380 tx=0x7f30c4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeefacf136ca114b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30caa00640 1 -- 172.21.15.137:0/4079226685 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c401d040 con 0x55ebf0440150 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30caa00640 1 -- 172.21.15.137:0/4079226685 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30c401e040 con 0x55ebf0440150 2024-04-25T02:09:00.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.872+0000 7f30caa00640 1 -- 172.21.15.137:0/4079226685 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c400f990 con 0x55ebf0440150 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- 172.21.15.137:0/4079226685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 msgr2=0x55ebf0450f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009380 tx=0x7f30c4009310 comp rx=0 tx=0).stop 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- 172.21.15.137:0/4079226685 shutdown_connections 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf04452c0 0x55ebf043b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf0440150 0x55ebf0450f60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 --2- 172.21.15.137:0/4079226685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf0440bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- 172.21.15.137:0/4079226685 >> 172.21.15.137:0/4079226685 conn(0x55ebf043add0 msgr2=0x55ebf0435b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- 172.21.15.137:0/4079226685 shutdown_connections 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- 172.21.15.137:0/4079226685 wait complete. 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.873+0000 7f30e3d22740 1 -- start start 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 Processor -- start 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf044eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf04bb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0457fd0 con 0x55ebf0440150 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55ebf0457900 con 0x55ebf043f760 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ebf04586a0 con 0x55ebf04452c0 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30e3d22740 10 client.0 _ll_register_callbacks cb 0x7f30d4011e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30d1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30d1400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42402/0 (socket says 172.21.15.137:42402) 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30d1400640 1 -- 172.21.15.137:0/2822531769 learned_addr learned my addr 172.21.15.137:0/2822531769 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30d9e00640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf044eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.874+0000 7f30da800640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf04bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 -- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 msgr2=0x55ebf04bb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf04bb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 -- 172.21.15.137:0/2822531769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 msgr2=0x55ebf044eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf044eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 -- 172.21.15.137:0/2822531769 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf0444380 con 0x55ebf0440150 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30da800640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf04bb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d9e00640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf044eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30d1400640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000c00 tx=0x7f30c40056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facd46b78a8a2af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4032070 con 0x55ebf0440150 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f30c4003800 con 0x55ebf0440150 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c401e040 con 0x55ebf0440150 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.875+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f30c403e050 con 0x55ebf0440150 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 10 client.14913 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ebf04bc830 con 0x55ebf0440150 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30c401e040 con 0x55ebf0440150 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f30c4019490 con 0x55ebf0440150 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 10 client.14913 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 10 client.14913 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 20 client.14913 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf04c0c70 0x55ebf04bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 4 client.14913 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "status"}) -- 0x55ebf03aa680 con 0x55ebf04c0c70 2024-04-25T02:09:00.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.876+0000 7f30d9e00640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf04c0c70 0x55ebf04bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30d9e00640 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf04c0c70 0x55ebf04bf980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=568a1cdd30b30fe5 server_cookie=fef5d16ffd3eb209 in_seq=0 out_seq=0 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30bfe00640 10 client.14913 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30bfe00640 1 -- 172.21.15.137:0/2822531769 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ebf03aa680 con 0x55ebf04c0c70 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30bfe00640 10 client.14913 handle_command_reply: tid=0 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 client.14913 shutdown 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 msgr2=0x55ebf04b8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000c00 tx=0x7f30c40056b0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 shutdown_connections 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55ebf04c0c70 0x55ebf04bf980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ebf04452c0 0x55ebf04bb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ebf0440150 0x55ebf04b8c70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30bfe00640 0 client.14913 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 --2- 172.21.15.137:0/2822531769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebf043f760 0x55ebf044eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.877+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 >> 172.21.15.137:0/2822531769 conn(0x55ebf043add0 msgr2=0x55ebf043b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 shutdown_connections 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e3d22740 1 -- 172.21.15.137:0/2822531769 wait complete. 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e3d22740 20 client.14913 trim_cache size 0 max 16384 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 2, 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24538, 2024-04-25T02:09:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 97.494430907999998, 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 125.240076711 2024-04-25T02:09:00.891 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 msgr2=0x7f30c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 0x7f30c00a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ebf04409b0 tx=0x7f30d4009500 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 msgr2=0x7f30dc199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0316a0 tx=0x7f30cc032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 shutdown_connections 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f30c00a2c10 0x7f30c00a50d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30dc105550 0x7f30dc1a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30dc104b90 0x7f30dc19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 --2- 172.21.15.137:0/3249830399 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30dc1039a0 0x7f30dc199dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.878+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 >> 172.21.15.137:0/3249830399 conn(0x7f30dc0fef30 msgr2=0x7f30dc107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.879+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 shutdown_connections 2024-04-25T02:09:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:00.879+0000 7f30e1200640 1 -- 172.21.15.137:0/3249830399 wait complete. 2024-04-25T02:09:00.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T02:09:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 -- 172.21.15.137:0/1268852146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728109830 msgr2=0x7f67281100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 --2- 172.21.15.137:0/1268852146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728109830 0x7f67281100c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6720009be0 tx=0x7f672002a6d0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 -- 172.21.15.137:0/1268852146 shutdown_connections 2024-04-25T02:09:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 --2- 172.21.15.137:0/1268852146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728109830 0x7f67281100c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 --2- 172.21.15.137:0/1268852146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728108e70 0x7f67281092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 --2- 172.21.15.137:0/1268852146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728107c80 0x7f67281080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 -- 172.21.15.137:0/1268852146 >> 172.21.15.137:0/1268852146 conn(0x7f6728076c10 msgr2=0x7f6728079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 -- 172.21.15.137:0/1268852146 shutdown_connections 2024-04-25T02:09:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.096+0000 7f672ea00640 1 -- 172.21.15.137:0/1268852146 wait complete. 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 Processor -- start 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 -- start start 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728108e70 0x7f672819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728109830 0x7f67281a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6728113a30 con 0x7f6728109830 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f67281138b0 con 0x7f6728107c80 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672ea00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6728113bb0 con 0x7f6728108e70 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728109830 0x7f67281a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:57216/0 (socket says 172.21.15.137:57216) 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672d600640 1 -- 172.21.15.137:0/182490363 learned_addr learned my addr 172.21.15.137:0/182490363 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.098+0000 7f672cc00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728108e70 0x7f672819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 -- 172.21.15.137:0/182490363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728108e70 msgr2=0x7f672819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728108e70 0x7f672819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 -- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728109830 msgr2=0x7f67281a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728109830 0x7f67281a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 -- 172.21.15.137:0/182490363 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67281a5c70 con 0x7f6728107c80 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672d600640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f671c00e9a0 tx=0x7f671c00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f6726000640 1 -- 172.21.15.137:0/182490363 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00cd80 con 0x7f6728107c80 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f6726000640 1 -- 172.21.15.137:0/182490363 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f671c010930 con 0x7f6728107c80 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67281a5f60 con 0x7f6728107c80 2024-04-25T02:09:01.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.099+0000 7f6726000640 1 -- 172.21.15.137:0/182490363 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c018a70 con 0x7f6728107c80 2024-04-25T02:09:01.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.100+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67281a63c0 con 0x7f6728107c80 2024-04-25T02:09:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 Processor -- start 2024-04-25T02:09:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6726000640 1 -- 172.21.15.137:0/182490363 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f671c018c10 con 0x7f6728107c80 2024-04-25T02:09:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 -- start start 2024-04-25T02:09:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922729e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55792272a4d0 0x55792272c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557922624ed0 con 0x557922724970 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x557922687df0 con 0x55792272a4d0 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f6732e04740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5579226308d0 con 0x557922725360 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42432/0 (socket says 172.21.15.137:42432) 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f672e000640 1 -- 172.21.15.137:0/2440181196 learned_addr learned my addr 172.21.15.137:0/2440181196 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.103+0000 7f672cc00640 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55792272a4d0 0x55792272c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672d600640 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922729e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 -- 172.21.15.137:0/2440181196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 msgr2=0x557922729e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922729e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 -- 172.21.15.137:0/2440181196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55792272a4d0 msgr2=0x55792272c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55792272a4d0 0x55792272c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 -- 172.21.15.137:0/2440181196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792239c2d0 con 0x557922724970 2024-04-25T02:09:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f672e000640 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f672002acc0 tx=0x7f6720005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e351d88497cd43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f671a600640 1 -- 172.21.15.137:0/2440181196 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720041030 con 0x557922724970 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f6726000640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 0x7f67100a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f671a600640 1 -- 172.21.15.137:0/2440181196 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6720030b90 con 0x557922724970 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.104+0000 7f671a600640 1 -- 172.21.15.137:0/2440181196 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720036040 con 0x557922724970 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6726000640 1 -- 172.21.15.137:0/182490363 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f671c0cf400 con 0x7f6728107c80 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f672d600640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 0x7f67100a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 -- 172.21.15.137:0/2440181196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 msgr2=0x557922724d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f672002acc0 tx=0x7f6720005fd0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 -- 172.21.15.137:0/2440181196 shutdown_connections 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55792272a4d0 0x55792272c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922729e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 --2- 172.21.15.137:0/2440181196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x557922724d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 -- 172.21.15.137:0/2440181196 >> 172.21.15.137:0/2440181196 conn(0x55792271ffe0 msgr2=0x5579227203e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 -- 172.21.15.137:0/2440181196 shutdown_connections 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f6732e04740 1 -- 172.21.15.137:0/2440181196 wait complete. 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.105+0000 7f672d600640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 0x7f67100a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f671c098070 tx=0x7f671c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 -- start start 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 Processor -- start 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x55792272ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55792272a4d0 0x5579227361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557922643d20 con 0x557922724970 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x557922683db0 con 0x557922725360 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.106+0000 7f6732e04740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55792272d420 con 0x55792272a4d0 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f6732e04740 10 client.0 _ll_register_callbacks cb 0x55792267ef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x55792272ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:57242/0 (socket says 172.21.15.137:57242) 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 -- 172.21.15.137:0/2805968464 learned_addr learned my addr 172.21.15.137:0/2805968464 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672e000640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55792272a4d0 0x5579227361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 -- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55792272a4d0 msgr2=0x5579227361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55792272a4d0 0x5579227361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 -- 172.21.15.137:0/2805968464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 msgr2=0x55792272ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x55792272ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 -- 172.21.15.137:0/2805968464 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579224666b0 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672e000640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x55792272ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f672cc00640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6714012700 tx=0x7f6714012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22e545d3693c46f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.107+0000 7f670ea00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400f8c0 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f671400fa60 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6720030b90 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f671400fc60 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f6732e04740 10 client.25013 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5579227395d0 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.108+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6720030b90 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f6714010550 con 0x557922725360 2024-04-25T02:09:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 10 client.25013 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 10 client.25013 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 20 client.25013 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55792273bbf0 0x55792273d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 4 client.25013 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557922695330 con 0x55792273bbf0 2024-04-25T02:09:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.109+0000 7f672e000640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55792273bbf0 0x55792273d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.110+0000 7f672e000640 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55792273bbf0 0x55792273d060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d6e19ecd9182559 server_cookie=34d9ce77bb9dd033 in_seq=0 out_seq=0 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.110+0000 7f670ea00640 10 client.25013 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f670ea00640 1 -- 172.21.15.137:0/2805968464 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557922695330 con 0x55792273bbf0 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f670ea00640 10 client.25013 handle_command_reply: tid=0 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 client.25013 shutdown 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 msgr2=0x55792272f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6714012700 tx=0x7f6714012bc0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 shutdown_connections 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55792273bbf0 0x55792273d060 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55792272a4d0 0x5579227361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922725360 0x55792272f160 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f670ea00640 0 client.25013 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 --2- 172.21.15.137:0/2805968464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557922724970 0x55792272ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 >> 172.21.15.137:0/2805968464 conn(0x55792271ffe0 msgr2=0x55792271f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 shutdown_connections 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 1 -- 172.21.15.137:0/2805968464 wait complete. 2024-04-25T02:09:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.111+0000 7f6732e04740 20 client.25013 trim_cache size 0 max 16384 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 Processor -- start 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 -- start start 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x55792272e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922736160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x55792272ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55792273b3a0 con 0x55792272a4d0 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55792273ba70 con 0x557922724970 2024-04-25T02:09:01.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.131+0000 7f6732e04740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55792273c140 con 0x557922725360 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x55792272ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922736160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x55792272ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42462/0 (socket says 172.21.15.137:42462) 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672e000640 1 -- 172.21.15.137:0/1570557835 learned_addr learned my addr 172.21.15.137:0/1570557835 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672e000640 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x55792272e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 -- 172.21.15.137:0/1570557835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 msgr2=0x55792272e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x55792272e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 -- 172.21.15.137:0/1570557835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 msgr2=0x55792272ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x55792272ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 -- 172.21.15.137:0/1570557835 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55792272fc10 con 0x557922725360 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.132+0000 7f672cc00640 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922736160 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6714009380 tx=0x7f6714009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd63e8801ede6a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6719c00640 1 -- 172.21.15.137:0/1570557835 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714010c30 con 0x557922725360 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6719c00640 1 -- 172.21.15.137:0/1570557835 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6714010dd0 con 0x557922725360 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6719c00640 1 -- 172.21.15.137:0/1570557835 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671401c470 con 0x557922725360 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 -- 172.21.15.137:0/1570557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 msgr2=0x557922736160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922736160 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6714009380 tx=0x7f6714009ec0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 -- 172.21.15.137:0/1570557835 shutdown_connections 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x55792272ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x557922736160 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 --2- 172.21.15.137:0/1570557835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x55792272e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.133+0000 7f6732e04740 1 -- 172.21.15.137:0/1570557835 >> 172.21.15.137:0/1570557835 conn(0x55792271ffe0 msgr2=0x557922726860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.134+0000 7f6732e04740 1 -- 172.21.15.137:0/1570557835 shutdown_connections 2024-04-25T02:09:01.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.134+0000 7f6732e04740 1 -- 172.21.15.137:0/1570557835 wait complete. 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.134+0000 7f6732e04740 1 -- start start 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.134+0000 7f6732e04740 1 Processor -- start 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.134+0000 7f6732e04740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x557922732390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x5579227328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55792273cee0 con 0x55792272a4d0 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55792273c810 con 0x557922724970 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55792273d5b0 con 0x557922725360 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f6732e04740 10 client.0 _ll_register_callbacks cb 0x7f6714009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42474/0 (socket says 172.21.15.137:42474) 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 -- 172.21.15.137:0/1448032914 learned_addr learned my addr 172.21.15.137:0/1448032914 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672cc00640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x5579227328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x557922732390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 -- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 msgr2=0x5579227328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x5579227328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 -- 172.21.15.137:0/1448032914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 msgr2=0x557922732390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x557922732390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 -- 172.21.15.137:0/1448032914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579227358d0 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.135+0000 7f672e000640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x557922733210 tx=0x7f6720005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7e181baecaaf84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720050040 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f6720030640 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6714010dd0 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6720041040 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f6732e04740 10 client.14931 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5579227a2040 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6714010dd0 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.136+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f672002f900 con 0x55792272a4d0 2024-04-25T02:09:01.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 10 client.14931 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 10 client.14931 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 20 client.14931 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x5579227a6760 0x5579227a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 4 client.14931 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "status"}) -- 0x55792268f680 con 0x5579227a6760 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f672cc00640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x5579227a6760 0x5579227a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f670ea00640 10 client.14931 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.137+0000 7f672cc00640 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x5579227a6760 0x5579227a5470 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7aa0d403befde03 server_cookie=3c7822f2f49f41d in_seq=0 out_seq=0 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f670ea00640 1 -- 172.21.15.137:0/1448032914 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55792268f680 con 0x5579227a6760 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f670ea00640 10 client.14931 handle_command_reply: tid=0 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 client.14931 shutdown 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 msgr2=0x557922735290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x557922733210 tx=0x7f6720005fd0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 shutdown_connections 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x5579227a6760 0x5579227a5470 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55792272a4d0 0x557922735290 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557922725360 0x5579227328d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f670ea00640 0 client.14931 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 --2- 172.21.15.137:0/1448032914 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557922724970 0x557922732390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 >> 172.21.15.137:0/1448032914 conn(0x55792271ffe0 msgr2=0x55792272e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 shutdown_connections 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 1 -- 172.21.15.137:0/1448032914 wait complete. 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.138+0000 7f6732e04740 20 client.14931 trim_cache size 0 max 16384 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 1, 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24559, 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:01.149 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 98.766827523000003, 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 119.805562259 2024-04-25T02:09:01.150 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 msgr2=0x7f67100a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 0x7f67100a5050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f671c098070 tx=0x7f671c000bc0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 msgr2=0x7f672819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f671c00e9a0 tx=0x7f671c00ee60 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 shutdown_connections 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f67100a2b90 0x7f67100a5050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6728109830 0x7f67281a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6728108e70 0x7f672819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 --2- 172.21.15.137:0/182490363 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6728107c80 0x7f672819e050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 >> 172.21.15.137:0/182490363 conn(0x7f6728076c10 msgr2=0x7f672810c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 shutdown_connections 2024-04-25T02:09:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.139+0000 7f672ea00640 1 -- 172.21.15.137:0/182490363 wait complete. 2024-04-25T02:09:01.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 -- 172.21.15.137:0/121184997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c104a70 msgr2=0x7fea7c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 --2- 172.21.15.137:0/121184997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c104a70 0x7fea7c104ef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fea68009900 tx=0x7fea6802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 -- 172.21.15.137:0/121184997 shutdown_connections 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 --2- 172.21.15.137:0/121184997 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c10bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 --2- 172.21.15.137:0/121184997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c104a70 0x7fea7c104ef0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 --2- 172.21.15.137:0/121184997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c103880 0x7fea7c103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 -- 172.21.15.137:0/121184997 >> 172.21.15.137:0/121184997 conn(0x7fea7c0fedf0 msgr2=0x7fea7c101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 -- 172.21.15.137:0/121184997 shutdown_connections 2024-04-25T02:09:01.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.351+0000 7fea80e00640 1 -- 172.21.15.137:0/121184997 wait complete. 2024-04-25T02:09:01.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 Processor -- start 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 -- start start 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 0x7fea7c19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c1a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c10f680 con 0x7fea7c103880 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c10f500 con 0x7fea7c105430 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.352+0000 7fea80e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c10f800 con 0x7fea7c104a70 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42486/0 (socket says 172.21.15.137:42486) 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7b400640 1 -- 172.21.15.137:0/316401466 learned_addr learned my addr 172.21.15.137:0/316401466 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c1a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7aa00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 0x7fea7c19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 -- 172.21.15.137:0/316401466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 msgr2=0x7fea7c19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 0x7fea7c19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 -- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 msgr2=0x7fea7c199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 -- 172.21.15.137:0/316401466 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c1a1890 con 0x7fea7c105430 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7b400640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7aa00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 0x7fea7c19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.353+0000 7fea7be00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c1a11f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea7400ec50 tx=0x7fea7400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.354+0000 7fea73e00640 1 -- 172.21.15.137:0/316401466 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74003b70 con 0x7fea7c105430 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.354+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1a1b80 con 0x7fea7c105430 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.354+0000 7fea73e00640 1 -- 172.21.15.137:0/316401466 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea74003d10 con 0x7fea7c105430 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.354+0000 7fea73e00640 1 -- 172.21.15.137:0/316401466 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74010920 con 0x7fea7c105430 2024-04-25T02:09:01.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.354+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1a2080 con 0x7fea7c105430 2024-04-25T02:09:01.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.357+0000 7fea851f3740 1 Processor -- start 2024-04-25T02:09:01.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.357+0000 7fea73e00640 1 -- 172.21.15.137:0/316401466 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fea74004020 con 0x7fea7c105430 2024-04-25T02:09:01.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.357+0000 7fea851f3740 1 -- start start 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed22d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed2a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55694ec22ed0 con 0x55694ed23360 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55694ec85df0 con 0x55694ed22970 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea851f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55694ec2e8d0 con 0x55694ed284d0 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42498/0 (socket says 172.21.15.137:42498) 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 -- 172.21.15.137:0/3724493075 learned_addr learned my addr 172.21.15.137:0/3724493075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7aa00640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed2a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7aa00640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed22d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 -- 172.21.15.137:0/3724493075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 msgr2=0x55694ed2a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed2a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 -- 172.21.15.137:0/3724493075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 msgr2=0x55694ed22d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.358+0000 7fea7b400640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed22d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea7b400640 1 -- 172.21.15.137:0/3724493075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55694e99a2d0 con 0x55694ed23360 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea7aa00640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed22d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea7b400640 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0115f0 tx=0x7fea6c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed80656d5b081fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea73e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 0x7fea600a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea73e00640 1 -- 172.21.15.137:0/316401466 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fea740cf6a0 con 0x7fea7c105430 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea70c00640 1 -- 172.21.15.137:0/3724493075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c005020 con 0x55694ed23360 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea70c00640 1 -- 172.21.15.137:0/3724493075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea6c0047a0 con 0x55694ed23360 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea70c00640 1 -- 172.21.15.137:0/3724493075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00fac0 con 0x55694ed23360 2024-04-25T02:09:01.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.359+0000 7fea7aa00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 0x7fea600a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 -- 172.21.15.137:0/3724493075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 msgr2=0x55694ed27e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0115f0 tx=0x7fea6c011ab0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea7aa00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 0x7fea600a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea68006010 tx=0x7fea68000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 -- 172.21.15.137:0/3724493075 shutdown_connections 2024-04-25T02:09:01.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed2a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed27e60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 --2- 172.21.15.137:0/3724493075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed22d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 -- 172.21.15.137:0/3724493075 >> 172.21.15.137:0/3724493075 conn(0x55694ed1dfe0 msgr2=0x55694ed1e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 -- 172.21.15.137:0/3724493075 shutdown_connections 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.360+0000 7fea851f3740 1 -- 172.21.15.137:0/3724493075 wait complete. 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 -- start start 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 Processor -- start 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed23360 0x55694ed2d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed34140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55694ec41d20 con 0x55694ed22970 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55694ec81db0 con 0x55694ed23360 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55694ed2b480 con 0x55694ed284d0 2024-04-25T02:09:01.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea851f3740 10 client.0 _ll_register_callbacks cb 0x55694ec7cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea7b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42500/0 (socket says 172.21.15.137:42500) 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.361+0000 7fea7b400640 1 -- 172.21.15.137:0/1988835647 learned_addr learned my addr 172.21.15.137:0/1988835647 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7be00640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed34140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed23360 0x55694ed2d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 -- 172.21.15.137:0/1988835647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 msgr2=0x55694ed34140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed34140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 -- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed23360 msgr2=0x55694ed2d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed23360 0x55694ed2d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 -- 172.21.15.137:0/1988835647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55694ea646b0 con 0x55694ed22970 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea7b400640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea6c01b040 tx=0x7fea6c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b65fdfd7c7577b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea65600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c028070 con 0x55694ed22970 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.362+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fea6c004020 con 0x55694ed22970 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea6c0047a0 con 0x55694ed22970 2024-04-25T02:09:01.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea6c004220 con 0x55694ed22970 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 10 client.14943 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55694ed374b0 con 0x55694ed22970 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea6c0047a0 con 0x55694ed22970 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fea6c003710 con 0x55694ed22970 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 10 client.14943 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 10 client.14943 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 20 client.14943 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694ed398e0 0x55694ed3ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 4 client.14943 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.363+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55694ec93330 con 0x55694ed398e0 2024-04-25T02:09:01.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.364+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694ed398e0 0x55694ed3ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.364+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694ed398e0 0x55694ed3ad50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3efa40344364b56 server_cookie=25bdeea31a050e21 in_seq=0 out_seq=0 2024-04-25T02:09:01.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.364+0000 7fea65600640 10 client.14943 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:01.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.365+0000 7fea65600640 1 -- 172.21.15.137:0/1988835647 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55694ec93330 con 0x55694ed398e0 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.365+0000 7fea65600640 10 client.14943 handle_command_reply: tid=0 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.365+0000 7fea851f3740 1 client.14943 shutdown 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.365+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 msgr2=0x55694ed2cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.365+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea6c01b040 tx=0x7fea6c005250 comp rx=0 tx=0).stop 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 shutdown_connections 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694ed398e0 0x55694ed3ad50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed34140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed23360 0x55694ed2d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 --2- 172.21.15.137:0/1988835647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed22970 0x55694ed2cbc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 >> 172.21.15.137:0/1988835647 conn(0x55694ed1dfe0 msgr2=0x55694ed1d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea65600640 0 client.14943 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 shutdown_connections 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 1 -- 172.21.15.137:0/1988835647 wait complete. 2024-04-25T02:09:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.366+0000 7fea851f3740 20 client.14943 trim_cache size 0 max 16384 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 Processor -- start 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 -- start start 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed1e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed284d0 0x55694ed1c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55694ed39090 con 0x55694ed23360 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55694ed39760 con 0x55694ed284d0 2024-04-25T02:09:01.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.387+0000 7fea851f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55694ed39e30 con 0x55694ed22970 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed284d0 0x55694ed1c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37392/0 (socket says 172.21.15.137:37392) 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 -- 172.21.15.137:0/3102118534 learned_addr learned my addr 172.21.15.137:0/3102118534 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7aa00640 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed1e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 -- 172.21.15.137:0/3102118534 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed284d0 msgr2=0x55694ed1c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed284d0 0x55694ed1c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 -- 172.21.15.137:0/3102118534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 msgr2=0x55694ed1e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed1e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 -- 172.21.15.137:0/3102118534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55694ed1c620 con 0x55694ed22970 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea7b400640 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0058c0 tx=0x7fea6c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78795bcfed11bdf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.388+0000 7fea67e00640 1 -- 172.21.15.137:0/3102118534 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c028040 con 0x55694ed22970 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea67e00640 1 -- 172.21.15.137:0/3102118534 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea6c004780 con 0x55694ed22970 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea67e00640 1 -- 172.21.15.137:0/3102118534 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00fc00 con 0x55694ed22970 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 -- 172.21.15.137:0/3102118534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 msgr2=0x55694ed23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fea6c0058c0 tx=0x7fea6c005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 -- 172.21.15.137:0/3102118534 shutdown_connections 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed284d0 0x55694ed1c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed1e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 --2- 172.21.15.137:0/3102118534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed22970 0x55694ed23b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 -- 172.21.15.137:0/3102118534 >> 172.21.15.137:0/3102118534 conn(0x55694ed1dfe0 msgr2=0x55694ed18d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.389+0000 7fea851f3740 1 -- 172.21.15.137:0/3102118534 shutdown_connections 2024-04-25T02:09:01.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 -- 172.21.15.137:0/3102118534 wait complete. 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 -- start start 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 Processor -- start 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55694ed3abd0 con 0x55694ed23360 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55694ed3a500 con 0x55694ed22970 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.390+0000 7fea851f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55694ed3b2a0 con 0x55694ed284d0 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea851f3740 10 client.0 _ll_register_callbacks cb 0x7fea740093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42508/0 (socket says 172.21.15.137:42508) 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 -- 172.21.15.137:0/1796632507 learned_addr learned my addr 172.21.15.137:0/1796632507 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7be00640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7b400640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 -- 172.21.15.137:0/1796632507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 msgr2=0x55694ed326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 -- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 msgr2=0x55694ed2f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed2f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 -- 172.21.15.137:0/1796632507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55694ed32c90 con 0x55694ed23360 2024-04-25T02:09:01.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea7aa00640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea680317b0 tx=0x7fea6802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b4a4274c3ac288 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.391+0000 7fea65600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68059060 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fea68053d00 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea6c004780 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea68035040 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea851f3740 10 client.14949 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55694ed9fce0 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea6c004780 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.392+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fea68048040 con 0x55694ed23360 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 10 client.14949 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:01.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 10 client.14949 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 20 client.14949 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694eda4930 0x55694eda0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 4 client.14949 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "status"}) -- 0x55694ec8d680 con 0x55694eda4930 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.393+0000 7fea7b400640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694eda4930 0x55694eda0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea7b400640 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694eda4930 0x55694eda0d70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe50fd1df4f35bac server_cookie=4e16147edee04068 in_seq=0 out_seq=0 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea65600640 10 client.14949 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea65600640 1 -- 172.21.15.137:0/1796632507 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55694ec8d680 con 0x55694eda4930 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea65600640 10 client.14949 handle_command_reply: tid=0 2024-04-25T02:09:01.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 client.14949 shutdown 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 msgr2=0x55694ed2f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea680317b0 tx=0x7fea6802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 shutdown_connections 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55694eda4930 0x55694eda0d70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55694ed284d0 0x55694ed326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55694ed23360 0x55694ed2f680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 --2- 172.21.15.137:0/1796632507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694ed22970 0x55694ed2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea65600640 0 client.14949 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 >> 172.21.15.137:0/1796632507 conn(0x55694ed1dfe0 msgr2=0x55694ed1e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 shutdown_connections 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 1 -- 172.21.15.137:0/1796632507 wait complete. 2024-04-25T02:09:01.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.394+0000 7fea851f3740 20 client.14949 trim_cache size 0 max 16384 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24560, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 101.997162339, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:01.407 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 109.59132092900001 2024-04-25T02:09:01.408 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 msgr2=0x7fea600a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 0x7fea600a5050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea68006010 tx=0x7fea68000bc0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 msgr2=0x7fea7c1a11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c1a11f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea7400ec50 tx=0x7fea7400c6a0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 shutdown_connections 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fea600a2b90 0x7fea600a5050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea7c105430 0x7fea7c1a11f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea7c104a70 0x7fea7c19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 --2- 172.21.15.137:0/316401466 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea7c103880 0x7fea7c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 >> 172.21.15.137:0/316401466 conn(0x7fea7c0fedf0 msgr2=0x7fea7c107d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 shutdown_connections 2024-04-25T02:09:01.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:01.395+0000 7fea80e00640 1 -- 172.21.15.137:0/316401466 wait complete. 2024-04-25T02:09:01.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:01 smithi137 ceph-mon[28303]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:01.418 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:01 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2231470112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:01.420 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T02:09:01.420 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:09:01.431 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:01.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T02:09:01.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:01 smithi163 ceph-mon[32577]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:01.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:01 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2231470112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:01.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:01 smithi174 ceph-mon[33171]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:01.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:01 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2231470112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:01.871 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:03.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:03 smithi137 ceph-mon[28303]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:03.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:03 smithi163 ceph-mon[32577]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:03.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:03 smithi174 ceph-mon[33171]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 -- 172.21.15.137:0/2289214278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a41022a0 msgr2=0x7f55a41026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 --2- 172.21.15.137:0/2289214278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a41022a0 0x7f55a41026c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f559400b0d0 tx=0x7f559400b3e0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 -- 172.21.15.137:0/2289214278 shutdown_connections 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 --2- 172.21.15.137:0/2289214278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a41022a0 0x7f55a41026c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 --2- 172.21.15.137:0/2289214278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a4103e40 0x7f55a410a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 --2- 172.21.15.137:0/2289214278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a4103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.971+0000 7f55ab000700 1 -- 172.21.15.137:0/2289214278 >> 172.21.15.137:0/2289214278 conn(0x7f55a40fd800 msgr2=0x7f55a40ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:03.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.972+0000 7f55ab000700 1 -- 172.21.15.137:0/2289214278 shutdown_connections 2024-04-25T02:09:03.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.972+0000 7f55ab000700 1 -- 172.21.15.137:0/2289214278 wait complete. 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.973+0000 7f55ab000700 1 Processor -- start 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.973+0000 7f55ab000700 1 -- start start 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a4103e40 0x7f55a41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410e010 con 0x7f55a41034a0 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410de90 con 0x7f55a4103e40 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55ab000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410e190 con 0x7f55a41022a0 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f559b400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:03.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37420/0 (socket says 172.21.15.137:37420) 2024-04-25T02:09:03.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 -- 172.21.15.137:0/3940298355 learned_addr learned my addr 172.21.15.137:0/3940298355 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:03.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a9000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a4103e40 0x7f55a41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 -- 172.21.15.137:0/3940298355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a4103e40 msgr2=0x7f55a41a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a4103e40 0x7f55a41a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 -- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 msgr2=0x7f55a419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f55a3e00700 1 -- 172.21.15.137:0/3940298355 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41a24d0 con 0x7f55a41022a0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.974+0000 7f559b400700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55a3e00700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5594007d90 tx=0x7f5594007dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594003e10 con 0x7f55a41022a0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5594022070 con 0x7f55a41022a0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41a2760 con 0x7f55a41022a0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559401b6c0 con 0x7f55a41022a0 2024-04-25T02:09:03.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.975+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a41a2c10 con 0x7f55a41022a0 2024-04-25T02:09:03.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.976+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a4068f20 con 0x7f55a41022a0 2024-04-25T02:09:03.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.978+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f559401d470 con 0x7f55a41022a0 2024-04-25T02:09:03.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.980+0000 7f55a1600700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 0x7f55880a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:03.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.980+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f559400f020 con 0x7f55a41022a0 2024-04-25T02:09:03.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.980+0000 7f559b400700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 0x7f55880a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:03.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.981+0000 7f559b400700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 0x7f55880a5160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f558c009680 tx=0x7f558c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:03.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:03.984+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f559409cd40 con 0x7f55a41022a0 2024-04-25T02:09:04.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.225+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f55a4075b80 con 0x7f55880a2ca0 2024-04-25T02:09:04.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.226+0000 7f55a1600700 1 -- 172.21.15.137:0/3940298355 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f55a4075b80 con 0x7f55880a2ca0 2024-04-25T02:09:04.234 INFO:teuthology.orchestra.run.smithi137.stdout:Backend: cephadm 2024-04-25T02:09:04.235 INFO:teuthology.orchestra.run.smithi137.stdout:Available: Yes 2024-04-25T02:09:04.235 INFO:teuthology.orchestra.run.smithi137.stdout:Paused: No 2024-04-25T02:09:04.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 msgr2=0x7f55880a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:04.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 0x7f55880a5160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f558c009680 tx=0x7f558c009260 comp rx=0 tx=0).stop 2024-04-25T02:09:04.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 msgr2=0x7f55a419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:04.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5594007d90 tx=0x7f5594007dc0 comp rx=0 tx=0).stop 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 shutdown_connections 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f55880a2ca0 0x7f55880a5160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55a4103e40 0x7f55a41a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55a41022a0 0x7f55a419a8c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 --2- 172.21.15.137:0/3940298355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55a41034a0 0x7f55a419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.229+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 >> 172.21.15.137:0/3940298355 conn(0x7f55a40fd800 msgr2=0x7f55a4074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.230+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 shutdown_connections 2024-04-25T02:09:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:04.230+0000 7f55ab000700 1 -- 172.21.15.137:0/3940298355 wait complete. 2024-04-25T02:09:05.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T02:09:05.552 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:05.742 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:05 smithi137 ceph-mon[28303]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:05.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:05 smithi137 ceph-mon[28303]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:05 smithi163 ceph-mon[32577]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:05 smithi163 ceph-mon[32577]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:05.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:05 smithi174 ceph-mon[33171]: from='client.25081 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:05.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:05 smithi174 ceph-mon[33171]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:07.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 -- 172.21.15.137:0/2686027850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c101e30 msgr2=0x7f827c1022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:07.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 --2- 172.21.15.137:0/2686027850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c101e30 0x7f827c1022b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f827400b0a0 tx=0x7f827400b3b0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 -- 172.21.15.137:0/2686027850 shutdown_connections 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 --2- 172.21.15.137:0/2686027850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c101e30 0x7f827c1022b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 --2- 172.21.15.137:0/2686027850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c100b10 0x7f827c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 --2- 172.21.15.137:0/2686027850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101470 0x7f827c1018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 -- 172.21.15.137:0/2686027850 >> 172.21.15.137:0/2686027850 conn(0x7f827c0fc730 msgr2=0x7f827c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 -- 172.21.15.137:0/2686027850 shutdown_connections 2024-04-25T02:09:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.658+0000 7f8281600700 1 -- 172.21.15.137:0/2686027850 wait complete. 2024-04-25T02:09:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.659+0000 7f8281600700 1 Processor -- start 2024-04-25T02:09:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.659+0000 7f8281600700 1 -- start start 2024-04-25T02:09:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 0x7f827c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 0x7f827c1a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f827c1101d0 con 0x7f827c101470 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f827c110050 con 0x7f827c100b10 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8281600700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f827c110350 con 0x7f827c101e30 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8272000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f827aa00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 0x7f827c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8272000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42538/0 (socket says 172.21.15.137:42538) 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f8272000700 1 -- 172.21.15.137:0/3725551543 learned_addr learned my addr 172.21.15.137:0/3725551543 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f827b400700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 0x7f827c1a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f827aa00700 1 -- 172.21.15.137:0/3725551543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 msgr2=0x7f827c1a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f827aa00700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 0x7f827c1a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.660+0000 7f827aa00700 1 -- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 msgr2=0x7f827c19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f827aa00700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f827aa00700 1 -- 172.21.15.137:0/3725551543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c1a2370 con 0x7f827c100b10 2024-04-25T02:09:07.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8272000700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:07.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f827b400700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 0x7f827c1a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:07.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f827aa00700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 0x7f827c19a710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f826c00e9f0 tx=0x7f826c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:07.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c00c9c0 con 0x7f827c100b10 2024-04-25T02:09:07.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f826c00cb60 con 0x7f827c100b10 2024-04-25T02:09:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c018710 con 0x7f827c100b10 2024-04-25T02:09:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c1a2660 con 0x7f827c100b10 2024-04-25T02:09:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.661+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c1a2b50 con 0x7f827c100b10 2024-04-25T02:09:07.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.662+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c068f20 con 0x7f827c100b10 2024-04-25T02:09:07.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.664+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f826c0188b0 con 0x7f827c100b10 2024-04-25T02:09:07.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.666+0000 7f8273e00700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 0x7f82600a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:07.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.666+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f826c0cf500 con 0x7f827c100b10 2024-04-25T02:09:07.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.666+0000 7f8272000700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 0x7f82600a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:07.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.666+0000 7f8272000700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 0x7f82600a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8264011590 tx=0x7f8264009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:07.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.668+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f826c09c410 con 0x7f827c100b10 2024-04-25T02:09:07.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:07 smithi137 ceph-mon[28303]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:07 smithi163 ceph-mon[32577]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.899+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f827c062670 con 0x7f82600a2ca0 2024-04-25T02:09:07.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:07 smithi174 ceph-mon[33171]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-25T02:09:07.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.939+0000 7f8273e00700 1 -- 172.21.15.137:0/3725551543 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f827c062670 con 0x7f82600a2ca0 2024-04-25T02:09:07.947 INFO:teuthology.orchestra.run.smithi137.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T02:09:07.947 INFO:teuthology.orchestra.run.smithi137.stdout:mds.a smithi137 running (119s) 24s ago 118s 12.2M - 19.0.0-2445-gd2c45d97 f68e37b807ef 711fa5fa2b2a 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.b smithi163 running (116s) 47s ago 116s 24.9M - 19.0.0-2445-gd2c45d97 f68e37b807ef 7cce14c4a471 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.c smithi174 running (2m) 47s ago 2m 19.4M - 19.0.0-2445-gd2c45d97 f68e37b807ef bccf9f57d681 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.d smithi137 running (2m) 24s ago 2m 12.4M - 19.0.0-2445-gd2c45d97 f68e37b807ef 6de09441d624 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.e smithi163 running (2m) 47s ago 2m 18.3M - 19.0.0-2445-gd2c45d97 f68e37b807ef e8aac0e79476 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.f smithi174 running (2m) 47s ago 2m 20.2M - 19.0.0-2445-gd2c45d97 f68e37b807ef 7da23759640e 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.g smithi137 running (2m) 24s ago 2m 12.3M - 19.0.0-2445-gd2c45d97 f68e37b807ef 16de271b9bc8 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.h smithi163 running (2m) 47s ago 2m 16.9M - 19.0.0-2445-gd2c45d97 f68e37b807ef 889b9474540f 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.i smithi174 running (2m) 47s ago 2m 20.1M - 19.0.0-2445-gd2c45d97 f68e37b807ef 3f58871b1352 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.j smithi137 running (2m) 24s ago 2m 12.5M - 19.0.0-2445-gd2c45d97 f68e37b807ef 63c3c430f48e 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.k smithi163 running (2m) 47s ago 2m 13.9M - 19.0.0-2445-gd2c45d97 f68e37b807ef f165f3773520 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mds.l smithi174 running (2m) 47s ago 2m 14.1M - 19.0.0-2445-gd2c45d97 f68e37b807ef e37acfb3d3de 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.x smithi137 *:9283,8765 running (10m) 24s ago 10m 513M - 19.0.0-2445-gd2c45d97 f68e37b807ef 42dc1a9dfb2f 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.y smithi163 *:8443,8765 running (8m) 47s ago 8m 452M - 19.0.0-2445-gd2c45d97 f68e37b807ef 1da1aeb9bfa2 2024-04-25T02:09:07.948 INFO:teuthology.orchestra.run.smithi137.stdout:mgr.z smithi174 *:8443,8765 running (8m) 47s ago 8m 454M - 19.0.0-2445-gd2c45d97 f68e37b807ef b5a7022bd229 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:mon.a smithi137 running (10m) 24s ago 10m 48.0M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef c1008860790e 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:mon.b smithi163 running (8m) 47s ago 8m 40.4M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 0bd69b21d62a 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:mon.c smithi174 running (8m) 47s ago 8m 40.8M 2048M 19.0.0-2445-gd2c45d97 f68e37b807ef 7c993c27c0d1 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 smithi137 running (7m) 24s ago 7m 54.9M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef ada4f49a96af 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 smithi163 running (7m) 47s ago 7m 55.8M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 5ba846fd70cc 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 smithi174 running (7m) 47s ago 7m 56.5M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 104ac170b953 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 smithi137 running (6m) 24s ago 6m 45.5M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef e96ce0d01274 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 smithi163 running (6m) 47s ago 6m 52.4M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef e5d9d9a609b9 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 smithi174 running (5m) 47s ago 5m 53.6M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 45d86797b9aa 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 smithi137 running (5m) 24s ago 5m 44.1M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 63ea63f0bd52 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 smithi163 running (4m) 47s ago 4m 53.4M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef db0edbb131a9 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.8 smithi174 running (4m) 47s ago 4m 49.0M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef d8eb69936e79 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.9 smithi137 running (3m) 24s ago 3m 43.2M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 9c647476d1ae 2024-04-25T02:09:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:osd.10 smithi163 running (3m) 47s ago 3m 46.0M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 931ae78d3174 2024-04-25T02:09:07.950 INFO:teuthology.orchestra.run.smithi137.stdout:osd.11 smithi174 running (2m) 47s ago 2m 49.4M 4272M 19.0.0-2445-gd2c45d97 f68e37b807ef 4a7d5d6fa2bb 2024-04-25T02:09:07.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 msgr2=0x7f82600a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:07.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 0x7f82600a5160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8264011590 tx=0x7f8264009260 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 msgr2=0x7f827c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 0x7f827c19a710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f826c00e9f0 tx=0x7f826c00ed00 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 shutdown_connections 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f82600a2ca0 0x7f82600a5160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f827c100b10 0x7f827c19a710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f827c101e30 0x7f827c1a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 --2- 172.21.15.137:0/3725551543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f827c101470 0x7f827c19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 >> 172.21.15.137:0/3725551543 conn(0x7f827c0fc730 msgr2=0x7f827c0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 shutdown_connections 2024-04-25T02:09:07.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:07.942+0000 7f8281600700 1 -- 172.21.15.137:0/3725551543 wait complete. 2024-04-25T02:09:08.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T02:09:09.164 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:09.577 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:09 smithi137 ceph-mon[28303]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:09.577 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:09 smithi137 ceph-mon[28303]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:09 smithi163 ceph-mon[32577]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:09 smithi163 ceph-mon[32577]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:09.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:09 smithi174 ceph-mon[33171]: from='client.25049 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:09.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:09 smithi174 ceph-mon[33171]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-25T02:09:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 -- 172.21.15.137:0/1675328357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef24103d50 msgr2=0x7fef2410a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 --2- 172.21.15.137:0/1675328357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef24103d50 0x7fef2410a600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00b0d0 tx=0x7fef1c00b3e0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 -- 172.21.15.137:0/1675328357 shutdown_connections 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 --2- 172.21.15.137:0/1675328357 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef24103d50 0x7fef2410a600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 --2- 172.21.15.137:0/1675328357 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef241021b0 0x7fef241025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 --2- 172.21.15.137:0/1675328357 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 0x7fef24103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 -- 172.21.15.137:0/1675328357 >> 172.21.15.137:0/1675328357 conn(0x7fef240fd770 msgr2=0x7fef240ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 -- 172.21.15.137:0/1675328357 shutdown_connections 2024-04-25T02:09:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.121+0000 7fef2a600700 1 -- 172.21.15.137:0/1675328357 wait complete. 2024-04-25T02:09:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.122+0000 7fef2a600700 1 Processor -- start 2024-04-25T02:09:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 -- start start 2024-04-25T02:09:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 0x7fef2419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef24103d50 0x7fef241a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fef2410df80 con 0x7fef241033b0 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fef2410de00 con 0x7fef241021b0 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef2a600700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fef2410e100 con 0x7fef24103d50 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef29200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef29200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:41648/0 (socket says 172.21.15.137:41648) 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef29200700 1 -- 172.21.15.137:0/848226288 learned_addr learned my addr 172.21.15.137:0/848226288 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.123+0000 7fef23e00700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 0x7fef2419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29c00700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef24103d50 0x7fef241a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 -- 172.21.15.137:0/848226288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef24103d50 msgr2=0x7fef241a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef24103d50 0x7fef241a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 -- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 msgr2=0x7fef2419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 0x7fef2419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 -- 172.21.15.137:0/848226288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef241a22c0 con 0x7fef241021b0 2024-04-25T02:09:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef29200700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef1800e950 tx=0x7fef1800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18004230 con 0x7fef241021b0 2024-04-25T02:09:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef180043d0 con 0x7fef241021b0 2024-04-25T02:09:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18010430 con 0x7fef241021b0 2024-04-25T02:09:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.124+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef241a25b0 con 0x7fef241021b0 2024-04-25T02:09:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.125+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef241a2aa0 con 0x7fef241021b0 2024-04-25T02:09:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.126+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef24068f20 con 0x7fef241021b0 2024-04-25T02:09:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.128+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fef1800c7e0 con 0x7fef241021b0 2024-04-25T02:09:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.129+0000 7fef21600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 0x7fef0c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.129+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fef180cf2a0 con 0x7fef241021b0 2024-04-25T02:09:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.129+0000 7fef23e00700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 0x7fef0c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.130+0000 7fef23e00700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 0x7fef0c0a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fef10009680 tx=0x7fef10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.133+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fef1809c1b0 con 0x7fef241021b0 2024-04-25T02:09:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.364+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fef24075b80 con 0x7fef0c0a2c20 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.375+0000 7fef21600700 1 -- 172.21.15.137:0/848226288 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fef24075b80 con 0x7fef0c0a2c20 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stdout:mds.all 12/12 51s ago 2m smithi137=a;smithi137=d;smithi137=g;smithi137=j;smithi163=b;smithi163=e;smithi163=h;smithi163=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stdout:mgr 3/3 51s ago 8m smithi137=x;smithi163=y;smithi174=z;count:3 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stdout:mon 3/3 51s ago 8m smithi137:172.21.15.137=a;smithi163:172.21.15.163=b;smithi174:172.21.15.174=c;count:3 2024-04-25T02:09:11.383 INFO:teuthology.orchestra.run.smithi137.stdout:osd 12 51s ago - 2024-04-25T02:09:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.378+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 msgr2=0x7fef0c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.378+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 0x7fef0c0a50e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fef10009680 tx=0x7fef10009260 comp rx=0 tx=0).stop 2024-04-25T02:09:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.378+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 msgr2=0x7fef2419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.378+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef1800e950 tx=0x7fef1800ec60 comp rx=0 tx=0).stop 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 shutdown_connections 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fef0c0a2c20 0x7fef0c0a50e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef241021b0 0x7fef2419a660 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef24103d50 0x7fef241a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 --2- 172.21.15.137:0/848226288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fef241033b0 0x7fef2419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 >> 172.21.15.137:0/848226288 conn(0x7fef240fd770 msgr2=0x7fef24074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 shutdown_connections 2024-04-25T02:09:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:11.379+0000 7fef2a600700 1 -- 172.21.15.137:0/848226288 wait complete. 2024-04-25T02:09:11.752 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:11 smithi137 ceph-mon[28303]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T02:09:11.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:11 smithi163 ceph-mon[32577]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T02:09:11.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:11 smithi174 ceph-mon[33171]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-25T02:09:12.233 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T02:09:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:12.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:12 smithi137 ceph-mon[28303]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:12.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:12 smithi163 ceph-mon[32577]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:12.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:12 smithi174 ceph-mon[33171]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:13.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:13 smithi137 ceph-mon[28303]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:13.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:13 smithi163 ceph-mon[32577]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:13.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:13 smithi174 ceph-mon[33171]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:14.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 -- 172.21.15.137:0/3366480079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080787f0 msgr2=0x7f3408079070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 --2- 172.21.15.137:0/3366480079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080787f0 0x7f3408079070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f340000b0a0 tx=0x7f340000b3b0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 -- 172.21.15.137:0/3366480079 shutdown_connections 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 --2- 172.21.15.137:0/3366480079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408076be0 0x7f3408077000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 --2- 172.21.15.137:0/3366480079 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34080787f0 0x7f3408079070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 --2- 172.21.15.137:0/3366480079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3408077e30 0x7f34080782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.676+0000 7f340e200700 1 -- 172.21.15.137:0/3366480079 >> 172.21.15.137:0/3366480079 conn(0x7f34080ffa80 msgr2=0x7f3408101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.677+0000 7f340e200700 1 -- 172.21.15.137:0/3366480079 shutdown_connections 2024-04-25T02:09:14.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.677+0000 7f340e200700 1 -- 172.21.15.137:0/3366480079 wait complete. 2024-04-25T02:09:14.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 Processor -- start 2024-04-25T02:09:14.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 -- start start 2024-04-25T02:09:14.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408077e30 0x7f340819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34080787f0 0x7f34081a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34081145e0 con 0x7f3408076be0 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3408114460 con 0x7f3408077e30 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f340e200700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3408114760 con 0x7f34080787f0 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.678+0000 7f3407400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34470/0 (socket says 172.21.15.137:34470) 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 -- 172.21.15.137:0/1575253617 learned_addr learned my addr 172.21.15.137:0/1575253617 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f33ffe00700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408077e30 0x7f340819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407e00700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34080787f0 0x7f34081a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 -- 172.21.15.137:0/1575253617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34080787f0 msgr2=0x7f34081a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34080787f0 0x7f34081a6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 -- 172.21.15.137:0/1575253617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408077e30 msgr2=0x7f340819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408077e30 0x7f340819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 -- 172.21.15.137:0/1575253617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081a6700 con 0x7f3408076be0 2024-04-25T02:09:14.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.679+0000 7f3407400700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33f800e9d0 tx=0x7f33f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.680+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f800cbd0 con 0x7f3408076be0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.680+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33f800ee70 con 0x7f3408076be0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.680+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081a69f0 con 0x7f3408076be0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.680+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8018710 con 0x7f3408076be0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.680+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081a6f80 con 0x7f3408076be0 2024-04-25T02:09:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.681+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408068f20 con 0x7f3408076be0 2024-04-25T02:09:14.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.683+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f33f80188b0 con 0x7f3408076be0 2024-04-25T02:09:14.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.684+0000 7f3404c00700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 0x7f33ec0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:14.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.684+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f33f80cf250 con 0x7f3408076be0 2024-04-25T02:09:14.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.684+0000 7f33ffe00700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 0x7f33ec0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:14.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.685+0000 7f33ffe00700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 0x7f33ec0a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009c60 tx=0x7f33f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:14.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.690+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f33f809c160 con 0x7f3408076be0 2024-04-25T02:09:14.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.918+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f3408062670 con 0x7f33ec0a2ca0 2024-04-25T02:09:14.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.921+0000 7f3404c00700 1 -- 172.21.15.137:0/1575253617 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f3408062670 con 0x7f33ec0a2ca0 2024-04-25T02:09:14.929 INFO:teuthology.orchestra.run.smithi137.stdout:HOST ADDR LABELS STATUS 2024-04-25T02:09:14.929 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137 172.21.15.137 2024-04-25T02:09:14.929 INFO:teuthology.orchestra.run.smithi137.stdout:smithi163 172.21.15.163 2024-04-25T02:09:14.929 INFO:teuthology.orchestra.run.smithi137.stdout:smithi174 172.21.15.174 2024-04-25T02:09:14.929 INFO:teuthology.orchestra.run.smithi137.stdout:3 hosts in cluster 2024-04-25T02:09:14.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.923+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 msgr2=0x7f33ec0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.923+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 0x7f33ec0a5160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009c60 tx=0x7f33f0009260 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.923+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 msgr2=0x7f340819eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.923+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f33f800e9d0 tx=0x7f33f800ece0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 shutdown_connections 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f33ec0a2ca0 0x7f33ec0a5160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34080787f0 0x7f34081a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3408076be0 0x7f340819eaf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 --2- 172.21.15.137:0/1575253617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3408077e30 0x7f340819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 >> 172.21.15.137:0/1575253617 conn(0x7f34080ffa80 msgr2=0x7f3408101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 shutdown_connections 2024-04-25T02:09:14.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:14.924+0000 7f340e200700 1 -- 172.21.15.137:0/1575253617 wait complete. 2024-04-25T02:09:15.657 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:15 smithi137 ceph-mon[28303]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:15.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T02:09:15.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:15 smithi163 ceph-mon[32577]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:15.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:15 smithi174 ceph-mon[33171]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:16.178 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:16.578 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:16 smithi137 ceph-mon[28303]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:16.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:16 smithi163 ceph-mon[32577]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:16.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:16 smithi174 ceph-mon[33171]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:17.607 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:17 smithi137 ceph-mon[28303]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:17.794 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:17 smithi163 ceph-mon[32577]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:17.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:17 smithi174 ceph-mon[33171]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 -- 172.21.15.137:0/1386501771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab441055d0 msgr2=0x7fab44105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 --2- 172.21.15.137:0/1386501771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab441055d0 0x7fab44105a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab30009990 tx=0x7fab30009ca0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 -- 172.21.15.137:0/1386501771 shutdown_connections 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 --2- 172.21.15.137:0/1386501771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab44105f70 0x7fab4410c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 --2- 172.21.15.137:0/1386501771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab441047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 --2- 172.21.15.137:0/1386501771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab441055d0 0x7fab44105a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 -- 172.21.15.137:0/1386501771 >> 172.21.15.137:0/1386501771 conn(0x7fab440ff970 msgr2=0x7fab44101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.055+0000 7fab49c00700 1 -- 172.21.15.137:0/1386501771 shutdown_connections 2024-04-25T02:09:18.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.056+0000 7fab49c00700 1 -- 172.21.15.137:0/1386501771 wait complete. 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 Processor -- start 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 -- start start 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 0x7fab4419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab44105f70 0x7fab441a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab44110160 con 0x7fab441043d0 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fab4410ffe0 con 0x7fab441055d0 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fab441102e0 con 0x7fab44105f70 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab43e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab43e00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34496/0 (socket says 172.21.15.137:34496) 2024-04-25T02:09:18.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab43e00700 1 -- 172.21.15.137:0/3484104470 learned_addr learned my addr 172.21.15.137:0/3484104470 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab43400700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 0x7fab4419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.057+0000 7fab49200700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab44105f70 0x7fab441a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 -- 172.21.15.137:0/3484104470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab44105f70 msgr2=0x7fab441a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab44105f70 0x7fab441a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 -- 172.21.15.137:0/3484104470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 msgr2=0x7fab4419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 0x7fab4419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 -- 172.21.15.137:0/3484104470 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab441a22f0 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43400700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 0x7fab4419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.058+0000 7fab43e00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9a0 tx=0x7fab3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.059+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34004220 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.059+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab441a25e0 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.059+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab340043c0 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.059+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34010430 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.059+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab441a2b20 con 0x7fab441043d0 2024-04-25T02:09:18.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.060+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab44068f20 con 0x7fab441043d0 2024-04-25T02:09:18.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.062+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fab3400c810 con 0x7fab441043d0 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.064+0000 7fab40c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 0x7fab280a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:18.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.064+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fab340cf3a0 con 0x7fab441043d0 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.064+0000 7fab43400700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 0x7fab280a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:18.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.065+0000 7fab43400700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 0x7fab280a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab3000b2e0 tx=0x7fab30005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:18.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.068+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fab3409c340 con 0x7fab441043d0 2024-04-25T02:09:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.301+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fab44062670 con 0x7fab280a2c20 2024-04-25T02:09:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.303+0000 7fab40c00700 1 -- 172.21.15.137:0/3484104470 <== mgr.14152 v2:172.21.15.137:6800/205966009 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fab44062670 con 0x7fab280a2c20 2024-04-25T02:09:18.310 INFO:teuthology.orchestra.run.smithi137.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T02:09:18.310 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233004A400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-25T02:09:18.310 INFO:teuthology.orchestra.run.smithi137.stdout:smithi163 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GU400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-25T02:09:18.310 INFO:teuthology.orchestra.run.smithi137.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-25T02:09:18.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.306+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 msgr2=0x7fab280a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.306+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 0x7fab280a50e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fab3000b2e0 tx=0x7fab30005fb0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.306+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 msgr2=0x7fab4419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.306+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab3400e9a0 tx=0x7fab3400ecb0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.306+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 shutdown_connections 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fab280a2c20 0x7fab280a50e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab44105f70 0x7fab441a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab441043d0 0x7fab4419a690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 --2- 172.21.15.137:0/3484104470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fab441055d0 0x7fab4419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 >> 172.21.15.137:0/3484104470 conn(0x7fab440ff970 msgr2=0x7fab44108870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 shutdown_connections 2024-04-25T02:09:18.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:18.307+0000 7fab49c00700 1 -- 172.21.15.137:0/3484104470 wait complete. 2024-04-25T02:09:19.043 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T02:09:19.052 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:19.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T02:09:19.500 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:19.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:19 smithi137 ceph-mon[28303]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:19.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:19 smithi137 ceph-mon[28303]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:19.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:19 smithi163 ceph-mon[32577]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:19.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:19 smithi163 ceph-mon[32577]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:19.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:19 smithi174 ceph-mon[33171]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:19.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:19 smithi174 ceph-mon[33171]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:21.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 -- 172.21.15.137:0/2957844152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241034a0 msgr2=0x7fa724103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 --2- 172.21.15.137:0/2957844152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241034a0 0x7fa724103900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0099c0 tx=0x7fa70c009cd0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 -- 172.21.15.137:0/2957844152 shutdown_connections 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 --2- 172.21.15.137:0/2957844152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7241022a0 0x7fa7241026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 --2- 172.21.15.137:0/2957844152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa724103e40 0x7fa72410a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 --2- 172.21.15.137:0/2957844152 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241034a0 0x7fa724103900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 -- 172.21.15.137:0/2957844152 >> 172.21.15.137:0/2957844152 conn(0x7fa7240fd800 msgr2=0x7fa7240ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 -- 172.21.15.137:0/2957844152 shutdown_connections 2024-04-25T02:09:21.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.397+0000 7fa729400700 1 -- 172.21.15.137:0/2957844152 wait complete. 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 Processor -- start 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 -- start start 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7241034a0 0x7fa724198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 0x7fa72419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa72410e020 con 0x7fa7241022a0 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa72410dea0 con 0x7fa724103e40 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.398+0000 7fa729400700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa72410e1a0 con 0x7fa7241034a0 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53774/0 (socket says 172.21.15.137:53774) 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 -- 172.21.15.137:0/3992199881 learned_addr learned my addr 172.21.15.137:0/3992199881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa719e00700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7241034a0 0x7fa724198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa723200700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 0x7fa72419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 -- 172.21.15.137:0/3992199881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7241034a0 msgr2=0x7fa724198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7241034a0 0x7fa724198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 -- 172.21.15.137:0/3992199881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 msgr2=0x7fa72419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 0x7fa72419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 -- 172.21.15.137:0/3992199881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7241a01f0 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa723200700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 0x7fa72419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.399+0000 7fa722800700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e9a0 tx=0x7fa71400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.400+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71400cbd0 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.400+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa714004520 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.400+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7241a04e0 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.400+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714010430 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.400+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7241a0a20 con 0x7fa7241022a0 2024-04-25T02:09:21.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.401+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa724068f20 con 0x7fa7241022a0 2024-04-25T02:09:21.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.403+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fa714003f00 con 0x7fa7241022a0 2024-04-25T02:09:21.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.404+0000 7fa71be00700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 0x7fa7080a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:21.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.404+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fa7140cf330 con 0x7fa7241022a0 2024-04-25T02:09:21.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.405+0000 7fa719e00700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 0x7fa7080a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:21.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.405+0000 7fa719e00700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 0x7fa7080a50e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:21.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.409+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa71409c240 con 0x7fa7241022a0 2024-04-25T02:09:21.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.680+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa724062e40 con 0x7fa7241022a0 2024-04-25T02:09:21.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.681+0000 7fa71be00700 1 -- 172.21.15.137:0/3992199881 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) ==== 76+0+3058 (secure 0 0 0) 0x7fa71409bb40 con 0x7fa7241022a0 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:e22 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:legacy client fscid: 1 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:Filesystem 'cephfs' (1) 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:fs_name cephfs 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 22 2024-04-25T02:09:21.689 INFO:teuthology.orchestra.run.smithi137.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-04-25T02:07:18.852775+0000 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:modified 2024-04-25T02:07:24.393065+0000 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:tableserver 0 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:root 0 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:session_timeout 300 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:session_autoclose 300 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:max_file_size 1099511627776 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:max_xattr_size 65536 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:required_client_features {} 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:last_failure 0 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:last_failure_osd_epoch 0 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:max_mds 3 2024-04-25T02:09:21.690 INFO:teuthology.orchestra.run.smithi137.stdout:in 0,1,2 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:up {0=24560,1=24559,2=24538} 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:failed 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:damaged 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:stopped 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:data_pools [3] 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:metadata_pool 2 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:inline_data disabled 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:balancer 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:bal_rank_mask -1 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:standby_count_wanted 0 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:qdb_cluster leader: 24560 members: 24560,24538,24559 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b{0:24560} state up:active seq 3 addr [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.f{0:24526} state up:standby-replay seq 1 addr [v2:172.21.15.174:6834/1300618267,v1:172.21.15.174:6835/1300618267] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.691 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.i{1:24559} state up:active seq 7 addr [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.h{1:24512} state up:standby-replay seq 1 addr [v2:172.21.15.163:6836/432820443,v1:172.21.15.163:6837/432820443] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c{2:24538} state up:active seq 8 addr [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.e{2:24488} state up:standby-replay seq 1 addr [v2:172.21.15.163:6834/2970303147,v1:172.21.15.163:6835/2970303147] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:Standby daemons: 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.j{-1:14388} state up:standby seq 1 addr [v2:172.21.15.137:6834/3709487068,v1:172.21.15.137:6835/3709487068] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d{-1:14400} state up:standby seq 1 addr [v2:172.21.15.137:6836/3865493572,v1:172.21.15.137:6837/3865493572] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.g{-1:14454} state up:standby seq 1 addr [v2:172.21.15.137:6838/4129277647,v1:172.21.15.137:6839/4129277647] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a{-1:14466} state up:standby seq 1 addr [v2:172.21.15.137:6840/3132066952,v1:172.21.15.137:6841/3132066952] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.k{-1:24440} state up:standby seq 1 addr [v2:172.21.15.163:6832/1032553485,v1:172.21.15.163:6833/1032553485] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.692 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.l{-1:24457} state up:standby seq 1 addr [v2:172.21.15.174:6832/82630736,v1:172.21.15.174:6833/82630736] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T02:09:21.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 msgr2=0x7fa7080a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 0x7fa7080a50e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c005fb0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 msgr2=0x7fa724198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e9a0 tx=0x7fa71400ecb0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 shutdown_connections 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fa7080a2c20 0x7fa7080a50e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa724103e40 0x7fa72419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa7241022a0 0x7fa724198590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 --2- 172.21.15.137:0/3992199881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7241034a0 0x7fa724198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 >> 172.21.15.137:0/3992199881 conn(0x7fa7240fd800 msgr2=0x7fa724106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.684+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 shutdown_connections 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:21.685+0000 7fa729400700 1 -- 172.21.15.137:0/3992199881 wait complete. 2024-04-25T02:09:21.694 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:09:21.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:21 smithi163 ceph-mon[32577]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:21.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:21 smithi174 ceph-mon[33171]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:22.005 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:21 smithi137 ceph-mon[28303]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:22.415 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-25T02:09:22.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:22 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3992199881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:09:22.860 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:22.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:22 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3992199881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:09:22.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:22 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3992199881' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T02:09:23.811 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:23 smithi137 ceph-mon[28303]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:23 smithi163 ceph-mon[32577]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:23.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:23 smithi174 ceph-mon[33171]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 -- 172.21.15.137:0/1605771807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234105650 msgr2=0x7f6234107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 --2- 172.21.15.137:0/1605771807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234105650 0x7f6234107a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6220009990 tx=0x7f6220009ca0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 -- 172.21.15.137:0/1605771807 shutdown_connections 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 --2- 172.21.15.137:0/1605771807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234102d20 0x7f6234105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 --2- 172.21.15.137:0/1605771807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234107f80 0x7f623410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 --2- 172.21.15.137:0/1605771807 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234105650 0x7f6234107a40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 -- 172.21.15.137:0/1605771807 >> 172.21.15.137:0/1605771807 conn(0x7f62340fc730 msgr2=0x7f62340feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:24.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 -- 172.21.15.137:0/1605771807 shutdown_connections 2024-04-25T02:09:24.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.898+0000 7f6239c00700 1 -- 172.21.15.137:0/1605771807 wait complete. 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.899+0000 7f6239c00700 1 Processor -- start 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.899+0000 7f6239c00700 1 -- start start 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234102d20 0x7f62341985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234107f80 0x7f623419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f623410dfa0 con 0x7f6234102d20 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f623410de20 con 0x7f6234107f80 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6239c00700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f623410e120 con 0x7f6234105650 2024-04-25T02:09:24.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6232a00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234102d20 0x7f62341985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6232000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6232000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:39474/0 (socket says 172.21.15.137:39474) 2024-04-25T02:09:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6232000700 1 -- 172.21.15.137:0/2766554158 learned_addr learned my addr 172.21.15.137:0/2766554158 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.900+0000 7f6233400700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234107f80 0x7f623419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 -- 172.21.15.137:0/2766554158 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234107f80 msgr2=0x7f623419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234107f80 0x7f623419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 -- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234102d20 msgr2=0x7f62341985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234102d20 0x7f62341985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 -- 172.21.15.137:0/2766554158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62341a0210 con 0x7f6234105650 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6232000700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62200098e0 tx=0x7f62200047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220027070 con 0x7f6234105650 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62341a04a0 con 0x7f6234105650 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.901+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341a0950 con 0x7f6234105650 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.902+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6220022470 con 0x7f6234105650 2024-04-25T02:09:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.902+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220017630 con 0x7f6234105650 2024-04-25T02:09:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.903+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6234068f20 con 0x7f6234105650 2024-04-25T02:09:24.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.904+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f622002a070 con 0x7f6234105650 2024-04-25T02:09:24.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.906+0000 7f622b400700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 0x7f62180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:24.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.906+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f62200cfd30 con 0x7f6234105650 2024-04-25T02:09:24.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.906+0000 7f6232a00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 0x7f62180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:24.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.907+0000 7f6232a00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 0x7f62180a5160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6224009680 tx=0x7f6224009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:24.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:24.910+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6220013070 con 0x7f6234105650 2024-04-25T02:09:25.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.135+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f6234062e40 con 0x7f6234105650 2024-04-25T02:09:25.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.137+0000 7f622b400700 1 -- 172.21.15.137:0/2766554158 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+5319 (secure 0 0 0) 0x7f622009cdf0 con 0x7f6234105650 2024-04-25T02:09:25.144 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 87 2024-04-25T02:09:25.144 INFO:teuthology.orchestra.run.smithi137.stdout:fsid 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-04-25T01:58:20.233191+0000 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:modified 2024-04-25T02:07:27.432292+0000 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:crush_version 26 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:full_ratio 0.95 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:backfillfull_ratio 0.9 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:nearfull_ratio 0.85 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:require_min_compat_client luminous 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:min_compat_client luminous 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:require_osd_release squid 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:stretch_mode_enabled false 2024-04-25T02:09:25.145 INFO:teuthology.orchestra.run.smithi137.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:max_osd 12 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6802/3540238189,v1:172.21.15.137:6803/3540238189] [v2:172.21.15.137:6804/3540238189,v1:172.21.15.137:6805/3540238189] exists,up 9e559d91-361d-49dd-8183-384013ae9660 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/1976154605,v1:172.21.15.163:6801/1976154605] [v2:172.21.15.163:6802/1976154605,v1:172.21.15.163:6803/1976154605] exists,up 30f001bf-a25c-4c29-be9a-d5b9c20ff743 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/2383666582,v1:172.21.15.174:6801/2383666582] [v2:172.21.15.174:6802/2383666582,v1:172.21.15.174:6803/2383666582] exists,up d1acbadd-93be-4154-b3c1-1fb8b007154b 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6810/2967583331,v1:172.21.15.137:6811/2967583331] [v2:172.21.15.137:6812/2967583331,v1:172.21.15.137:6813/2967583331] exists,up e53d03ce-79d0-490e-b2d7-6767e008fa8a 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6808/2824580331,v1:172.21.15.163:6809/2824580331] [v2:172.21.15.163:6810/2824580331,v1:172.21.15.163:6811/2824580331] exists,up 3d77d217-ffdb-41c9-aeb0-ee27621608dc 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6808/586542310,v1:172.21.15.174:6809/586542310] [v2:172.21.15.174:6810/586542310,v1:172.21.15.174:6811/586542310] exists,up e4948650-970a-4d7d-ad93-1735d9fffdfe 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.6 up in weight 1 up_from 46 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6818/2828658472,v1:172.21.15.137:6819/2828658472] [v2:172.21.15.137:6820/2828658472,v1:172.21.15.137:6821/2828658472] exists,up e22c068f-0298-47f3-a90b-8735effc8206 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.7 up in weight 1 up_from 51 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6816/1494568625,v1:172.21.15.163:6817/1494568625] [v2:172.21.15.163:6818/1494568625,v1:172.21.15.163:6819/1494568625] exists,up 967eb934-6a0b-4f22-8bc7-5c0da457ffd3 2024-04-25T02:09:25.146 INFO:teuthology.orchestra.run.smithi137.stdout:osd.8 up in weight 1 up_from 59 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6816/2804246192,v1:172.21.15.174:6817/2804246192] [v2:172.21.15.174:6818/2804246192,v1:172.21.15.174:6819/2804246192] exists,up 574d3bea-4097-4bf7-ac49-a60fbe0b1f7f 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.137:6826/2280455179,v1:172.21.15.137:6827/2280455179] [v2:172.21.15.137:6828/2280455179,v1:172.21.15.137:6829/2280455179] exists,up 53182274-54d4-4bf5-a2da-0edf8abc688f 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6824/2960962752,v1:172.21.15.163:6825/2960962752] [v2:172.21.15.163:6826/2960962752,v1:172.21.15.163:6827/2960962752] exists,up e169cc70-dd4a-44da-966d-8cf065db66d7 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6824/2420568301,v1:172.21.15.174:6825/2420568301] [v2:172.21.15.174:6826/2420568301,v1:172.21.15.174:6827/2420568301] exists,up 64dcd982-78ef-4b76-9014-0a2b668457fb 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 2.4 [2,11] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 2.13 [2,11] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 2.1f [8,4] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 3.3 [4,9] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 3.18 [3,9] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 3.2c [4,9] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 3.31 [4,8] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:pg_upmap_items 3.37 [5,6] 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/2811873727 expires 2024-04-26T01:59:26.231648+0000 2024-04-25T02:09:25.147 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:6801/1454150812 expires 2024-04-26T01:59:26.231648+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:6800/1454150812 expires 2024-04-26T01:59:26.231648+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/3398591634 expires 2024-04-26T01:59:26.231648+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/1248132211 expires 2024-04-26T01:58:53.335832+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:6801/3009931509 expires 2024-04-26T01:58:53.335832+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/4170175592 expires 2024-04-26T01:58:53.335832+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:6800/3009931509 expires 2024-04-26T01:58:53.335832+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/797325498 expires 2024-04-26T01:58:53.335832+0000 2024-04-25T02:09:25.148 INFO:teuthology.orchestra.run.smithi137.stdout:blocklist 172.21.15.137:0/1909466669 expires 2024-04-26T01:59:26.231648+0000 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 msgr2=0x7f62180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 0x7f62180a5160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6224009680 tx=0x7f6224009260 comp rx=0 tx=0).stop 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 msgr2=0x7f6234198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62200098e0 tx=0x7f62200047b0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 shutdown_connections 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f62180a2ca0 0x7f62180a5160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6234107f80 0x7f623419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6234102d20 0x7f62341985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 --2- 172.21.15.137:0/2766554158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6234105650 0x7f6234198af0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:25.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 >> 172.21.15.137:0/2766554158 conn(0x7f62340fc730 msgr2=0x7f6234103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:25.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.140+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 shutdown_connections 2024-04-25T02:09:25.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:25.141+0000 7f6239c00700 1 -- 172.21.15.137:0/2766554158 wait complete. 2024-04-25T02:09:25.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:25 smithi137 ceph-mon[28303]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:25.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:25 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2766554158' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T02:09:25.847 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-25T02:09:25.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:25.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:25 smithi163 ceph-mon[32577]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:25.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:25 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2766554158' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T02:09:25.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:25 smithi174 ceph-mon[33171]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:09:25.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:25 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2766554158' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-25T02:09:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 -- 172.21.15.137:0/2570359889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 msgr2=0x7fb3a8100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 --2- 172.21.15.137:0/2570359889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a8100bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb390009900 tx=0x7fb39002a410 comp rx=0 tx=0).stop 2024-04-25T02:09:26.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 -- 172.21.15.137:0/2570359889 shutdown_connections 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 --2- 172.21.15.137:0/2570359889 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a8101130 0x7fb3a81015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 --2- 172.21.15.137:0/2570359889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a8100bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 --2- 172.21.15.137:0/2570359889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a80ffe30 0x7fb3a8100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 -- 172.21.15.137:0/2570359889 >> 172.21.15.137:0/2570359889 conn(0x7fb3a80fba10 msgr2=0x7fb3a80fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 -- 172.21.15.137:0/2570359889 shutdown_connections 2024-04-25T02:09:26.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.070+0000 7fb3ae000640 1 -- 172.21.15.137:0/2570359889 wait complete. 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.071+0000 7fb3ae000640 1 Processor -- start 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.071+0000 7fb3ae000640 1 -- start start 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a80ffe30 0x7fb3a8199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a8101130 0x7fb3a81a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810f540 con 0x7fb3a8100790 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810f3c0 con 0x7fb3a80ffe30 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ae000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810f6c0 con 0x7fb3a8101130 2024-04-25T02:09:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53826/0 (socket says 172.21.15.137:53826) 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3a7e00640 1 -- 172.21.15.137:0/1770327711 learned_addr learned my addr 172.21.15.137:0/1770327711 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3acc00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a80ffe30 0x7fb3a8199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3ad600640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a8101130 0x7fb3a81a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3a7e00640 1 -- 172.21.15.137:0/1770327711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a8101130 msgr2=0x7fb3a81a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.072+0000 7fb3a7e00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a8101130 0x7fb3a81a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a7e00640 1 -- 172.21.15.137:0/1770327711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a80ffe30 msgr2=0x7fb3a8199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a7e00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a80ffe30 0x7fb3a8199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a7e00640 1 -- 172.21.15.137:0/1770327711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a81a17a0 con 0x7fb3a8100790 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a7e00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb390009a20 tx=0x7fb3900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39003f030 con 0x7fb3a8100790 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb390003d00 con 0x7fb3a8100790 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a81a1a30 con 0x7fb3a8100790 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390035070 con 0x7fb3a8100790 2024-04-25T02:09:26.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.073+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a81a1f20 con 0x7fb3a8100790 2024-04-25T02:09:26.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.074+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a810ab80 con 0x7fb3a8100790 2024-04-25T02:09:26.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.076+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fb390042030 con 0x7fb3a8100790 2024-04-25T02:09:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.078+0000 7fb3a5600640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 0x7fb38c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.078+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fb3900ef590 con 0x7fb3a8100790 2024-04-25T02:09:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.078+0000 7fb3acc00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 0x7fb38c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.079+0000 7fb3acc00640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 0x7fb38c0a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb398005fd0 tx=0x7fb398009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.082+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fb3900bbe50 con 0x7fb3a8100790 2024-04-25T02:09:26.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.284+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3a8062340 con 0x7fb3a8100790 2024-04-25T02:09:26.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.286+0000 7fb3a5600640 1 -- 172.21.15.137:0/1770327711 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7fb3900c0150 con 0x7fb3a8100790 2024-04-25T02:09:26.293 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:26.293 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 msgr2=0x7fb38c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 0x7fb38c0a5050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb398005fd0 tx=0x7fb398009500 comp rx=0 tx=0).stop 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 msgr2=0x7fb3a819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb390009a20 tx=0x7fb3900042f0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 shutdown_connections 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fb38c0a2b90 0x7fb38c0a5050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb3a8101130 0x7fb3a81a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3a8100790 0x7fb3a819a0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 --2- 172.21.15.137:0/1770327711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3a80ffe30 0x7fb3a8199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 >> 172.21.15.137:0/1770327711 conn(0x7fb3a80fba10 msgr2=0x7fb3a80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 shutdown_connections 2024-04-25T02:09:26.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.289+0000 7fb3ae000640 1 -- 172.21.15.137:0/1770327711 wait complete. 2024-04-25T02:09:26.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:26.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.526+0000 7f1fc1800640 1 -- 172.21.15.137:0/122133370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc077340 msgr2=0x7f1fbc0777a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 --2- 172.21.15.137:0/122133370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc077340 0x7f1fbc0777a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009900 tx=0x7f1fa402a410 comp rx=0 tx=0).stop 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 -- 172.21.15.137:0/122133370 shutdown_connections 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 --2- 172.21.15.137:0/122133370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 --2- 172.21.15.137:0/122133370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc077340 0x7f1fbc0777a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 --2- 172.21.15.137:0/122133370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc076100 0x7f1fbc076520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 -- 172.21.15.137:0/122133370 >> 172.21.15.137:0/122133370 conn(0x7f1fbc0fedf0 msgr2=0x7f1fbc101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 -- 172.21.15.137:0/122133370 shutdown_connections 2024-04-25T02:09:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.527+0000 7f1fc1800640 1 -- 172.21.15.137:0/122133370 wait complete. 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 Processor -- start 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 -- start start 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc076100 0x7f1fbc19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 0x7f1fbc19e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc113a30 con 0x7f1fbc077340 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1138b0 con 0x7f1fbc076100 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.528+0000 7f1fc1800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc113bb0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fb3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 0x7f1fbc19e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:39502/0 (socket says 172.21.15.137:39502) 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 -- 172.21.15.137:0/1361525862 learned_addr learned my addr 172.21.15.137:0/1361525862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fbbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc076100 0x7f1fbc19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 -- 172.21.15.137:0/1361525862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc076100 msgr2=0x7f1fbc19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc076100 0x7f1fbc19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 -- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 msgr2=0x7f1fbc19e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 0x7f1fbc19e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 -- 172.21.15.137:0/1361525862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1a5c30 con 0x7f1fbc077ce0 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fb3e00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 0x7f1fbc19e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.529+0000 7f1fc0e00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400eb10 tx=0x7f1fb400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.530+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4004b20 con 0x7f1fbc077ce0 2024-04-25T02:09:26.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.530+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1fb4004cc0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.530+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1a5f20 con 0x7f1fbc077ce0 2024-04-25T02:09:26.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.530+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40107f0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.530+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc1a6390 con 0x7f1fbc077ce0 2024-04-25T02:09:26.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.531+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc1101f0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.533+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1fb4010990 con 0x7f1fbc077ce0 2024-04-25T02:09:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.534+0000 7f1fb9600640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 0x7f1fa00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.534+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f1fb40cf7e0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.535+0000 7f1fbbe00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 0x7f1fa00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.535+0000 7f1fbbe00640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 0x7f1fa00a5050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009bd0 tx=0x7f1fac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.536+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f1fb4053740 con 0x7f1fbc077ce0 2024-04-25T02:09:26.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.741+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1fbc02d170 con 0x7f1fbc077ce0 2024-04-25T02:09:26.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.741+0000 7f1fb9600640 1 -- 172.21.15.137:0/1361525862 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f1fb409c6f0 con 0x7f1fbc077ce0 2024-04-25T02:09:26.748 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:09:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 msgr2=0x7f1fa00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 0x7f1fa00a5050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009bd0 tx=0x7f1fac005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:26.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 msgr2=0x7f1fbc1a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400eb10 tx=0x7f1fb400c2d0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 shutdown_connections 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f1fa00a2b90 0x7f1fa00a5050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1fbc077ce0 0x7f1fbc1a55c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1fbc077340 0x7f1fbc19e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 --2- 172.21.15.137:0/1361525862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1fbc076100 0x7f1fbc19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.744+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 >> 172.21.15.137:0/1361525862 conn(0x7f1fbc0fedf0 msgr2=0x7f1fbc1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.745+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 shutdown_connections 2024-04-25T02:09:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.745+0000 7f1fc1800640 1 -- 172.21.15.137:0/1361525862 wait complete. 2024-04-25T02:09:26.767 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:26 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1770327711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:26.767 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:26 smithi137 ceph-mon[28303]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:26.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:26 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1770327711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:26.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:26 smithi163 ceph-mon[32577]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:26 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1770327711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:26.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:26 smithi174 ceph-mon[33171]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:09:26.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.968+0000 7f0274a00640 1 -- 172.21.15.137:0/301852936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0270075780 msgr2=0x7f0270073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.968+0000 7f0274a00640 1 --2- 172.21.15.137:0/301852936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0270075780 0x7f0270073bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0260009930 tx=0x7f026002a420 comp rx=0 tx=0).stop 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 -- 172.21.15.137:0/301852936 shutdown_connections 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 --2- 172.21.15.137:0/301852936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f027010dc40 0x7f0270110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 --2- 172.21.15.137:0/301852936 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f02700741a0 0x7f0270074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 --2- 172.21.15.137:0/301852936 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0270075780 0x7f0270073bd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 -- 172.21.15.137:0/301852936 >> 172.21.15.137:0/301852936 conn(0x7f02700fcbe0 msgr2=0x7f02700ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 -- 172.21.15.137:0/301852936 shutdown_connections 2024-04-25T02:09:26.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.969+0000 7f0274a00640 1 -- 172.21.15.137:0/301852936 wait complete. 2024-04-25T02:09:26.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 Processor -- start 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 -- start start 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0270075780 0x7f027019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f027010dc40 0x7f02701a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0270113a70 con 0x7f02700741a0 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f02701138f0 con 0x7f027010dc40 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f0274a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0270113bf0 con 0x7f0270075780 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f026e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f026e800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53864/0 (socket says 172.21.15.137:53864) 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f026e800640 1 -- 172.21.15.137:0/394643365 learned_addr learned my addr 172.21.15.137:0/394643365 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f026f200640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f027010dc40 0x7f02701a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.970+0000 7f026de00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0270075780 0x7f027019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 -- 172.21.15.137:0/394643365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0270075780 msgr2=0x7f027019e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0270075780 0x7f027019e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 -- 172.21.15.137:0/394643365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f027010dc40 msgr2=0x7f02701a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f027010dc40 0x7f02701a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 -- 172.21.15.137:0/394643365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02701a5cc0 con 0x7f02700741a0 2024-04-25T02:09:26.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f026e800640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f02600316a0 tx=0x7f0260032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026003f030 con 0x7f02700741a0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0260003d00 con 0x7f02700741a0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02701a5f50 con 0x7f02700741a0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.971+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260035070 con 0x7f02700741a0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.972+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02701a63b0 con 0x7f02700741a0 2024-04-25T02:09:26.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.973+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270103e10 con 0x7f02700741a0 2024-04-25T02:09:26.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.975+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f0260042030 con 0x7f02700741a0 2024-04-25T02:09:26.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.976+0000 7f0267400640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 0x7f02540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:26.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.976+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f02600ef3b0 con 0x7f02700741a0 2024-04-25T02:09:26.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.977+0000 7f026de00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 0x7f02540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:26.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.977+0000 7f026de00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 0x7f02540a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f025c0095f0 tx=0x7f025c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:26.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:26.980+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f02600bbc70 con 0x7f02700741a0 2024-04-25T02:09:27.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.181+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02700623e0 con 0x7f02700741a0 2024-04-25T02:09:27.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.182+0000 7f0267400640 1 -- 172.21.15.137:0/394643365 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f02600bff70 con 0x7f02700741a0 2024-04-25T02:09:27.189 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 msgr2=0x7f02540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 0x7f02540a50d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f025c0095f0 tx=0x7f025c005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 msgr2=0x7f027019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f02600316a0 tx=0x7f0260032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 shutdown_connections 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f02540a2c10 0x7f02540a50d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f027010dc40 0x7f02701a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0270075780 0x7f027019e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 --2- 172.21.15.137:0/394643365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f02700741a0 0x7f027019e0a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 >> 172.21.15.137:0/394643365 conn(0x7f02700fcbe0 msgr2=0x7f0270100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 shutdown_connections 2024-04-25T02:09:27.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.185+0000 7f0274a00640 1 -- 172.21.15.137:0/394643365 wait complete. 2024-04-25T02:09:27.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 -- 172.21.15.137:0/3385460157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078105430 msgr2=0x7f207810bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 --2- 172.21.15.137:0/3385460157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078105430 0x7f207810bcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2070009860 tx=0x7f207002a340 comp rx=0 tx=0).stop 2024-04-25T02:09:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 -- 172.21.15.137:0/3385460157 shutdown_connections 2024-04-25T02:09:27.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 --2- 172.21.15.137:0/3385460157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078105430 0x7f207810bcc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 --2- 172.21.15.137:0/3385460157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 0x7f2078104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 --2- 172.21.15.137:0/3385460157 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078103880 0x7f2078103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.410+0000 7f207dc00640 1 -- 172.21.15.137:0/3385460157 >> 172.21.15.137:0/3385460157 conn(0x7f20780fedf0 msgr2=0x7f2078101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.411+0000 7f207dc00640 1 -- 172.21.15.137:0/3385460157 shutdown_connections 2024-04-25T02:09:27.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.411+0000 7f207dc00640 1 -- 172.21.15.137:0/3385460157 wait complete. 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.411+0000 7f207dc00640 1 Processor -- start 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 -- start start 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 0x7f207819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078105430 0x7f20781a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f207810f630 con 0x7f2078105430 2024-04-25T02:09:27.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f207810f4b0 con 0x7f2078104a70 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207dc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f207810f7b0 con 0x7f2078103880 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f207d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078105430 0x7f20781a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:39522/0 (socket says 172.21.15.137:39522) 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 -- 172.21.15.137:0/2522865604 learned_addr learned my addr 172.21.15.137:0/2522865604 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077400640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 0x7f207819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 -- 172.21.15.137:0/2522865604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 msgr2=0x7f207819a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 0x7f207819a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 -- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078105430 msgr2=0x7f20781a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.412+0000 7f2077e00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078105430 0x7f20781a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f2077e00640 1 -- 172.21.15.137:0/2522865604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20781a1890 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f2077e00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f206000e9f0 tx=0x7f206000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206000ccc0 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20600035f0 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20781a1b80 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206000ce60 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.413+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781a2120 con 0x7f2078103880 2024-04-25T02:09:27.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.414+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207810aad0 con 0x7f2078103880 2024-04-25T02:09:27.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.416+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f20600037a0 con 0x7f2078103880 2024-04-25T02:09:27.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.418+0000 7f2074c00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 0x7f205c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.418+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f20600cf320 con 0x7f2078103880 2024-04-25T02:09:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.418+0000 7f2077400640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 0x7f205c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.419+0000 7f2077400640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 0x7f205c0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.422+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f206009c230 con 0x7f2078103880 2024-04-25T02:09:27.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.624+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2078062340 con 0x7f2078103880 2024-04-25T02:09:27.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.625+0000 7f2074c00640 1 -- 172.21.15.137:0/2522865604 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f206009bb30 con 0x7f2078103880 2024-04-25T02:09:27.632 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.627+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 msgr2=0x7f205c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 0x7f205c0a50d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068009500 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 msgr2=0x7f2078199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f206000e9f0 tx=0x7f206000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 shutdown_connections 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f205c0a2c10 0x7f205c0a50d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2078105430 0x7f20781a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2078104a70 0x7f207819a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 --2- 172.21.15.137:0/2522865604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2078103880 0x7f2078199c80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 >> 172.21.15.137:0/2522865604 conn(0x7f20780fedf0 msgr2=0x7f2078107ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 shutdown_connections 2024-04-25T02:09:27.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.628+0000 7f207dc00640 1 -- 172.21.15.137:0/2522865604 wait complete. 2024-04-25T02:09:27.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:27.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 -- 172.21.15.137:0/2927621579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc1039c0 msgr2=0x7fcdcc103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 --2- 172.21.15.137:0/2927621579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc103de0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009900 tx=0x7fcdb802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 -- 172.21.15.137:0/2927621579 shutdown_connections 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 --2- 172.21.15.137:0/2927621579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc105570 0x7fcdcc10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 --2- 172.21.15.137:0/2927621579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 --2- 172.21.15.137:0/2927621579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc103de0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 -- 172.21.15.137:0/2927621579 >> 172.21.15.137:0/2927621579 conn(0x7fcdcc0fef30 msgr2=0x7fcdcc101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 -- 172.21.15.137:0/2927621579 shutdown_connections 2024-04-25T02:09:27.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.841+0000 7fcdd1200640 1 -- 172.21.15.137:0/2927621579 wait complete. 2024-04-25T02:09:27.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.842+0000 7fcdd1200640 1 Processor -- start 2024-04-25T02:09:27.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.842+0000 7fcdd1200640 1 -- start start 2024-04-25T02:09:27.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc10f7b0 con 0x7fcdcc105570 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc10f630 con 0x7fcdcc104bb0 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdd1200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc10f930 con 0x7fcdcc1039c0 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdca800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdc9400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdc9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdca800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53908/0 (socket says 172.21.15.137:53908) 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.843+0000 7fcdca800640 1 -- 172.21.15.137:0/806899307 learned_addr learned my addr 172.21.15.137:0/806899307 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 -- 172.21.15.137:0/806899307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 msgr2=0x7fcdcc199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 -- 172.21.15.137:0/806899307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 msgr2=0x7fcdcc19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 -- 172.21.15.137:0/806899307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc1a1a20 con 0x7fcdcc105570 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdc9e00640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdc9400640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdca800640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e9b0 tx=0x7fcdc400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400cd80 con 0x7fcdcc105570 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc1a1d10 con 0x7fcdcc105570 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcdc40035f0 con 0x7fcdcc105570 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4010690 con 0x7fcdcc105570 2024-04-25T02:09:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.844+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1a21b0 con 0x7fcdcc105570 2024-04-25T02:09:27.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.845+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc10ace0 con 0x7fcdcc105570 2024-04-25T02:09:27.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.847+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fcdc40037a0 con 0x7fcdcc105570 2024-04-25T02:09:27.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.850+0000 7fcdc2a00640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 0x7fcdb00a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:27.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.850+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fcdc40cf310 con 0x7fcdcc105570 2024-04-25T02:09:27.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.850+0000 7fcdc9e00640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 0x7fcdb00a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:27.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.851+0000 7fcdc9e00640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 0x7fcdb00a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802a9e0 tx=0x7fcdb8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:27.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:27.854+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fcdc409c280 con 0x7fcdcc105570 2024-04-25T02:09:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1361525862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:27.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:27 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/394643365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:27 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1361525862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:27.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:27 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/394643365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:27 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1361525862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:27 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/394643365' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.090+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdcc0623e0 con 0x7fcdcc105570 2024-04-25T02:09:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.091+0000 7fcdc2a00640 1 -- 172.21.15.137:0/806899307 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7fcdc409bb80 con 0x7fcdcc105570 2024-04-25T02:09:28.098 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:28.099 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:09:28.099 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:09:28.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 msgr2=0x7fcdb00a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 0x7fcdb00a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802a9e0 tx=0x7fcdb8005a20 comp rx=0 tx=0).stop 2024-04-25T02:09:28.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 msgr2=0x7fcdcc1a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e9b0 tx=0x7fcdc400ee70 comp rx=0 tx=0).stop 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 shutdown_connections 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fcdb00a2b90 0x7fcdb00a5050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcdcc105570 0x7fcdcc1a13b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcdcc104bb0 0x7fcdcc19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 --2- 172.21.15.137:0/806899307 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdcc1039c0 0x7fcdcc199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 >> 172.21.15.137:0/806899307 conn(0x7fcdcc0fef30 msgr2=0x7fcdcc107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 shutdown_connections 2024-04-25T02:09:28.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.094+0000 7fcdd1200640 1 -- 172.21.15.137:0/806899307 wait complete. 2024-04-25T02:09:28.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 -- 172.21.15.137:0/759610658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 msgr2=0x7fc838104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 --2- 172.21.15.137:0/759610658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc838104e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc820009900 tx=0x7fc82002a410 comp rx=0 tx=0).stop 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 -- 172.21.15.137:0/759610658 shutdown_connections 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 --2- 172.21.15.137:0/759610658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc83810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 --2- 172.21.15.137:0/759610658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc838104e30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 --2- 172.21.15.137:0/759610658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 -- 172.21.15.137:0/759610658 >> 172.21.15.137:0/759610658 conn(0x7fc8380fed50 msgr2=0x7fc838101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 -- 172.21.15.137:0/759610658 shutdown_connections 2024-04-25T02:09:28.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.314+0000 7fc83ca00640 1 -- 172.21.15.137:0/759610658 wait complete. 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.315+0000 7fc83ca00640 1 Processor -- start 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.315+0000 7fc83ca00640 1 -- start start 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.315+0000 7fc83ca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.315+0000 7fc83ca00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.315+0000 7fc83ca00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc8381a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc83ca00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc83810f5c0 con 0x7fc8381049b0 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc83ca00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc83810f440 con 0x7fc838105370 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc83ca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc83810f740 con 0x7fc8381037c0 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53926/0 (socket says 172.21.15.137:53926) 2024-04-25T02:09:28.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc837400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 -- 172.21.15.137:0/864140303 learned_addr learned my addr 172.21.15.137:0/864140303 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc837e00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc8381a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 -- 172.21.15.137:0/864140303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 msgr2=0x7fc838199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 -- 172.21.15.137:0/864140303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 msgr2=0x7fc8381a1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc8381a1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 -- 172.21.15.137:0/864140303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381a1780 con 0x7fc8381049b0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc837e00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc8381a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc837400640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.316+0000 7fc82ea00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8200316a0 tx=0x7fc820032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.317+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82003f030 con 0x7fc8381049b0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.317+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc820003d00 con 0x7fc8381049b0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.317+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381a1a10 con 0x7fc8381049b0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.317+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820035070 con 0x7fc8381049b0 2024-04-25T02:09:28.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.317+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381a1f50 con 0x7fc8381049b0 2024-04-25T02:09:28.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.318+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83810aa80 con 0x7fc8381049b0 2024-04-25T02:09:28.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.320+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc820042030 con 0x7fc8381049b0 2024-04-25T02:09:28.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.321+0000 7fc834c00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 0x7fc81c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.321+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc8200ef720 con 0x7fc8381049b0 2024-04-25T02:09:28.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.321+0000 7fc837400640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 0x7fc81c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.322+0000 7fc837400640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 0x7fc81c0a50d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc838104810 tx=0x7fc828005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.325+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc8200bc630 con 0x7fc8381049b0 2024-04-25T02:09:28.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.527+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc838062340 con 0x7fc8381049b0 2024-04-25T02:09:28.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.531+0000 7fc834c00640 1 -- 172.21.15.137:0/864140303 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7fc8200bbf30 con 0x7fc8381049b0 2024-04-25T02:09:28.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:28.538 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 msgr2=0x7fc81c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 0x7fc81c0a50d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc838104810 tx=0x7fc828005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 msgr2=0x7fc83819a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8200316a0 tx=0x7fc820032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 shutdown_connections 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc81c0a2c10 0x7fc81c0a50d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc838105370 0x7fc8381a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8381049b0 0x7fc83819a0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 --2- 172.21.15.137:0/864140303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8381037c0 0x7fc838199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 >> 172.21.15.137:0/864140303 conn(0x7fc8380fed50 msgr2=0x7fc838107c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 shutdown_connections 2024-04-25T02:09:28.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.534+0000 7fc83ca00640 1 -- 172.21.15.137:0/864140303 wait complete. 2024-04-25T02:09:28.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:28.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 -- 172.21.15.137:0/1360643959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224103880 msgr2=0x7f9224103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 --2- 172.21.15.137:0/1360643959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224103880 0x7f9224103ca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9214009900 tx=0x7f921402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 -- 172.21.15.137:0/1360643959 shutdown_connections 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 --2- 172.21.15.137:0/1360643959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224105430 0x7f922410bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 --2- 172.21.15.137:0/1360643959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224104a70 0x7f9224104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 --2- 172.21.15.137:0/1360643959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224103880 0x7f9224103ca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 -- 172.21.15.137:0/1360643959 >> 172.21.15.137:0/1360643959 conn(0x7f92240fedf0 msgr2=0x7f9224101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 -- 172.21.15.137:0/1360643959 shutdown_connections 2024-04-25T02:09:28.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.754+0000 7f9223e00640 1 -- 172.21.15.137:0/1360643959 wait complete. 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.755+0000 7f9223e00640 1 Processor -- start 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.755+0000 7f9223e00640 1 -- start start 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.755+0000 7f9223e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224103880 0x7f9224199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224105430 0x7f92241a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f922410f680 con 0x7f9224104a70 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f922410f500 con 0x7f9224103880 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f922410f800 con 0x7f9224105430 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53950/0 (socket says 172.21.15.137:53950) 2024-04-25T02:09:28.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 -- 172.21.15.137:0/975915512 learned_addr learned my addr 172.21.15.137:0/975915512 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222a00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224103880 0x7f9224199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9223400640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224105430 0x7f92241a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 -- 172.21.15.137:0/975915512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224105430 msgr2=0x7f92241a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224105430 0x7f92241a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 -- 172.21.15.137:0/975915512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224103880 msgr2=0x7f9224199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224103880 0x7f9224199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 -- 172.21.15.137:0/975915512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241a18d0 con 0x7f9224104a70 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.756+0000 7f9222000640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e9f0 tx=0x7f920c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.757+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c00cd80 con 0x7f9224104a70 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.757+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92241a1bc0 con 0x7f9224104a70 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.757+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f920c005520 con 0x7f9224104a70 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.757+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c018650 con 0x7f9224104a70 2024-04-25T02:09:28.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.757+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a2090 con 0x7f9224104a70 2024-04-25T02:09:28.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.758+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922410aba0 con 0x7f9224104a70 2024-04-25T02:09:28.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.760+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f920c0046c0 con 0x7f9224104a70 2024-04-25T02:09:28.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.761+0000 7f921b400640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 0x7f92080a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:28.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.762+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f920c0cf6c0 con 0x7f9224104a70 2024-04-25T02:09:28.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.762+0000 7f9222a00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 0x7f92080a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:28.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.762+0000 7f9222a00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 0x7f92080a5050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f921402a9e0 tx=0x7f9214005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:28.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.765+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f920c09c5d0 con 0x7f9224104a70 2024-04-25T02:09:28.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:28 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2522865604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:28 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/806899307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:28 smithi163 ceph-mon[32577]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:28.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:28 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/864140303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:28 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2522865604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:28 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/806899307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:28 smithi174 ceph-mon[33171]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:28.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:28 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/864140303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.965+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9224062340 con 0x7f9224104a70 2024-04-25T02:09:28.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.966+0000 7f921b400640 1 -- 172.21.15.137:0/975915512 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f920c09bed0 con 0x7f9224104a70 2024-04-25T02:09:28.973 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 msgr2=0x7f92080a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 0x7f92080a5050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f921402a9e0 tx=0x7f9214005a20 comp rx=0 tx=0).stop 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 msgr2=0x7f922419a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f920c00e9f0 tx=0x7f920c00edf0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 shutdown_connections 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f92080a2b90 0x7f92080a5050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9224105430 0x7f92241a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9224104a70 0x7f922419a1d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 --2- 172.21.15.137:0/975915512 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9224103880 0x7f9224199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:28.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 >> 172.21.15.137:0/975915512 conn(0x7f92240fedf0 msgr2=0x7f9224107d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:28.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 shutdown_connections 2024-04-25T02:09:28.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:28.969+0000 7f9223e00640 1 -- 172.21.15.137:0/975915512 wait complete. 2024-04-25T02:09:28.993 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2522865604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:28.993 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/806899307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.993 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:28 smithi137 ceph-mon[28303]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:28.993 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:28 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/864140303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:28.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 -- 172.21.15.137:0/1128166251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194109830 msgr2=0x7f91941100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 --2- 172.21.15.137:0/1128166251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194109830 0x7f91941100c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 -- 172.21.15.137:0/1128166251 shutdown_connections 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 --2- 172.21.15.137:0/1128166251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194109830 0x7f91941100c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 --2- 172.21.15.137:0/1128166251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f91941092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 --2- 172.21.15.137:0/1128166251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194107c80 0x7f91941080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.188+0000 7f9199400640 1 -- 172.21.15.137:0/1128166251 >> 172.21.15.137:0/1128166251 conn(0x7f9194076c10 msgr2=0x7f9194079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.189+0000 7f9199400640 1 -- 172.21.15.137:0/1128166251 shutdown_connections 2024-04-25T02:09:29.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.189+0000 7f9199400640 1 -- 172.21.15.137:0/1128166251 wait complete. 2024-04-25T02:09:29.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.189+0000 7f9199400640 1 Processor -- start 2024-04-25T02:09:29.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 -- start start 2024-04-25T02:09:29.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 0x7f919419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f919419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9194113a30 con 0x7f9194107c80 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f91941138b0 con 0x7f9194108e70 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9199400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9194113bb0 con 0x7f9194109830 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9193e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 0x7f919419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9198a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9198a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:39602/0 (socket says 172.21.15.137:39602) 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9198a00640 1 -- 172.21.15.137:0/451704710 learned_addr learned my addr 172.21.15.137:0/451704710 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9193400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f919419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.190+0000 7f9193e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 0x7f919419dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53962/0 (socket says 172.21.15.137:53962) 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 -- 172.21.15.137:0/451704710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 msgr2=0x7f919419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f919419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 -- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 msgr2=0x7f919419dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 0x7f919419dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 -- 172.21.15.137:0/451704710 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91941a5bc0 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9193400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f919419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9198a00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91840316a0 tx=0x7f91840042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918403f030 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9184003d00 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91941a5e50 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184035070 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.191+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91941a62b0 con 0x7f9194109830 2024-04-25T02:09:29.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.192+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919410eed0 con 0x7f9194109830 2024-04-25T02:09:29.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.195+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f9184042030 con 0x7f9194109830 2024-04-25T02:09:29.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.196+0000 7f9190c00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 0x7f91780a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.196+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f91840ef550 con 0x7f9194109830 2024-04-25T02:09:29.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.196+0000 7f9193e00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 0x7f91780a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.197+0000 7f9193e00640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 0x7f91780a5050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9194108cd0 tx=0x7f918c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.198+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f91840bbe10 con 0x7f9194109830 2024-04-25T02:09:29.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.399+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9194062340 con 0x7f9194109830 2024-04-25T02:09:29.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.400+0000 7f9190c00640 1 -- 172.21.15.137:0/451704710 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f91840c0110 con 0x7f9194109830 2024-04-25T02:09:29.407 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:09:29.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 msgr2=0x7f91780a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 0x7f91780a5050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9194108cd0 tx=0x7f918c009500 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 msgr2=0x7f91941a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91840316a0 tx=0x7f91840042f0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 shutdown_connections 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f91780a2b90 0x7f91780a5050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194109830 0x7f91941a5550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9194108e70 0x7f919419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 --2- 172.21.15.137:0/451704710 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194107c80 0x7f919419dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 >> 172.21.15.137:0/451704710 conn(0x7f9194076c10 msgr2=0x7f919410c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 shutdown_connections 2024-04-25T02:09:29.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.403+0000 7f9199400640 1 -- 172.21.15.137:0/451704710 wait complete. 2024-04-25T02:09:29.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 -- 172.21.15.137:0/1637574525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 msgr2=0x7f48a8101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1637574525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8101a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4898009900 tx=0x7f489802a400 comp rx=0 tx=0).stop 2024-04-25T02:09:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 -- 172.21.15.137:0/1637574525 shutdown_connections 2024-04-25T02:09:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1637574525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a8109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1637574525 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1637574525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8101a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 -- 172.21.15.137:0/1637574525 >> 172.21.15.137:0/1637574525 conn(0x7f48a80fcbe0 msgr2=0x7f48a80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 -- 172.21.15.137:0/1637574525 shutdown_connections 2024-04-25T02:09:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.633+0000 7f48a7e00640 1 -- 172.21.15.137:0/1637574525 wait complete. 2024-04-25T02:09:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.634+0000 7f48a7e00640 1 Processor -- start 2024-04-25T02:09:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 -- start start 2024-04-25T02:09:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48a810d470 con 0x7f48a8102860 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f48a810d2f0 con 0x7f48a8101670 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48a810d5f0 con 0x7f48a8103220 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a6a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a6000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a6a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:47920/0 (socket says 172.21.15.137:47920) 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a6a00640 1 -- 172.21.15.137:0/1724379728 learned_addr learned my addr 172.21.15.137:0/1724379728 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.635+0000 7f48a7400640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 -- 172.21.15.137:0/1724379728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 msgr2=0x7f48a8197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 -- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 msgr2=0x7f48a8197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 -- 172.21.15.137:0/1724379728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a819f650 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a6a00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a6000640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f48a7400640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a819efe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009fd0 tx=0x7f48a000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.636+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a000ce20 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.637+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f48a0004b20 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.637+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a819f940 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.637+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0010790 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.637+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a819fe90 con 0x7f48a8103220 2024-04-25T02:09:29.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.638+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a8108930 con 0x7f48a8103220 2024-04-25T02:09:29.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.640+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f48a0005020 con 0x7f48a8103220 2024-04-25T02:09:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.641+0000 7f489f400640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 0x7f488c0a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.641+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f48a00cf7f0 con 0x7f48a8103220 2024-04-25T02:09:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.641+0000 7f48a6a00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 0x7f488c0a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.642+0000 7f48a6a00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 0x7f488c0a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4898006010 tx=0x7f4898005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:29.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.645+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f48a009c700 con 0x7f48a8103220 2024-04-25T02:09:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:29 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/975915512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:29.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:29 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/451704710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:29.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.845+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48a8062340 con 0x7f48a8103220 2024-04-25T02:09:29.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.846+0000 7f489f400640 1 -- 172.21.15.137:0/1724379728 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f48a00bc0c0 con 0x7f48a8103220 2024-04-25T02:09:29.853 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:09:29.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 msgr2=0x7f488c0a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 0x7f488c0a5050 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4898006010 tx=0x7f4898005a20 comp rx=0 tx=0).stop 2024-04-25T02:09:29.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 msgr2=0x7f48a819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:29.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a819efe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009fd0 tx=0x7f48a000ef10 comp rx=0 tx=0).stop 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 shutdown_connections 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f488c0a2b90 0x7f488c0a5050 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8103220 0x7f48a819efe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48a8102860 0x7f48a8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.848+0000 7f48a7e00640 1 --2- 172.21.15.137:0/1724379728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48a8101670 0x7f48a8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.849+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 >> 172.21.15.137:0/1724379728 conn(0x7f48a80fcbe0 msgr2=0x7f48a8105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.849+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 shutdown_connections 2024-04-25T02:09:29.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:29.849+0000 7f48a7e00640 1 -- 172.21.15.137:0/1724379728 wait complete. 2024-04-25T02:09:29.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:29.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:29 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/975915512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:29.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:29 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/451704710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:29.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:29 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/975915512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:29.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:29 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/451704710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 -- 172.21.15.137:0/975399629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 msgr2=0x7f427c106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 --2- 172.21.15.137:0/975399629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c106d60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f426c009900 tx=0x7f426c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 -- 172.21.15.137:0/975399629 shutdown_connections 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 --2- 172.21.15.137:0/975399629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 0x7f427c1096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 --2- 172.21.15.137:0/975399629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c106d60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 --2- 172.21.15.137:0/975399629 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 0x7f427c104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 -- 172.21.15.137:0/975399629 >> 172.21.15.137:0/975399629 conn(0x7f427c0fba50 msgr2=0x7f427c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 -- 172.21.15.137:0/975399629 shutdown_connections 2024-04-25T02:09:30.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.075+0000 7f4280a00640 1 -- 172.21.15.137:0/975399629 wait complete. 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.076+0000 7f4280a00640 1 Processor -- start 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.076+0000 7f4280a00640 1 -- start start 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 0x7f427c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 0x7f427c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10d370 con 0x7f427c104970 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10d1f0 con 0x7f427c102040 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4280a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10d4f0 con 0x7f427c1072a0 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54006/0 (socket says 172.21.15.137:54006) 2024-04-25T02:09:30.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 -- 172.21.15.137:0/823361676 learned_addr learned my addr 172.21.15.137:0/823361676 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f427a800640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 0x7f427c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f427b200640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 0x7f427c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 -- 172.21.15.137:0/823361676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 msgr2=0x7f427c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 0x7f427c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 -- 172.21.15.137:0/823361676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 msgr2=0x7f427c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 0x7f427c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.077+0000 7f4279e00640 1 -- 172.21.15.137:0/823361676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c19f610 con 0x7f427c104970 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4279e00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f426c009230 tx=0x7f426c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c03f030 con 0x7f427c104970 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f426c003d00 con 0x7f427c104970 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c035070 con 0x7f427c104970 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c19f8a0 con 0x7f427c104970 2024-04-25T02:09:30.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.078+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c19fd90 con 0x7f427c104970 2024-04-25T02:09:30.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.079+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c0fd540 con 0x7f427c104970 2024-04-25T02:09:30.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.081+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f426c042030 con 0x7f427c104970 2024-04-25T02:09:30.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.083+0000 7f4273400640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 0x7f42600a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.083+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f426c0ef490 con 0x7f427c104970 2024-04-25T02:09:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.083+0000 7f427a800640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 0x7f42600a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.083+0000 7f427a800640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 0x7f42600a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4264009bd0 tx=0x7f4264005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.087+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f426c0bbd90 con 0x7f427c104970 2024-04-25T02:09:30.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.327+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427c062340 con 0x7f427c104970 2024-04-25T02:09:30.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.328+0000 7f4273400640 1 -- 172.21.15.137:0/823361676 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11884 (secure 0 0 0) 0x7f426c0c0090 con 0x7f427c104970 2024-04-25T02:09:30.336 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:30.336 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:07:24.393065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:09:30.336 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-25T02:09:30.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 msgr2=0x7f42600a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 0x7f42600a5050 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4264009bd0 tx=0x7f4264005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 msgr2=0x7f427c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f426c009230 tx=0x7f426c0042f0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 shutdown_connections 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f42600a2b90 0x7f42600a5050 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f427c1072a0 0x7f427c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f427c104970 0x7f427c197f30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 --2- 172.21.15.137:0/823361676 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f427c102040 0x7f427c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 >> 172.21.15.137:0/823361676 conn(0x7f427c0fba50 msgr2=0x7f427c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 shutdown_connections 2024-04-25T02:09:30.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.331+0000 7f4280a00640 1 -- 172.21.15.137:0/823361676 wait complete. 2024-04-25T02:09:30.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:30.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 -- 172.21.15.137:0/555720793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c0741a0 msgr2=0x7ff30c074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 --2- 172.21.15.137:0/555720793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c0741a0 0x7ff30c074620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009890 tx=0x7ff2f402a360 comp rx=0 tx=0).stop 2024-04-25T02:09:30.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 -- 172.21.15.137:0/555720793 shutdown_connections 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 --2- 172.21.15.137:0/555720793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c10dd60 0x7ff30c110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 --2- 172.21.15.137:0/555720793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c0741a0 0x7ff30c074620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 --2- 172.21.15.137:0/555720793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 0x7ff30c073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 -- 172.21.15.137:0/555720793 >> 172.21.15.137:0/555720793 conn(0x7ff30c0fcd20 msgr2=0x7ff30c0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 -- 172.21.15.137:0/555720793 shutdown_connections 2024-04-25T02:09:30.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.551+0000 7ff312000640 1 -- 172.21.15.137:0/555720793 wait complete. 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.552+0000 7ff312000640 1 Processor -- start 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 -- start start 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 0x7ff30c19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 0x7ff30c1a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c113b40 con 0x7ff30c0741a0 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c1139c0 con 0x7ff30c10dd60 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff312000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c113cc0 con 0x7ff30c075780 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff30b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff30b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54026/0 (socket says 172.21.15.137:54026) 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff30b400640 1 -- 172.21.15.137:0/621033262 learned_addr learned my addr 172.21.15.137:0/621033262 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff30be00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 0x7ff30c1a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.553+0000 7ff302a00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 0x7ff30c19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 -- 172.21.15.137:0/621033262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 msgr2=0x7ff30c19e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 0x7ff30c19e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 -- 172.21.15.137:0/621033262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 msgr2=0x7ff30c1a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 0x7ff30c1a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 -- 172.21.15.137:0/621033262 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c1a5db0 con 0x7ff30c0741a0 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30be00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 0x7ff30c1a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:30.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff30b400640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00e9f0 tx=0x7ff2fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00cd80 con 0x7ff30c0741a0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2fc005520 con 0x7ff30c0741a0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c1a60a0 con 0x7ff30c0741a0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.554+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc010690 con 0x7ff30c0741a0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.555+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c1a65c0 con 0x7ff30c0741a0 2024-04-25T02:09:30.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.556+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c103f30 con 0x7ff30c0741a0 2024-04-25T02:09:30.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.558+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7ff2fc0046c0 con 0x7ff30c0741a0 2024-04-25T02:09:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.559+0000 7ff308c00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 0x7ff2f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.559+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7ff2fc0cf3e0 con 0x7ff30c0741a0 2024-04-25T02:09:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.559+0000 7ff302a00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 0x7ff2f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.560+0000 7ff302a00640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 0x7ff2f00a50d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097b0 tx=0x7ff2f4030610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.564+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff2fc09c350 con 0x7ff30c0741a0 2024-04-25T02:09:30.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.764+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff30c062340 con 0x7ff30c0741a0 2024-04-25T02:09:30.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.768+0000 7ff308c00640 1 -- 172.21.15.137:0/621033262 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22680 (secure 0 0 0) 0x7ff2fc09bc50 con 0x7ff30c0741a0 2024-04-25T02:09:30.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:30.775 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:07:27.432292+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 msgr2=0x7ff2f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 0x7ff2f00a50d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40097b0 tx=0x7ff2f4030610 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 msgr2=0x7ff30c19e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00e9f0 tx=0x7ff2fc00edf0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 shutdown_connections 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7ff2f00a2c10 0x7ff2f00a50d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff30c10dd60 0x7ff30c1a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff30c075780 0x7ff30c19e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 --2- 172.21.15.137:0/621033262 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff30c0741a0 0x7ff30c19e190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 >> 172.21.15.137:0/621033262 conn(0x7ff30c0fcd20 msgr2=0x7ff30c101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 shutdown_connections 2024-04-25T02:09:30.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.771+0000 7ff312000640 1 -- 172.21.15.137:0/621033262 wait complete. 2024-04-25T02:09:30.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:30 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1724379728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:30.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:30 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/823361676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:30.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:30 smithi137 ceph-mon[28303]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T02:09:30.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T02:07:18.852775+0000', 'modified': '2024-04-25T02:07:24.393065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24559, 'mds_2': 24538}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6835/2970303147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6834', 'nonce': 2970303147}, {'type': 'v1', 'addr': '172.21.15.163:6835', 'nonce': 2970303147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6837/432820443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6836', 'nonce': 432820443}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 432820443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24526': {'gid': 24526, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/1300618267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 1300618267}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 1300618267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6837/1033703342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 1033703342}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 1033703342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.174:6839/695835924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 695835924}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 695835924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6839/2170091547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6838', 'nonce': 2170091547}, {'type': 'v1', 'addr': '172.21.15.163:6839', 'nonce': 2170091547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24560, 24538, 24559]} 2024-04-25T02:09:30.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T02:09:30.797 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T02:09:30.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:30 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1724379728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:30.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:30 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/823361676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:30.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:30 smithi163 ceph-mon[32577]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T02:09:30.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:30 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1724379728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:30.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:30 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/823361676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:30.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:30 smithi174 ceph-mon[33171]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-25T02:09:30.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 -- 172.21.15.137:0/1010713370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 msgr2=0x7fc82c101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 --2- 172.21.15.137:0/1010713370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c101d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc818009860 tx=0x7fc81802a340 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 -- 172.21.15.137:0/1010713370 shutdown_connections 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 --2- 172.21.15.137:0/1010713370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 0x7fc82c108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 --2- 172.21.15.137:0/1010713370 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c101d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 --2- 172.21.15.137:0/1010713370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 -- 172.21.15.137:0/1010713370 >> 172.21.15.137:0/1010713370 conn(0x7fc82c0fbc30 msgr2=0x7fc82c0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 -- 172.21.15.137:0/1010713370 shutdown_connections 2024-04-25T02:09:30.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.981+0000 7fc834000640 1 -- 172.21.15.137:0/1010713370 wait complete. 2024-04-25T02:09:30.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.982+0000 7fc834000640 1 Processor -- start 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.982+0000 7fc834000640 1 -- start start 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 0x7fc82c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c10c450 con 0x7fc82c1006a0 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c10c2d0 con 0x7fc82c102250 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc834000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c10c5d0 con 0x7fc82c101890 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36812/0 (socket says 172.21.15.137:36812) 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 -- 172.21.15.137:0/2307400722 learned_addr learned my addr 172.21.15.137:0/2307400722 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc830c00640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc832000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 0x7fc82c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 -- 172.21.15.137:0/2307400722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 msgr2=0x7fc82c102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 -- 172.21.15.137:0/2307400722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 msgr2=0x7fc82c1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 0x7fc82c1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.983+0000 7fc831600640 1 -- 172.21.15.137:0/2307400722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c103a70 con 0x7fc82c1006a0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc831600640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c3a0 tx=0x7fc82000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc82a000640 1 -- 172.21.15.137:0/2307400722 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820003970 con 0x7fc82c1006a0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c1a1d20 con 0x7fc82c1006a0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc82a000640 1 -- 172.21.15.137:0/2307400722 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc820004520 con 0x7fc82c1006a0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc82a000640 1 -- 172.21.15.137:0/2307400722 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82000bab0 con 0x7fc82c1006a0 2024-04-25T02:09:30.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.984+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c1a21d0 con 0x7fc82c1006a0 2024-04-25T02:09:30.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.987+0000 7fc836da1740 1 Processor -- start 2024-04-25T02:09:30.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.987+0000 7fc836da1740 1 -- start start 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b79c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b7a2c0 0x55aca7b7c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aca7a74ed0 con 0x55aca7b7a2c0 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55aca7ad7df0 con 0x55aca7b75150 2024-04-25T02:09:30.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc836da1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55aca7a808d0 con 0x55aca7b74760 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc82a000640 1 -- 172.21.15.137:0/2307400722 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc82001d020 con 0x7fc82c1006a0 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48606/0 (socket says 172.21.15.137:48606) 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 -- 172.21.15.137:0/1142394294 learned_addr learned my addr 172.21.15.137:0/1142394294 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc830c00640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b7a2c0 0x55aca7b7c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc831600640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b79c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 -- 172.21.15.137:0/1142394294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 msgr2=0x55aca7b79c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b79c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 -- 172.21.15.137:0/1142394294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b7a2c0 msgr2=0x55aca7b7c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b7a2c0 0x55aca7b7c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc832000640 1 -- 172.21.15.137:0/1142394294 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca77ec2d0 con 0x55aca7b74760 2024-04-25T02:09:30.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.988+0000 7fc831600640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b79c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.989+0000 7fc832000640 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b6b0 tx=0x7fc82400bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b125aadb7b59db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.989+0000 7fc81e600640 1 -- 172.21.15.137:0/1142394294 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824003bd0 con 0x55aca7b74760 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.989+0000 7fc81e600640 1 -- 172.21.15.137:0/1142394294 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc824015070 con 0x55aca7b74760 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.989+0000 7fc81e600640 1 -- 172.21.15.137:0/1142394294 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824011750 con 0x55aca7b74760 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.989+0000 7fc82a000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 0x7fc8140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc82a000640 1 -- 172.21.15.137:0/2307400722 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc8200cef60 con 0x7fc82c1006a0 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc831600640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 0x7fc8140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 -- 172.21.15.137:0/1142394294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 msgr2=0x55aca7b74b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b6b0 tx=0x7fc82400bb70 comp rx=0 tx=0).stop 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 -- 172.21.15.137:0/1142394294 shutdown_connections 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b7a2c0 0x55aca7b7c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b79c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 --2- 172.21.15.137:0/1142394294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b74760 0x55aca7b74b80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:30.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 -- 172.21.15.137:0/1142394294 >> 172.21.15.137:0/1142394294 conn(0x55aca7b6fdd0 msgr2=0x55aca7b701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 -- 172.21.15.137:0/1142394294 shutdown_connections 2024-04-25T02:09:31.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc836da1740 1 -- 172.21.15.137:0/1142394294 wait complete. 2024-04-25T02:09:31.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.990+0000 7fc831600640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 0x7fc8140a50d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ccde0 tx=0x7fc820000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 -- start start 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 Processor -- start 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b7ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b85fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aca7a93d20 con 0x55aca7b74760 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55aca7ad3db0 con 0x55aca7b7a2c0 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b7d270 con 0x55aca7b75150 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc836da1740 10 client.0 _ll_register_callbacks cb 0x55aca7acef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc832000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc832000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36816/0 (socket says 172.21.15.137:36816) 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.991+0000 7fc832000640 1 -- 172.21.15.137:0/4261189464 learned_addr learned my addr 172.21.15.137:0/4261189464 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc830c00640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b7ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b85fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 -- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 msgr2=0x55aca7b7ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b7ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 -- 172.21.15.137:0/4261189464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 msgr2=0x55aca7b85fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b85fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 -- 172.21.15.137:0/4261189464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aca78b66b0 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc832000640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b610 tx=0x7fc82400b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8393e847b8a00dad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc812a00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82401a670 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc82401a810 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.992+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc824015070 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc824032050 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 10 client.15069 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55aca7b89290 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc824015070 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc824004c00 con 0x55aca7b74760 2024-04-25T02:09:31.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 10 client.15069 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 10 client.15069 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 20 client.15069 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7b8b4e0 0x55aca7b8c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 4 client.15069 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.993+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aca7ae5330 con 0x55aca7b8b4e0 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.994+0000 7fc830c00640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7b8b4e0 0x55aca7b8c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.994+0000 7fc830c00640 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7b8b4e0 0x55aca7b8c950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=714024c68f5df14a server_cookie=12be376e4159e652 in_seq=0 out_seq=0 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.994+0000 7fc812a00640 10 client.15069 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc812a00640 1 -- 172.21.15.137:0/4261189464 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aca7ae5330 con 0x55aca7b8b4e0 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc812a00640 10 client.15069 handle_command_reply: tid=0 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 client.15069 shutdown 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 msgr2=0x55aca7b7ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc82400b610 tx=0x7fc82400b560 comp rx=0 tx=0).stop 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 shutdown_connections 2024-04-25T02:09:31.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b85fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7b8b4e0 0x55aca7b8c950 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.995+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b7ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc836da1740 1 --2- 172.21.15.137:0/4261189464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b7ea30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc812a00640 0 client.15069 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 >> 172.21.15.137:0/4261189464 conn(0x55aca7b6fdd0 msgr2=0x55aca7b6ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 shutdown_connections 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc836da1740 1 -- 172.21.15.137:0/4261189464 wait complete. 2024-04-25T02:09:31.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:30.996+0000 7fc836da1740 20 client.15069 trim_cache size 0 max 16384 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 Processor -- start 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 -- start start 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b85f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b7a2c0 0x55aca7b76510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8ac90 con 0x55aca7b74760 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8b360 con 0x55aca7b75150 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc836da1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8ba30 con 0x55aca7b7a2c0 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc832000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc832000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36824/0 (socket says 172.21.15.137:36824) 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc832000640 1 -- 172.21.15.137:0/3415709514 learned_addr learned my addr 172.21.15.137:0/3415709514 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc830c00640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b85f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.015+0000 7fc832000640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b7a2c0 0x55aca7b76510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 -- 172.21.15.137:0/3415709514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b7a2c0 msgr2=0x55aca7b76510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b7a2c0 0x55aca7b76510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 -- 172.21.15.137:0/3415709514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 msgr2=0x55aca7b79b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 -- 172.21.15.137:0/3415709514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aca7b75530 con 0x55aca7b75150 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc832000640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc830c00640 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b85f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc818035040 tx=0x7fc8180305c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1ffa77fc6e9cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.016+0000 7fc81dc00640 1 -- 172.21.15.137:0/3415709514 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818037040 con 0x55aca7b75150 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc81dc00640 1 -- 172.21.15.137:0/3415709514 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc818038040 con 0x55aca7b75150 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc81dc00640 1 -- 172.21.15.137:0/3415709514 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8180039e0 con 0x55aca7b75150 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 -- 172.21.15.137:0/3415709514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 msgr2=0x55aca7b85f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b85f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc818035040 tx=0x7fc8180305c0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 -- 172.21.15.137:0/3415709514 shutdown_connections 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b7a2c0 0x55aca7b76510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b75150 0x55aca7b85f70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 --2- 172.21.15.137:0/3415709514 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 -- 172.21.15.137:0/3415709514 >> 172.21.15.137:0/3415709514 conn(0x55aca7b6fdd0 msgr2=0x55aca7b701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 -- 172.21.15.137:0/3415709514 shutdown_connections 2024-04-25T02:09:31.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.017+0000 7fc836da1740 1 -- 172.21.15.137:0/3415709514 wait complete. 2024-04-25T02:09:31.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 -- start start 2024-04-25T02:09:31.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 Processor -- start 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b84c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8c7d0 con 0x55aca7b74760 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8c100 con 0x55aca7b7a2c0 2024-04-25T02:09:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55aca7b8cea0 con 0x55aca7b75150 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.018+0000 7fc836da1740 10 client.0 _ll_register_callbacks cb 0x7fc820009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48622/0 (socket says 172.21.15.137:48622) 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 -- 172.21.15.137:0/2780040286 learned_addr learned my addr 172.21.15.137:0/2780040286 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc832000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 -- 172.21.15.137:0/2780040286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 msgr2=0x55aca7b84c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b84c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 -- 172.21.15.137:0/2780040286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 msgr2=0x55aca7b817a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b817a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 -- 172.21.15.137:0/2780040286 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aca7b85290 con 0x55aca7b75150 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc830c00640 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc818009780 tx=0x7fc818005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811a5135c92c29ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc812a00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818057060 con 0x55aca7b75150 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc818038040 con 0x55aca7b75150 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.019+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fc818030a10 con 0x55aca7b75150 2024-04-25T02:09:31.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc818037040 con 0x55aca7b75150 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 10 client.25201 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55aca7bf14f0 con 0x55aca7b75150 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc818038040 con 0x55aca7b75150 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc818047030 con 0x55aca7b75150 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 10 client.25201 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 10 client.25201 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 20 client.25201 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7bf5c90 0x55aca7bf49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 4 client.25201 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.020+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "status"}) -- 0x55aca7adf680 con 0x55aca7bf5c90 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc832000640 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7bf5c90 0x55aca7bf49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc832000640 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7bf5c90 0x55aca7bf49a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=afaee913c9d75d2e server_cookie=3efe1feb3fcb807d in_seq=0 out_seq=0 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc812a00640 10 client.25201 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc812a00640 1 -- 172.21.15.137:0/2780040286 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aca7adf680 con 0x55aca7bf5c90 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc812a00640 10 client.25201 handle_command_reply: tid=0 2024-04-25T02:09:31.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 client.25201 shutdown 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 msgr2=0x55aca7b81ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc818009780 tx=0x7fc818005fd0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 shutdown_connections 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aca7b7a2c0 0x55aca7b84c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55aca7bf5c90 0x55aca7bf49a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55aca7b75150 0x55aca7b81ce0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 --2- 172.21.15.137:0/2780040286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55aca7b74760 0x55aca7b817a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 >> 172.21.15.137:0/2780040286 conn(0x55aca7b6fdd0 msgr2=0x55aca7b79780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.021+0000 7fc812a00640 0 client.25201 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 shutdown_connections 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc836da1740 1 -- 172.21.15.137:0/2780040286 wait complete. 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc836da1740 20 client.25201 trim_cache size 0 max 16384 2024-04-25T02:09:31.032 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 2, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24538, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 127.637465726, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 155.38311166299999 2024-04-25T02:09:31.033 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 msgr2=0x7fc8140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 0x7fc8140a50d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ccde0 tx=0x7fc820000f40 comp rx=0 tx=0).stop 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 msgr2=0x7fc82c1045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc82000c3a0 tx=0x7fc82000c860 comp rx=0 tx=0).stop 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 shutdown_connections 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fc8140a2c10 0x7fc8140a50d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc82c102250 0x7fc82c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc82c101890 0x7fc82c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 --2- 172.21.15.137:0/2307400722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc82c1006a0 0x7fc82c1045e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 >> 172.21.15.137:0/2307400722 conn(0x7fc82c0fbc30 msgr2=0x7fc82c0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.022+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 shutdown_connections 2024-04-25T02:09:31.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.023+0000 7fc834000640 1 -- 172.21.15.137:0/2307400722 wait complete. 2024-04-25T02:09:31.046 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 -- 172.21.15.137:0/749124762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464108e70 msgr2=0x7fe4641092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 --2- 172.21.15.137:0/749124762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464108e70 0x7fe4641092f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009860 tx=0x7fe44c02a340 comp rx=0 tx=0).stop 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 -- 172.21.15.137:0/749124762 shutdown_connections 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 --2- 172.21.15.137:0/749124762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464109830 0x7fe4641100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 --2- 172.21.15.137:0/749124762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464108e70 0x7fe4641092f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 --2- 172.21.15.137:0/749124762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe4641080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 -- 172.21.15.137:0/749124762 >> 172.21.15.137:0/749124762 conn(0x7fe464076c10 msgr2=0x7fe464079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 -- 172.21.15.137:0/749124762 shutdown_connections 2024-04-25T02:09:31.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.226+0000 7fe469a00640 1 -- 172.21.15.137:0/749124762 wait complete. 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.227+0000 7fe469a00640 1 Processor -- start 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.227+0000 7fe469a00640 1 -- start start 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464108e70 0x7fe46419e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464109830 0x7fe4641a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe464113a30 con 0x7fe464108e70 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe4641138b0 con 0x7fe464107c80 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe464113bb0 con 0x7fe464109830 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe45b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464108e70 0x7fe46419e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:46414/0 (socket says 172.21.15.137:46414) 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 -- 172.21.15.137:0/3434329650 learned_addr learned my addr 172.21.15.137:0/3434329650 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe469000640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464109830 0x7fe4641a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 -- 172.21.15.137:0/3434329650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464109830 msgr2=0x7fe4641a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464109830 0x7fe4641a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 -- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464108e70 msgr2=0x7fe46419e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464108e70 0x7fe46419e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.228+0000 7fe463e00640 1 -- 172.21.15.137:0/3434329650 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4641a5c60 con 0x7fe464107c80 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe463e00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe45400e9c0 tx=0x7fe45400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe461600640 1 -- 172.21.15.137:0/3434329650 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45400cd80 con 0x7fe464107c80 2024-04-25T02:09:31.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe461600640 1 -- 172.21.15.137:0/3434329650 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4540035f0 con 0x7fe464107c80 2024-04-25T02:09:31.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4641a5f50 con 0x7fe464107c80 2024-04-25T02:09:31.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe461600640 1 -- 172.21.15.137:0/3434329650 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454010670 con 0x7fe464107c80 2024-04-25T02:09:31.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.229+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4641a6360 con 0x7fe464107c80 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 Processor -- start 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 -- start start 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce122e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce125960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe461600640 1 -- 172.21.15.137:0/3434329650 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fe4540037a0 con 0x7fe464107c80 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560bce01ded0 con 0x560bce11e360 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x560bce080df0 con 0x560bce1234d0 2024-04-25T02:09:31.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.232+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bce0298d0 con 0x560bce11d970 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe463e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48654/0 (socket says 172.21.15.137:48654) 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 -- 172.21.15.137:0/3686741380 learned_addr learned my addr 172.21.15.137:0/3686741380 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe45b400640 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce125960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 -- 172.21.15.137:0/3686741380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 msgr2=0x560bce125960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce125960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 -- 172.21.15.137:0/3686741380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 msgr2=0x560bce122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 -- 172.21.15.137:0/3686741380 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bcdd952d0 con 0x560bce11d970 2024-04-25T02:09:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.233+0000 7fe469000640 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00e450 tx=0x7fe45c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be64b34d10df4d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe459600640 1 -- 172.21.15.137:0/3686741380 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c00d910 con 0x560bce11d970 2024-04-25T02:09:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe459600640 1 -- 172.21.15.137:0/3686741380 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe45c01c070 con 0x560bce11d970 2024-04-25T02:09:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe459600640 1 -- 172.21.15.137:0/3686741380 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c016380 con 0x560bce11d970 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe461600640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 0x7fe4480a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 -- 172.21.15.137:0/3686741380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 msgr2=0x560bce11dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00e450 tx=0x7fe45c0095c0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 -- 172.21.15.137:0/3686741380 shutdown_connections 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce125960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/3686741380 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce11dd90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe46ddfa740 1 -- 172.21.15.137:0/3686741380 >> 172.21.15.137:0/3686741380 conn(0x560bce118fe0 msgr2=0x560bce1193e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe461600640 1 -- 172.21.15.137:0/3434329650 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe4540cf430 con 0x7fe464107c80 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.234+0000 7fe463e00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 0x7fe4480a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.235+0000 7fe46ddfa740 1 -- 172.21.15.137:0/3686741380 shutdown_connections 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.235+0000 7fe46ddfa740 1 -- 172.21.15.137:0/3686741380 wait complete. 2024-04-25T02:09:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.235+0000 7fe463e00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 0x7fe4480a5050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe4540a4380 tx=0x7fe4540d2e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.235+0000 7fe46ddfa740 1 -- start start 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.235+0000 7fe46ddfa740 1 Processor -- start 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce127c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce12f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560bce03cd20 con 0x560bce11e360 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x560bce07cdb0 con 0x560bce1234d0 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bce126480 con 0x560bce11d970 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe46ddfa740 10 client.0 _ll_register_callbacks cb 0x560bce077f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36860/0 (socket says 172.21.15.137:36860) 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 -- 172.21.15.137:0/2710640075 learned_addr learned my addr 172.21.15.137:0/2710640075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe469000640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce127c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 -- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 msgr2=0x560bce127c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce127c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe469000640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce12f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 -- 172.21.15.137:0/2710640075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 msgr2=0x560bce12f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce12f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe45b400640 1 -- 172.21.15.137:0/2710640075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bcde5f6b0 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.236+0000 7fe469000640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce12f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe45b400640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009860 tx=0x7fe44c0308f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d923d9401c8c3d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c037040 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe44c004450 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe45c01c070 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe44c04f050 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe46ddfa740 10 client.15087 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560bce132580 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe45c01c070 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.237+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe44c03d040 con 0x560bce11e360 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 10 client.15087 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 20 client.15087 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce134c50 0x560bce1360c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 4 client.15087 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bce08e330 con 0x560bce134c50 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.238+0000 7fe469000640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce134c50 0x560bce1360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.239+0000 7fe469000640 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce134c50 0x560bce1360c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9af5fda12be75fae server_cookie=6264d23a88ba6195 in_seq=0 out_seq=0 2024-04-25T02:09:31.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.239+0000 7fe452000640 10 client.15087 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe452000640 1 -- 172.21.15.137:0/2710640075 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560bce08e330 con 0x560bce134c50 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe452000640 10 client.15087 handle_command_reply: tid=0 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 client.15087 shutdown 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 msgr2=0x560bce128180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009860 tx=0x7fe44c0308f0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 shutdown_connections 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce134c50 0x560bce1360c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce1234d0 0x560bce12f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce128180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/2710640075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce127c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe452000640 0 client.15087 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 >> 172.21.15.137:0/2710640075 conn(0x560bce118fe0 msgr2=0x560bce118120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 shutdown_connections 2024-04-25T02:09:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 1 -- 172.21.15.137:0/2710640075 wait complete. 2024-04-25T02:09:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.240+0000 7fe46ddfa740 20 client.15087 trim_cache size 0 max 16384 2024-04-25T02:09:31.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 Processor -- start 2024-04-25T02:09:31.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 -- start start 2024-04-25T02:09:31.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11d970 0x560bce11bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce1234d0 0x560bce11c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560bce134400 con 0x560bce11e360 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x560bce134ad0 con 0x560bce11d970 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.259+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bce1351a0 con 0x560bce1234d0 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36876/0 (socket says 172.21.15.137:36876) 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 -- 172.21.15.137:0/4061029453 learned_addr learned my addr 172.21.15.137:0/4061029453 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe469000640 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11d970 0x560bce11bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe469000640 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce1234d0 0x560bce11c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 -- 172.21.15.137:0/4061029453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce1234d0 msgr2=0x560bce11c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce1234d0 0x560bce11c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 -- 172.21.15.137:0/4061029453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11d970 msgr2=0x560bce11bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11d970 0x560bce11bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 -- 172.21.15.137:0/4061029453 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bce11ebf0 con 0x560bce11e360 2024-04-25T02:09:31.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe45b400640 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02a860 tx=0x7fe44c0095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3365a153df608a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe458c00640 1 -- 172.21.15.137:0/4061029453 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c058070 con 0x560bce11e360 2024-04-25T02:09:31.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.260+0000 7fe458c00640 1 -- 172.21.15.137:0/4061029453 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe44c038040 con 0x560bce11e360 2024-04-25T02:09:31.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe458c00640 1 -- 172.21.15.137:0/4061029453 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c037030 con 0x560bce11e360 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4061029453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 msgr2=0x560bce12f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02a860 tx=0x7fe44c0095b0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4061029453 shutdown_connections 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce1234d0 0x560bce11c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce11e360 0x560bce12f110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4061029453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11d970 0x560bce11bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4061029453 >> 172.21.15.137:0/4061029453 conn(0x560bce118fe0 msgr2=0x560bce1193c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4061029453 shutdown_connections 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.261+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4061029453 wait complete. 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 -- start start 2024-04-25T02:09:31.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 Processor -- start 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce12acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 0x560bce12b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560bce135f40 con 0x560bce1234d0 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x560bce135870 con 0x560bce11e360 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bce136610 con 0x560bce11d970 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe46ddfa740 10 client.0 _ll_register_callbacks cb 0x7fe454005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe469000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe469000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36886/0 (socket says 172.21.15.137:36886) 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.262+0000 7fe469000640 1 -- 172.21.15.137:0/4221793944 learned_addr learned my addr 172.21.15.137:0/4221793944 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe469000640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce12acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 0x560bce12b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 -- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 msgr2=0x560bce12acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce12acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 -- 172.21.15.137:0/4221793944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 msgr2=0x560bce12e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 -- 172.21.15.137:0/4221793944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bce12e7a0 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe469000640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe45b400640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 0x560bce12b200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02a380 tx=0x7fe44c032440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3580de046915e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe452000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c058050 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe44c038040 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.263+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fe44c032b90 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe44c037040 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 10 client.25172 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560bce19afc0 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe44c038040 con 0x560bce11e360 2024-04-25T02:09:31.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe44c053550 con 0x560bce11e360 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 10 client.25172 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 10 client.25172 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 20 client.25172 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce19f9b0 0x560bce19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 4 client.25172 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.264+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "status"}) -- 0x560bce088680 con 0x560bce19f9b0 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe469000640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce19f9b0 0x560bce19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe469000640 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce19f9b0 0x560bce19e6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f5a20044e7042ac server_cookie=58ab006322a268d0 in_seq=0 out_seq=0 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe452000640 10 client.25172 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe452000640 1 -- 172.21.15.137:0/4221793944 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560bce088680 con 0x560bce19f9b0 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe452000640 10 client.25172 handle_command_reply: tid=0 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.265+0000 7fe46ddfa740 1 client.25172 shutdown 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 msgr2=0x560bce12b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 0x560bce12b200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe44c02a380 tx=0x7fe44c032440 comp rx=0 tx=0).stop 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 shutdown_connections 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x560bce19f9b0 0x560bce19e6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560bce1234d0 0x560bce12e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560bce11e360 0x560bce12b200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 --2- 172.21.15.137:0/4221793944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bce11d970 0x560bce12acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe452000640 0 client.25172 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 >> 172.21.15.137:0/4221793944 conn(0x560bce118fe0 msgr2=0x560bce117620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 shutdown_connections 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 1 -- 172.21.15.137:0/4221793944 wait complete. 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe46ddfa740 20 client.25172 trim_cache size 0 max 16384 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:31.277 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 1, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24559, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 128.89360368600001, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 149.93233857499999 2024-04-25T02:09:31.278 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 msgr2=0x7fe4480a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 0x7fe4480a5050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe4540a4380 tx=0x7fe4540d2e70 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 msgr2=0x7fe46419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.266+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe45400e9c0 tx=0x7fe45400ee80 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 shutdown_connections 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fe4480a2b90 0x7fe4480a5050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe464109830 0x7fe4641a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe464108e70 0x7fe46419e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 --2- 172.21.15.137:0/3434329650 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe464107c80 0x7fe46419e040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 >> 172.21.15.137:0/3434329650 conn(0x7fe464076c10 msgr2=0x7fe46410c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 shutdown_connections 2024-04-25T02:09:31.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.267+0000 7fe469a00640 1 -- 172.21.15.137:0/3434329650 wait complete. 2024-04-25T02:09:31.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 -- 172.21.15.137:0/3068504259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 msgr2=0x7f22581100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 --2- 172.21.15.137:0/3068504259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581100c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2250009be0 tx=0x7f225002a6c0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 -- 172.21.15.137:0/3068504259 shutdown_connections 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 --2- 172.21.15.137:0/3068504259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581100c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 --2- 172.21.15.137:0/3068504259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 0x7f22581092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 --2- 172.21.15.137:0/3068504259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f22581080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 -- 172.21.15.137:0/3068504259 >> 172.21.15.137:0/3068504259 conn(0x7f2258076c10 msgr2=0x7f2258079050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 -- 172.21.15.137:0/3068504259 shutdown_connections 2024-04-25T02:09:31.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.480+0000 7f225e200640 1 -- 172.21.15.137:0/3068504259 wait complete. 2024-04-25T02:09:31.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 Processor -- start 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 -- start start 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 0x7f225819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2258113a30 con 0x7f2258107c80 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f22581138b0 con 0x7f2258108e70 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.481+0000 7f225e200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2258113bb0 con 0x7f2258109830 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36904/0 (socket says 172.21.15.137:36904) 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 -- 172.21.15.137:0/4271966530 learned_addr learned my addr 172.21.15.137:0/4271966530 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225d800640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f224fe00640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 0x7f225819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 -- 172.21.15.137:0/4271966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 msgr2=0x7f22581a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 -- 172.21.15.137:0/4271966530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 msgr2=0x7f225819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 0x7f225819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 -- 172.21.15.137:0/4271966530 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22581a5c30 con 0x7f2258107c80 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f225ce00640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9f0 tx=0x7f224000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f2256000640 1 -- 172.21.15.137:0/4271966530 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224000ccc0 con 0x7f2258107c80 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.482+0000 7f2256000640 1 -- 172.21.15.137:0/4271966530 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22400035f0 con 0x7f2258107c80 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.483+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22581a5f20 con 0x7f2258107c80 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.483+0000 7f2256000640 1 -- 172.21.15.137:0/4271966530 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224000ce60 con 0x7f2258107c80 2024-04-25T02:09:31.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.483+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581a6380 con 0x7f2258107c80 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 Processor -- start 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2256000640 1 -- 172.21.15.137:0/4271966530 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f22400037a0 con 0x7f2258107c80 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 -- start start 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bdae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43bdd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a43ad5ed0 con 0x564a43bd5970 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x564a43b38df0 con 0x564a43bd6360 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f2262632740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564a43ae18d0 con 0x564a43bdb4d0 2024-04-25T02:09:31.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f225ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bdae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f224fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43bdd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36910/0 (socket says 172.21.15.137:36910) 2024-04-25T02:09:31.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.486+0000 7f225d800640 1 -- 172.21.15.137:0/1080280861 learned_addr learned my addr 172.21.15.137:0/1080280861 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 -- 172.21.15.137:0/1080280861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 msgr2=0x564a43bdae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bdae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 -- 172.21.15.137:0/1080280861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 msgr2=0x564a43bd5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 -- 172.21.15.137:0/1080280861 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4384d2d0 con 0x564a43bdb4d0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224fe00640 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43bdd960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2248009bd0 tx=0x7f2248011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279b28e9d8c9fbeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f2256000640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 0x7f22380a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224e000640 1 -- 172.21.15.137:0/1080280861 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248004230 con 0x564a43bdb4d0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224e000640 1 -- 172.21.15.137:0/1080280861 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2248009e40 con 0x564a43bdb4d0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f224e000640 1 -- 172.21.15.137:0/1080280861 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248004e10 con 0x564a43bdb4d0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.487+0000 7f2256000640 1 -- 172.21.15.137:0/4271966530 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f22400cf2b0 con 0x7f2258107c80 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f225d800640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 0x7f22380a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 -- 172.21.15.137:0/1080280861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 msgr2=0x564a43bdd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43bdd960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2248009bd0 tx=0x7f2248011810 comp rx=0 tx=0).stop 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f225d800640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 0x7f22380a5050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564a43bd6bc0 tx=0x7f2250030ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 -- 172.21.15.137:0/1080280861 shutdown_connections 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43bdd960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bdae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 --2- 172.21.15.137:0/1080280861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 -- 172.21.15.137:0/1080280861 >> 172.21.15.137:0/1080280861 conn(0x564a43bd0fe0 msgr2=0x564a43bd13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 -- 172.21.15.137:0/1080280861 shutdown_connections 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.488+0000 7f2262632740 1 -- 172.21.15.137:0/1080280861 wait complete. 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 -- start start 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 Processor -- start 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd5970 0x564a43bdfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43be0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a43af4d20 con 0x564a43bdb4d0 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x564a43b34db0 con 0x564a43bd6360 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.489+0000 7f2262632740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564a43bde480 con 0x564a43bd5970 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f2262632740 10 client.0 _ll_register_callbacks cb 0x564a43b2ff10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43be0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36926/0 (socket says 172.21.15.137:36926) 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f225d800640 1 -- 172.21.15.137:0/3140812996 learned_addr learned my addr 172.21.15.137:0/3140812996 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f225ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd5970 0x564a43bdfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 -- 172.21.15.137:0/3140812996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd5970 msgr2=0x564a43bdfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd5970 0x564a43bdfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 -- 172.21.15.137:0/3140812996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 msgr2=0x564a43be7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 -- 172.21.15.137:0/3140812996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a439176b0 con 0x564a43bd6360 2024-04-25T02:09:31.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f225d800640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.490+0000 7f224fe00640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43be0130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2248011d10 tx=0x7f2248004490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c0a7555b511adbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2246a00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248027020 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f22480037f0 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a43b46330 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f224801e040 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2262632740 10 client.25184 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564a43bea4e0 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.491+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x564a43b46330 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f2248018070 con 0x564a43bd6360 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 10 client.25184 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 10 client.25184 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 20 client.25184 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43bec8c0 0x564a43bedd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 4 client.25184 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a43b40680 con 0x564a43bec8c0 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f225ce00640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43bec8c0 0x564a43bedd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f225ce00640 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43bec8c0 0x564a43bedd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6197d1d8e680130 server_cookie=9b5a9bd445f133e in_seq=0 out_seq=0 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.492+0000 7f2246a00640 10 client.25184 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2246a00640 1 -- 172.21.15.137:0/3140812996 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564a43b40680 con 0x564a43bec8c0 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2246a00640 10 client.25184 handle_command_reply: tid=0 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2262632740 1 client.25184 shutdown 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 msgr2=0x564a43be0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43be0130 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2248011d10 tx=0x7f2248004490 comp rx=0 tx=0).stop 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 shutdown_connections 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.493+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43bec8c0 0x564a43bedd30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43be7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43be0130 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 --2- 172.21.15.137:0/3140812996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd5970 0x564a43bdfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2246a00640 0 client.25184 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 >> 172.21.15.137:0/3140812996 conn(0x564a43bd0fe0 msgr2=0x564a43bd0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 shutdown_connections 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 1 -- 172.21.15.137:0/3140812996 wait complete. 2024-04-25T02:09:31.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.494+0000 7f2262632740 20 client.25184 trim_cache size 0 max 16384 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 Processor -- start 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 -- start start 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 0x564a43be7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43beb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a43bec070 con 0x564a43bdb4d0 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x564a43bec740 con 0x564a43bd5970 2024-04-25T02:09:31.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.513+0000 7f2262632740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564a43bece10 con 0x564a43bd6360 2024-04-25T02:09:31.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43beb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 0x564a43be7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43beb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36942/0 (socket says 172.21.15.137:36942) 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:46504/0 (socket says 172.21.15.137:46504) 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225d800640 1 -- 172.21.15.137:0/993958035 learned_addr learned my addr 172.21.15.137:0/993958035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 -- 172.21.15.137:0/993958035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 msgr2=0x564a43bd6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 -- 172.21.15.137:0/993958035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 msgr2=0x564a43beb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43beb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 -- 172.21.15.137:0/993958035 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a43bdb220 con 0x564a43bd6360 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f225ce00640 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.514+0000 7f224fe00640 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 0x564a43be7130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2248023ec0 tx=0x7f2248009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e14742b915c1adb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f224d600640 1 -- 172.21.15.137:0/993958035 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248027070 con 0x564a43bd6360 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f224d600640 1 -- 172.21.15.137:0/993958035 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2248003cf0 con 0x564a43bd6360 2024-04-25T02:09:31.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f224d600640 1 -- 172.21.15.137:0/993958035 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248019560 con 0x564a43bd6360 2024-04-25T02:09:31.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 -- 172.21.15.137:0/993958035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 msgr2=0x564a43be7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 0x564a43be7130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2248023ec0 tx=0x7f2248009ad0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 -- 172.21.15.137:0/993958035 shutdown_connections 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bdb4d0 0x564a43beb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bd6360 0x564a43be7130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 --2- 172.21.15.137:0/993958035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd5970 0x564a43bd6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 -- 172.21.15.137:0/993958035 >> 172.21.15.137:0/993958035 conn(0x564a43bd0fe0 msgr2=0x564a43bd0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 -- 172.21.15.137:0/993958035 shutdown_connections 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.515+0000 7f2262632740 1 -- 172.21.15.137:0/993958035 wait complete. 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 -- start start 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 Processor -- start 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bd9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43be56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564a43bedbb0 con 0x564a43bd5970 2024-04-25T02:09:31.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x564a43bed4e0 con 0x564a43bd6360 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564a43bee280 con 0x564a43bdb4d0 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f2262632740 10 client.0 _ll_register_callbacks cb 0x7f2240005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f225ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f224fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bd9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f225ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36948/0 (socket says 172.21.15.137:36948) 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.516+0000 7f225ce00640 1 -- 172.21.15.137:0/1564364305 learned_addr learned my addr 172.21.15.137:0/1564364305 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 -- 172.21.15.137:0/1564364305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 msgr2=0x564a43be56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f225d800640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43be56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43be56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 -- 172.21.15.137:0/1564364305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 msgr2=0x564a43bd97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 -- 172.21.15.137:0/1564364305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a43be5ce0 con 0x564a43bd6360 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f225ce00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:31.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f225d800640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43be56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f224fe00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bd9d20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564a43be0a30 tx=0x7f2248023d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64d04cc3bbb22dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2246a00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224803b060 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2248003cf0 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f2248003a00 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2248027070 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2262632740 10 client.25190 fetch_fsmap learned FSMap version 22 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.517+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564a43be6fe0 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2248003cf0 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f2248035030 con 0x564a43bd6360 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 10 client.25190 fetch_fsmap finished waiting for FSMap version 22 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 10 client.25190 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 20 client.25190 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43c569e0 0x564a43c556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 4 client.25190 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "status"}) -- 0x564a43abea40 con 0x564a43c569e0 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.518+0000 7f225ce00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43c569e0 0x564a43c556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f225ce00640 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43c569e0 0x564a43c556f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c76968f899a2b server_cookie=36d4e1c34911088e in_seq=0 out_seq=0 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2246a00640 10 client.25190 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2246a00640 1 -- 172.21.15.137:0/1564364305 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564a43abea40 con 0x564a43c569e0 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2246a00640 10 client.25190 handle_command_reply: tid=0 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 client.25190 shutdown 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 msgr2=0x564a43bd9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bd9d20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564a43be0a30 tx=0x7f2248023d90 comp rx=0 tx=0).stop 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 shutdown_connections 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x564a43c569e0 0x564a43c556f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564a43bdb4d0 0x564a43be56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564a43bd6360 0x564a43bd9d20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2246a00640 0 client.25190 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 --2- 172.21.15.137:0/1564364305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564a43bd5970 0x564a43bd97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 >> 172.21.15.137:0/1564364305 conn(0x564a43bd0fe0 msgr2=0x564a43bd0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 shutdown_connections 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.519+0000 7f2262632740 1 -- 172.21.15.137:0/1564364305 wait complete. 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f2262632740 20 client.25190 trim_cache size 0 max 16384 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "19106f5e-02a7-11ef-bc93-c7b262605968", 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 24560, 2024-04-25T02:09:31.531 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 132.12142594700001, 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 22, 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 139.71558293300001 2024-04-25T02:09:31.532 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 msgr2=0x7f22380a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 0x7f22380a5050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x564a43bd6bc0 tx=0x7f2250030ab0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 msgr2=0x7f225819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9f0 tx=0x7f224000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 shutdown_connections 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f22380a2b90 0x7f22380a5050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2258109830 0x7f22581a55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2258108e70 0x7f225819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 --2- 172.21.15.137:0/4271966530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258107c80 0x7f225819e010 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 >> 172.21.15.137:0/4271966530 conn(0x7f2258076c10 msgr2=0x7f225810c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 shutdown_connections 2024-04-25T02:09:31.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.520+0000 7f225e200640 1 -- 172.21.15.137:0/4271966530 wait complete. 2024-04-25T02:09:31.543 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T02:09:31.553 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T02:09:31.553 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T02:09:31.553 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T02:09:31.553 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-25T02:09:31.554 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:09:31.554 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:31.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-25T02:09:31.617 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:31 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/621033262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:31.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 -- 172.21.15.137:0/1569783045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 msgr2=0x7efcec104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 --2- 172.21.15.137:0/1569783045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec104e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009900 tx=0x7efcdc02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 -- 172.21.15.137:0/1569783045 shutdown_connections 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 --2- 172.21.15.137:0/1569783045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec1053b0 0x7efcec10bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 --2- 172.21.15.137:0/1569783045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec104e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 --2- 172.21.15.137:0/1569783045 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec103800 0x7efcec103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 -- 172.21.15.137:0/1569783045 >> 172.21.15.137:0/1569783045 conn(0x7efcec0fedb0 msgr2=0x7efcec1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 -- 172.21.15.137:0/1569783045 shutdown_connections 2024-04-25T02:09:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.734+0000 7efcf0a00640 1 -- 172.21.15.137:0/1569783045 wait complete. 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.735+0000 7efcf0a00640 1 Processor -- start 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 -- start start 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 0x7efcec1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10f5b0 con 0x7efcec1053b0 2024-04-25T02:09:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10f430 con 0x7efcec1049f0 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcf0a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10f730 con 0x7efcec103800 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efceb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efceb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48778/0 (socket says 172.21.15.137:48778) 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efceb400640 1 -- 172.21.15.137:0/2013206060 learned_addr learned my addr 172.21.15.137:0/2013206060 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efcebe00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 0x7efcec1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.736+0000 7efce3e00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 -- 172.21.15.137:0/2013206060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 msgr2=0x7efcec19a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec19a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 -- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 msgr2=0x7efcec1a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 0x7efcec1a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 -- 172.21.15.137:0/2013206060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec1a17b0 con 0x7efcec103800 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efcebe00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 0x7efcec1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efceb400640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efcd400e9c0 tx=0x7efcd400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd400cd80 con 0x7efcec103800 2024-04-25T02:09:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efcd40035f0 con 0x7efcec103800 2024-04-25T02:09:31.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcec1a1aa0 con 0x7efcec103800 2024-04-25T02:09:31.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4010690 con 0x7efcec103800 2024-04-25T02:09:31.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.737+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcec1a1fc0 con 0x7efcec103800 2024-04-25T02:09:31.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.738+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcec04fd50 con 0x7efcec103800 2024-04-25T02:09:31.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.740+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7efcd40037a0 con 0x7efcec103800 2024-04-25T02:09:31.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.741+0000 7efce8c00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 0x7efccc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:31.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.742+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7efcd40cf5a0 con 0x7efcec103800 2024-04-25T02:09:31.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.742+0000 7efce3e00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 0x7efccc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:31.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.742+0000 7efce3e00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 0x7efccc0a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcdc006010 tx=0x7efcdc031640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:31.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.746+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7efcd409c4b0 con 0x7efcec103800 2024-04-25T02:09:31.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:31 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/621033262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:31.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:31 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/621033262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:32.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:31.997+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7efcec062340 con 0x7efcec103800 2024-04-25T02:09:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.600+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7efcd4098420 con 0x7efcec103800 2024-04-25T02:09:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.601+0000 7efce8c00640 1 -- 172.21.15.137:0/2013206060 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7efcd405d9d0 con 0x7efcec103800 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 msgr2=0x7efccc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 0x7efccc0a5040 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcdc006010 tx=0x7efcdc031640 comp rx=0 tx=0).stop 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 msgr2=0x7efcec199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efcd400e9c0 tx=0x7efcd400ee80 comp rx=0 tx=0).stop 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 shutdown_connections 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7efccc0a2b80 0x7efccc0a5040 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcec1053b0 0x7efcec1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcec1049f0 0x7efcec19a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 --2- 172.21.15.137:0/2013206060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efcec103800 0x7efcec199b90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 >> 172.21.15.137:0/2013206060 conn(0x7efcec0fedb0 msgr2=0x7efcec107c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:32.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 shutdown_connections 2024-04-25T02:09:32.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.607+0000 7efcf0a00640 1 -- 172.21.15.137:0/2013206060 wait complete. 2024-04-25T02:09:32.638 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-25T02:09:32.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2652047562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 msgr2=0x7f9aac1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2652047562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac1019f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009900 tx=0x7f9a9c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2652047562 shutdown_connections 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2652047562 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac103180 0x7f9aac109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2652047562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac1027c0 0x7f9aac102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2652047562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac1019f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2652047562 >> 172.21.15.137:0/2652047562 conn(0x7f9aac0fcb40 msgr2=0x7f9aac0fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2652047562 shutdown_connections 2024-04-25T02:09:32.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.813+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2652047562 wait complete. 2024-04-25T02:09:32.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.814+0000 7f9ab1e00640 1 Processor -- start 2024-04-25T02:09:32.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.814+0000 7f9ab1e00640 1 -- start start 2024-04-25T02:09:32.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:32.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:32.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 0x7f9aac1a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10d3d0 con 0x7f9aac1015d0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10d250 con 0x7f9aac103180 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac10d550 con 0x7f9aac1027c0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab0a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48810/0 (socket says 172.21.15.137:48810) 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 -- 172.21.15.137:0/2780446711 learned_addr learned my addr 172.21.15.137:0/2780446711 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1400640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 0x7f9aac1a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 msgr2=0x7f9aac1a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 0x7f9aac1a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 msgr2=0x7f9aac199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9aa3e00640 1 -- 172.21.15.137:0/2780446711 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac1a17f0 con 0x7f9aac1027c0 2024-04-25T02:09:32.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.815+0000 7f9ab1400640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 0x7f9aac1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9aa3e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400e9f0 tx=0x7f9a9400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400cd80 con 0x7f9aac1027c0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a94010930 con 0x7f9aac1027c0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94018b00 con 0x7f9aac1027c0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac1a1ae0 con 0x7f9aac1027c0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.816+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac1a1fe0 con 0x7f9aac1027c0 2024-04-25T02:09:32.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.818+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac1a2210 con 0x7f9aac1027c0 2024-04-25T02:09:32.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.819+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f9a94018ca0 con 0x7f9aac1027c0 2024-04-25T02:09:32.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.821+0000 7f9aaa000640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 0x7f9a900a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:32.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.821+0000 7f9ab0a00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 msgr2=0x7f9a900a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:32.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.821+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f9a940cf4b0 con 0x7f9aac1027c0 2024-04-25T02:09:32.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.821+0000 7f9ab0a00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 0x7f9a900a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:32.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:32.825+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9a9409bd70 con 0x7f9aac1027c0 2024-04-25T02:09:32.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2013206060' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-mon[32577]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: ignoring --setuser ceph since I am not root 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: ignoring --setgroup ceph since I am not root 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-mgr[34009]: -- 172.21.15.163:0/2188609205 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d98660c5a0 con 0x55d9865e0c00 2024-04-25T02:09:32.893 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:32.764+0000 7f301f251200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:09:32.918 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2013206060' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.918 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.919 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-mon[28303]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:32.919 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setuser ceph since I am not root 2024-04-25T02:09:32.919 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: ignoring --setgroup ceph since I am not root 2024-04-25T02:09:32.919 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:32.911+0000 7f5c0e0ff200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: ignoring --setuser ceph since I am not root 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: ignoring --setgroup ceph since I am not root 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-mgr[34982]: -- 172.21.15.174:0/3990403624 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe08a725a0 con 0x55fe08a46800 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:32.766+0000 7f237bd99200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2013206060' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-25T02:09:32.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-mon[33171]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-04-25T02:09:33.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.022+0000 7f9ab0a00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 msgr2=0x7f9a900a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:33.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.022+0000 7f9ab0a00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 0x7f9a900a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:33.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.026+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f9aac1a23e0 con 0x7f9aac1027c0 2024-04-25T02:09:33.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.034+0000 7f9aaa000640 1 -- 172.21.15.137:0/2780446711 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f9a940a0070 con 0x7f9aac1027c0 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.036+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 msgr2=0x7f9a900a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.036+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 0x7f9a900a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.036+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 msgr2=0x7f9aac19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.036+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400e9f0 tx=0x7f9a9400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 shutdown_connections 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f9a900a2bd0 0x7f9a900a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9aac103180 0x7f9aac1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9aac1027c0 0x7f9aac19a110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 --2- 172.21.15.137:0/2780446711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9aac1015d0 0x7f9aac199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 >> 172.21.15.137:0/2780446711 conn(0x7f9aac0fcb40 msgr2=0x7f9aac073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:33.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 shutdown_connections 2024-04-25T02:09:33.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.037+0000 7f9ab1e00640 1 -- 172.21.15.137:0/2780446711 wait complete. 2024-04-25T02:09:33.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 -- 172.21.15.137:0/2160289619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 msgr2=0x7fae381019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 --2- 172.21.15.137:0/2160289619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae381019f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fae28009900 tx=0x7fae2802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 -- 172.21.15.137:0/2160289619 shutdown_connections 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 --2- 172.21.15.137:0/2160289619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae38103180 0x7fae38109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 --2- 172.21.15.137:0/2160289619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae381027c0 0x7fae38102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 --2- 172.21.15.137:0/2160289619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae381019f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 -- 172.21.15.137:0/2160289619 >> 172.21.15.137:0/2160289619 conn(0x7fae380fcb40 msgr2=0x7fae380fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:33.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 -- 172.21.15.137:0/2160289619 shutdown_connections 2024-04-25T02:09:33.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.236+0000 7fae37200640 1 -- 172.21.15.137:0/2160289619 wait complete. 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 Processor -- start 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 -- start start 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae381027c0 0x7fae3819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 0x7fae381a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810d3d0 con 0x7fae381027c0 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810d250 con 0x7fae38103180 2024-04-25T02:09:33.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae37200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fae3810d550 con 0x7fae381015d0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae35e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.237+0000 7fae35e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48826/0 (socket says 172.21.15.137:48826) 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 -- 172.21.15.137:0/188699251 learned_addr learned my addr 172.21.15.137:0/188699251 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae36800640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 0x7fae381a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35400640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae381027c0 0x7fae3819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 msgr2=0x7fae381a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 0x7fae381a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae381027c0 msgr2=0x7fae3819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae381027c0 0x7fae3819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 -- 172.21.15.137:0/188699251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae381a17f0 con 0x7fae381015d0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae36800640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 0x7fae381a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.238+0000 7fae35e00640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae280316a0 tx=0x7fae28032d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.239+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2803f030 con 0x7fae381015d0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.239+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae28003d00 con 0x7fae381015d0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.239+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae381a1a80 con 0x7fae381015d0 2024-04-25T02:09:33.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.239+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28035070 con 0x7fae381015d0 2024-04-25T02:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.239+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae381a1fc0 con 0x7fae381015d0 2024-04-25T02:09:33.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.240+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae381a2190 con 0x7fae381015d0 2024-04-25T02:09:33.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.243+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7fae28042030 con 0x7fae381015d0 2024-04-25T02:09:33.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.245+0000 7fae2ea00640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 0x7fae1c0a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:33.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.245+0000 7fae35400640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 msgr2=0x7fae1c0a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:33.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.245+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7fae280ef8b0 con 0x7fae381015d0 2024-04-25T02:09:33.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.245+0000 7fae35400640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 0x7fae1c0a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:33.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.245+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fae280bc170 con 0x7fae381015d0 2024-04-25T02:09:33.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:33.160+0000 7f5c0e0ff200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:33.366 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:32.949+0000 7f237bd99200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:33.367 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:33.051+0000 7f237bd99200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:09:33.370 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:32.949+0000 7f301f251200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:33.370 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:33.051+0000 7f301f251200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:09:33.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.442+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fae381a2360 con 0x7fae381015d0 2024-04-25T02:09:33.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.446+0000 7fae35400640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 msgr2=0x7fae1c0a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:33.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.446+0000 7fae35400640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 0x7fae1c0a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:33.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.449+0000 7fae2ea00640 1 -- 172.21.15.137:0/188699251 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7fae280c0470 con 0x7fae381015d0 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.451+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 msgr2=0x7fae1c0a5110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.451+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 0x7fae1c0a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 msgr2=0x7fae38199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae280316a0 tx=0x7fae28032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 shutdown_connections 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7fae1c0a2c50 0x7fae1c0a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fae38103180 0x7fae381a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae381027c0 0x7fae3819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 --2- 172.21.15.137:0/188699251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fae381015d0 0x7fae38199bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 >> 172.21.15.137:0/188699251 conn(0x7fae380fcb40 msgr2=0x7fae38073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:33.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 shutdown_connections 2024-04-25T02:09:33.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:33.452+0000 7fae37200640 1 -- 172.21.15.137:0/188699251 wait complete. 2024-04-25T02:09:33.476 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T02:09:33.500 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T02:09:33.501 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T02:09:33.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:33.501 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-25T02:09:33.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:33.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-25T02:09:33.619 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:33.359+0000 7f237bd99200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:09:33.619 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:33.444+0000 7f237bd99200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:09:33.620 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:33.297+0000 7f5c0e0ff200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:09:33.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T02:09:33.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-mon[32577]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-04-25T02:09:33.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' 2024-04-25T02:09:33.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' 2024-04-25T02:09:33.643 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:33.363+0000 7f301f251200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:09:33.643 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:33.450+0000 7f301f251200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:09:33.660 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-25T02:09:33.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:09:33.663 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-04-25T02:09:33.663 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:09:33.663 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:33.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T02:09:33.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T02:09:33.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-mon[33171]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-04-25T02:09:33.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' 2024-04-25T02:09:33.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:33 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' 2024-04-25T02:09:34.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-25T02:09:34.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-mon[28303]: mgrmap e19: x(active, since 10m), standbys: y, z 2024-04-25T02:09:34.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' 2024-04-25T02:09:34.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' 2024-04-25T02:09:34.034 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:33.709+0000 7f5c0e0ff200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:09:34.034 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:33.828+0000 7f5c0e0ff200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:09:34.131 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:09:34.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:34.624+0000 7f237bd99200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:09:34.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:34.794+0000 7f237bd99200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:34.987 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:34.635+0000 7f301f251200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:09:34.987 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:34.807+0000 7f301f251200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:35.258 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:34.965+0000 7f237bd99200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:09:35.278 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:34.980+0000 7f301f251200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:09:35.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:35.493+0000 7f5c0e0ff200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:09:35.558 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:35.251+0000 7f237bd99200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:09:35.558 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:35.343+0000 7f237bd99200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:09:35.580 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:35.271+0000 7f301f251200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:09:35.580 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:35.363+0000 7f301f251200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:09:35.892 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:35.573+0000 7f301f251200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:09:35.892 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:35.767+0000 7f301f251200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:35.914 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:35.729+0000 7f5c0e0ff200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:35.927 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:35.551+0000 7f237bd99200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:09:35.928 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:35.744+0000 7f237bd99200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 -- 172.21.15.137:0/2130763173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf01082b0 msgr2=0x7f3bf0108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 --2- 172.21.15.137:0/2130763173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf01082b0 0x7f3bf0108690 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009990 tx=0x7f3be0009ca0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 -- 172.21.15.137:0/2130763173 shutdown_connections 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 --2- 172.21.15.137:0/2130763173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf010f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 --2- 172.21.15.137:0/2130763173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf01082b0 0x7f3bf0108690 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 --2- 172.21.15.137:0/2130763173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf0069f40 0x7f3bf006a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 -- 172.21.15.137:0/2130763173 >> 172.21.15.137:0/2130763173 conn(0x7f3bf00780e0 msgr2=0x7f3bf00784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 -- 172.21.15.137:0/2130763173 shutdown_connections 2024-04-25T02:09:36.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.061+0000 7f3bf5000700 1 -- 172.21.15.137:0/2130763173 wait complete. 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 Processor -- start 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 -- start start 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0069f40 0x7f3bf01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 0x7f3bf019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf01126a0 con 0x7f3bf0069f40 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0112520 con 0x7f3bf01082b0 2024-04-25T02:09:36.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bf5000700 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0112820 con 0x7f3bf006a8e0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bed400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bee800700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 0x7f3bf019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bed400700 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48850/0 (socket says 172.21.15.137:48850) 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bede00700 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0069f40 0x7f3bf01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.063+0000 7f3bed400700 1 -- 172.21.15.137:0/3865592285 learned_addr learned my addr 172.21.15.137:0/3865592285 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 msgr2=0x7f3bf019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 0x7f3bf019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0069f40 msgr2=0x7f3bf01a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0069f40 0x7f3bf01a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 -- 172.21.15.137:0/3865592285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf019b250 con 0x7f3bf006a8e0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bee800700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 0x7f3bf019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3bed400700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9a0 tx=0x7f3bdc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00ca10 con 0x7f3bf006a8e0 2024-04-25T02:09:36.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bdc00cbb0 con 0x7f3bf006a8e0 2024-04-25T02:09:36.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.064+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc018710 con 0x7f3bf006a8e0 2024-04-25T02:09:36.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.065+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf019b540 con 0x7f3bf006a8e0 2024-04-25T02:09:36.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.065+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf01a7800 con 0x7f3bf006a8e0 2024-04-25T02:09:36.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.066+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf0103960 con 0x7f3bf006a8e0 2024-04-25T02:09:36.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.069+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f3bdc01f020 con 0x7f3bf006a8e0 2024-04-25T02:09:36.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.070+0000 7f3be6a00700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 0x7f3bd40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:36.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.070+0000 7f3bede00700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 msgr2=0x7f3bd40a51b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:36.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.070+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f3bdc0cf840 con 0x7f3bf006a8e0 2024-04-25T02:09:36.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.071+0000 7f3bede00700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 0x7f3bd40a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:36.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.072+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f3bdc026070 con 0x7f3bf006a8e0 2024-04-25T02:09:36.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.272+0000 7f3bede00700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 msgr2=0x7f3bd40a51b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:36.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.272+0000 7f3bede00700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 0x7f3bd40a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:36.279 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:35.963+0000 7f5c0e0ff200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:09:36.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.341+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3bf0068f20 con 0x7f3bf006a8e0 2024-04-25T02:09:36.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.342+0000 7f3be6a00700 1 -- 172.21.15.137:0/3865592285 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f3bf0068f20 con 0x7f3bf006a8e0 2024-04-25T02:09:36.349 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 msgr2=0x7f3bd40a51b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 0x7f3bd40a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 msgr2=0x7f3bf01a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9a0 tx=0x7f3bdc00ecb0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 shutdown_connections 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f3bd40a2cf0 0x7f3bd40a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf01082b0 0x7f3bf019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3bf0069f40 0x7f3bf01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 --2- 172.21.15.137:0/3865592285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3bf006a8e0 0x7f3bf01a0e70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 >> 172.21.15.137:0/3865592285 conn(0x7f3bf00780e0 msgr2=0x7f3bf010d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:36.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 shutdown_connections 2024-04-25T02:09:36.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:36.345+0000 7f3bf5000700 1 -- 172.21.15.137:0/3865592285 wait complete. 2024-04-25T02:09:36.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:36 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3865592285' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:09:36.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:36.357+0000 7f5c0e0ff200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:09:36.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:36.487+0000 7f5c0e0ff200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:09:36.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:36 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3865592285' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:09:36.642 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:36.370+0000 7f301f251200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:09:36.678 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:36.343+0000 7f237bd99200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:09:36.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:36 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3865592285' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T02:09:37.017 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:36.752+0000 7f5c0e0ff200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:09:37.067 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:36.765+0000 7f237bd99200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:09:37.067 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:36.862+0000 7f237bd99200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:09:37.100 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:36.796+0000 7f301f251200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:09:37.100 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:36.893+0000 7f301f251200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:09:37.109 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:09:37.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:09:37.110 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:09:37.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.110 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-25T02:09:37.161 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:09:37.161 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:09:37.161 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:09:37.162 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:09:37.163 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T02:09:37.163 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42011sec preferred_lft 42011sec 2024-04-25T02:09:37.163 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-25T02:09:37.163 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:09:37.163 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:09:37.163 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:37.163 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-25T02:09:37.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:09:37.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-04-25T02:09:37.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-04-25T02:09:37.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:09:37.164 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-25T02:09:37.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:37.281 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:37.010+0000 7f5c0e0ff200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:09:37.392 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:37.093+0000 7f301f251200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:09:37.427 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:37.059+0000 7f237bd99200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:09:37.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:37.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.627 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:09:37.687 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-25T02:09:37.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:37.690 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-25T02:09:37.743 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-25T02:09:37.743 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:09:37.743 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:09:37.743 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:09:37.743 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:09:37.744 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-25T02:09:37.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:37.892 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:37.622+0000 7f301f251200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:09:37.892 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:37.715+0000 7f301f251200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:09:37.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:37.587+0000 7f237bd99200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:09:37.926 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:37.679+0000 7f237bd99200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:09:38.115 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:37.852+0000 7f5c0e0ff200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T02:09:38.178 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:37.919+0000 7f237bd99200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:09:38.178 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:38.052+0000 7f237bd99200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:09:38.178 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:38.146+0000 7f237bd99200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:09:38.308 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:37.957+0000 7f301f251200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:09:38.308 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:38.090+0000 7f301f251200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:09:38.308 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:38.185+0000 7f301f251200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:09:38.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:38.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:38.440 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-25T02:09:38.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:38.486 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-25T02:09:38.576 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:38.576 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-25T02:09:38.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:09:38.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:09:38.576 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-25T02:09:38.642 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:38.301+0000 7f301f251200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:38.642 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:38.393+0000 7f301f251200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:09:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:38.677 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:38.261+0000 7f237bd99200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:38.678 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:38.351+0000 7f237bd99200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:09:38.695 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:38.432+0000 7f5c0e0ff200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:09:38.695 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:38.569+0000 7f5c0e0ff200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:09:38.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:38.749 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:09:38.749 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:38.749 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-25T02:09:38.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:09:38.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:09:38.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:09:38.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:09:38.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:09:38.750 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-25T02:09:38.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:38.947 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:38.853+0000 7f5c0e0ff200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:09:39.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:39.026 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:09:39.026 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-25T02:09:39.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-25T02:09:39.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:09:39.026 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-25T02:09:39.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:39.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:39.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:09:39.223 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:39.261 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:09:39.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:09:39.261 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:39.347 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-25T02:09:39.348 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-25T02:09:39.348 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963 2024-04-25T02:09:39.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:39.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-25T02:09:39.428 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:39.165+0000 7f237bd99200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:09:39.428 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z[34942]: 2024-04-25T02:09:39.379+0000 7f237bd99200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:09:39.500 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-25T02:09:39.500 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-04-25T02:09:39.500 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-04-25T02:09:39.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: Standby manager daemon z restarted 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: Standby manager daemon z started 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: Standby manager daemon y restarted 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: Standby manager daemon y started 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:09:39.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-mon[28303]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:39.642 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:39.211+0000 7f301f251200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y[34005]: 2024-04-25T02:09:39.427+0000 7f301f251200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: Standby manager daemon z restarted 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: Standby manager daemon z started 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: Standby manager daemon y restarted 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: Standby manager daemon y started 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:09:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:39 smithi163 ceph-mon[32577]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:39.927 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:39.560+0000 7f5c0e0ff200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:09:39.927 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:39.690+0000 7f5c0e0ff200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: Standby manager daemon z restarted 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: Standby manager daemon z started 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-25T02:09:39.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.174:0/1431659479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: Standby manager daemon y restarted 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: Standby manager daemon y started 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-25T02:09:39.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:39 smithi174 ceph-mon[33171]: from='mgr.? 172.21.15.163:0/4277422106' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:invalid new device string format 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:6789,172.21.15.163:6789,172.21.15.174:6789" 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.137:6789,172.21.15.163:6789,172.21.15.174:6789:/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963 2024-04-25T02:09:40.245 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=19106f5e-02a7-11ef-bc93-c7b262605968" will pass to kernel 2024-04-25T02:09:40.249 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T02:09:40.249 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-25T02:09:40.250 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T02:09:40.250 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T02:09:40.250 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T02:09:40.254 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T02:09:40.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:40.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:40.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:40.020+0000 7f5c0e0ff200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:09:40.283 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:40.202+0000 7f5c0e0ff200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T02:09:40.329 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:09:40.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:09:40.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:40.491 INFO:teuthology.orchestra.run.smithi137.stdout:client15147 2024-04-25T02:09:40.492 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:09:40.492 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:09:40.537 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:09:40.634 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-mon[28303]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T02:09:40.634 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:40.336+0000 7f5c0e0ff200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:09:40.635 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:40.497+0000 7f5c0e0ff200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:09:40.635 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:40.626+0000 7f5c0e0ff200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:09:40.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:09:40.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:40.691 INFO:teuthology.orchestra.run.smithi137.stdout:client15147 2024-04-25T02:09:40.691 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T02:09:40.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T02:09:40.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:40.806 INFO:teuthology.orchestra.run.smithi137.stdout:client15147 2024-04-25T02:09:40.806 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/19106f5e-02a7-11ef-bc93-c7b262605968.client15147/status') 2024-04-25T02:09:40.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:40 smithi163 ceph-mon[32577]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T02:09:40.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:09:40.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:40 smithi174 ceph-mon[33171]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-04-25T02:09:40.935 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.15147 (3)192.168.0.1:0/74167992 2024-04-25T02:09:40.935 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-04-25T02:09:40.936 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-04-25T02:09:40.936 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-04-25T02:09:40.936 INFO:teuthology.orchestra.run.smithi137.stderr:68 bytes copied, 7.5915e-05 s, 896 kB/s 2024-04-25T02:09:40.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:09:40.947 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:09:40.957 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:09:40.957 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:40.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 -- 172.21.15.137:0/250053488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641015d0 msgr2=0x7f76641019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 --2- 172.21.15.137:0/250053488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641015d0 0x7f76641019f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7654009900 tx=0x7f765402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 -- 172.21.15.137:0/250053488 shutdown_connections 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 --2- 172.21.15.137:0/250053488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7664103180 0x7f7664109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 --2- 172.21.15.137:0/250053488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f76641027c0 0x7f7664102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 --2- 172.21.15.137:0/250053488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641015d0 0x7f76641019f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 -- 172.21.15.137:0/250053488 >> 172.21.15.137:0/250053488 conn(0x7f76640fcb40 msgr2=0x7f76640fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:41.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 -- 172.21.15.137:0/250053488 shutdown_connections 2024-04-25T02:09:41.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.127+0000 7f7663200640 1 -- 172.21.15.137:0/250053488 wait complete. 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.128+0000 7f7663200640 1 Processor -- start 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.128+0000 7f7663200640 1 -- start start 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.128+0000 7f7663200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76641015d0 0x7f7664199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.128+0000 7f7663200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.128+0000 7f7663200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7664103180 0x7f76641a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7663200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f766410d370 con 0x7f76641027c0 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7663200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f766410d1f0 con 0x7f76641015d0 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7663200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f766410d4f0 con 0x7f7664103180 2024-04-25T02:09:41.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40892/0 (socket says 172.21.15.137:40892) 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 -- 172.21.15.137:0/1166862489 learned_addr learned my addr 172.21.15.137:0/1166862489 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7662800640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7664103180 0x7f76641a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661e00640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76641015d0 0x7f7664199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7664103180 msgr2=0x7f76641a1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7664103180 0x7f76641a1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76641015d0 msgr2=0x7f7664199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76641015d0 0x7f7664199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.129+0000 7f7661400640 1 -- 172.21.15.137:0/1166862489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76641a17e0 con 0x7f76641027c0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f7661400640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9f0 tx=0x7f765000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000cd80 con 0x7f76641027c0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7650010930 con 0x7f76641027c0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76641a1ad0 con 0x7f76641027c0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650018b00 con 0x7f76641027c0 2024-04-25T02:09:41.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.130+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76641a2020 con 0x7f76641027c0 2024-04-25T02:09:41.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.131+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76641a21f0 con 0x7f76641027c0 2024-04-25T02:09:41.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.134+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 20) ==== 137851+0+0 (secure 0 0 0) 0x7f7650018ca0 con 0x7f76641027c0 2024-04-25T02:09:41.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.135+0000 7f765aa00640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 0x7f76480a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.135+0000 7f7661e00640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 msgr2=0x7f76480a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:41.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.135+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f76500cf760 con 0x7f76641027c0 2024-04-25T02:09:41.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.135+0000 7f7661e00640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 0x7f76480a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:41.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.142+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f765009c020 con 0x7f76641027c0 2024-04-25T02:09:41.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.336+0000 7f7661e00640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 msgr2=0x7f76480a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:41.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.336+0000 7f7661e00640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 0x7f76480a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:41.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.381+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f76641a25e0 con 0x7f76641027c0 2024-04-25T02:09:41.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.460+0000 7f765aa00640 1 -- 172.21.15.137:0/1166862489 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f76500a0320 con 0x7f76641027c0 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.462+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 msgr2=0x7f76480a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.462+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 0x7f76480a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.462+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 msgr2=0x7f766419a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.462+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f765000e9f0 tx=0x7f765000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 shutdown_connections 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f76480a2bd0 0x7f76480a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7664103180 0x7f76641a1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76641027c0 0x7f766419a100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 --2- 172.21.15.137:0/1166862489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76641015d0 0x7f7664199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 >> 172.21.15.137:0/1166862489 conn(0x7f76640fcb40 msgr2=0x7f7664073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 shutdown_connections 2024-04-25T02:09:41.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.463+0000 7f7663200640 1 -- 172.21.15.137:0/1166862489 wait complete. 2024-04-25T02:09:41.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 -- 172.21.15.137:0/1354498641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d8101890 msgr2=0x7f13d8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 --2- 172.21.15.137:0/1354498641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d8101890 0x7f13d8101d10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009860 tx=0x7f13c402a340 comp rx=0 tx=0).stop 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 -- 172.21.15.137:0/1354498641 shutdown_connections 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 --2- 172.21.15.137:0/1354498641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8102250 0x7f13d8108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 --2- 172.21.15.137:0/1354498641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d8101890 0x7f13d8101d10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 --2- 172.21.15.137:0/1354498641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d81006a0 0x7f13d8100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.673+0000 7f13e0200640 1 -- 172.21.15.137:0/1354498641 >> 172.21.15.137:0/1354498641 conn(0x7f13d80fbc30 msgr2=0x7f13d80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:41.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.674+0000 7f13e0200640 1 -- 172.21.15.137:0/1354498641 shutdown_connections 2024-04-25T02:09:41.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.674+0000 7f13e0200640 1 -- 172.21.15.137:0/1354498641 wait complete. 2024-04-25T02:09:41.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 Processor -- start 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 -- start start 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 0x7f13d8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8101890 0x7f13d819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 0x7f13d81a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13d810d560 con 0x7f13d8102250 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f13d810d3e0 con 0x7f13d8101890 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13e0200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13d810d6e0 con 0x7f13d81006a0 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13de200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 0x7f13d81a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13dd800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 0x7f13d8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13dce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8101890 0x7f13d819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.675+0000 7f13de200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 0x7f13d81a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40910/0 (socket says 172.21.15.137:40910) 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 0x7f13d8199cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36772/0 (socket says 172.21.15.137:36772) 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13de200640 1 -- 172.21.15.137:0/1051164099 learned_addr learned my addr 172.21.15.137:0/1051164099 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:41.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8101890 msgr2=0x7f13d819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8101890 0x7f13d819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 msgr2=0x7f13d81a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 0x7f13d81a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d81a18f0 con 0x7f13d81006a0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dce00640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13d8101890 0x7f13d819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13de200640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d8102250 0x7f13d81a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13dd800640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 0x7f13d8199cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13d81016f0 tx=0x7f13cc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.676+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc01b070 con 0x7f13d81006a0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.677+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d81a1be0 con 0x7f13d81006a0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.677+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc003b80 con 0x7f13d81006a0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.677+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc016a00 con 0x7f13d81006a0 2024-04-25T02:09:41.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.677+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d81a2100 con 0x7f13d81006a0 2024-04-25T02:09:41.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.678+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d81a22d0 con 0x7f13d81006a0 2024-04-25T02:09:41.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.680+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 137851+0+0 (secure 0 0 0) 0x7f13cc01e070 con 0x7f13d81006a0 2024-04-25T02:09:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.681+0000 7f13d6000640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 0x7f13c00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.681+0000 7f13dce00640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 msgr2=0x7f13c00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.681+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8211+0+0 (secure 0 0 0) 0x7f13cc0ceef0 con 0x7f13d81006a0 2024-04-25T02:09:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.681+0000 7f13dce00640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 0x7f13c00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:09:41.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.686+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f13cc09b7b0 con 0x7f13d81006a0 2024-04-25T02:09:41.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:41 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T02:09:41.783 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:41.681+0000 7f5c0e0ff200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:09:41.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.882+0000 7f13dce00640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 msgr2=0x7f13c00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.137:6800/205966009 2024-04-25T02:09:41.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.882+0000 7f13dce00640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 0x7f13c00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:09:41.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:41 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T02:09:41.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.915+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f13d810abc0 con 0x7f13c00a2c80 2024-04-25T02:09:41.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:41 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-25T02:09:42.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.996+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f13cc097e20 con 0x7f13d81006a0 2024-04-25T02:09:42.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.998+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 msgr2=0x7f13c00a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:09:42.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:41.998+0000 7f13d6000640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/205966009,v1:172.21.15.137:6801/205966009] conn(0x7f13c00a2c80 0x7f13c00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:42.263 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:41.974+0000 7f5c0e0ff200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: Active manager daemon x restarted 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: Activating manager daemon x 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: mgrmap e21: x(active, starting, since 0.0239869s), standbys: y, z 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:09:42.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:09:42.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.297+0000 7f5b64600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.297+0000 7f5b64600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.297+0000 7f5b64600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.297+0000 7f5b64600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.297+0000 7f5b64600700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.298+0000 7f5b60000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.298+0000 7f5b60000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.298+0000 7f5b60000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.298+0000 7f5b60000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:42.298+0000 7f5b60000700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:09:42.536 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: Manager daemon x is now available 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.537 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:42.538 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:42 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: Active manager daemon x restarted 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: Activating manager daemon x 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:09:42.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: mgrmap e21: x(active, starting, since 0.0239869s), standbys: y, z 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:09:42.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:09:42.895 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: Manager daemon x is now available 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:42.896 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:42 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1166862489' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-25T02:09:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:09:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: Active manager daemon x restarted 2024-04-25T02:09:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: Activating manager daemon x 2024-04-25T02:09:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: osdmap e88: 12 total, 12 up, 12 in 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: mgrmap e21: x(active, starting, since 0.0239869s), standbys: y, z 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:09:42.929 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-25T02:09:42.930 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: Manager daemon x is now available 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:42.931 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:42 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-25T02:09:43.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.004+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f13cc0cca20 con 0x7f13d81006a0 2024-04-25T02:09:43.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.005+0000 7f13d6000640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13c00518c0 0x7f13c0051ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.005+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f13cc005a20 con 0x7f13c00518c0 2024-04-25T02:09:43.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.015+0000 7f13dce00640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13c00518c0 0x7f13c0051ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.023+0000 7f13dce00640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13c00518c0 0x7f13c0051ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13c402a930 tx=0x7f13c40305c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:43.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.042+0000 7f13d6000640 1 -- 172.21.15.137:0/1051164099 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f13cc005a20 con 0x7f13c00518c0 2024-04-25T02:09:43.050 INFO:teuthology.orchestra.run.smithi137.stdout:{} 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13c00518c0 msgr2=0x7f13c0051ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13c00518c0 0x7f13c0051ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f13c402a930 tx=0x7f13c40305c0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 msgr2=0x7f13d8199cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 --2- 172.21.15.137:0/1051164099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13d81006a0 0x7f13d8199cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13d81016f0 tx=0x7f13cc00c800 comp rx=0 tx=0).stop 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13de200640 1 -- 172.21.15.137:0/1051164099 reap_dead start 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 shutdown_connections 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 >> 172.21.15.137:0/1051164099 conn(0x7f13d80fbc30 msgr2=0x7f13d81094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 shutdown_connections 2024-04-25T02:09:43.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.045+0000 7f13e0200640 1 -- 172.21.15.137:0/1051164099 wait complete. 2024-04-25T02:09:43.071 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T02:09:43.083 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-25T02:09:43.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:43.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 -- 172.21.15.137:0/1911451210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0109620 msgr2=0x7f5cc010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 --2- 172.21.15.137:0/1911451210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0109620 0x7f5cc010bac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009ca0 tx=0x7f5cb802a950 comp rx=0 tx=0).stop 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 -- 172.21.15.137:0/1911451210 shutdown_connections 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 --2- 172.21.15.137:0/1911451210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0109620 0x7f5cc010bac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 --2- 172.21.15.137:0/1911451210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0074140 0x7f5cc00745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 --2- 172.21.15.137:0/1911451210 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc0073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 -- 172.21.15.137:0/1911451210 >> 172.21.15.137:0/1911451210 conn(0x7f5cc00fcd40 msgr2=0x7f5cc00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 -- 172.21.15.137:0/1911451210 shutdown_connections 2024-04-25T02:09:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.298+0000 7f5cc8600640 1 -- 172.21.15.137:0/1911451210 wait complete. 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.299+0000 7f5cc8600640 1 Processor -- start 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.299+0000 7f5cc8600640 1 -- start start 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.299+0000 7f5cc8600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.299+0000 7f5cc8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc8600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0109620 0x7f5cc01a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010f740 con 0x7f5cc0075720 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc8600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010f5c0 con 0x7f5cc0074140 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc8600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc010f8c0 con 0x7f5cc0109620 2024-04-25T02:09:43.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58442/0 (socket says 172.21.15.137:58442) 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 -- 172.21.15.137:0/3894808651 learned_addr learned my addr 172.21.15.137:0/3894808651 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5200640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc6600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0109620 0x7f5cc01a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 -- 172.21.15.137:0/3894808651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0109620 msgr2=0x7f5cc01a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0109620 0x7f5cc01a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 -- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 msgr2=0x7f5cc019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 -- 172.21.15.137:0/3894808651 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc01a1950 con 0x7f5cc0074140 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5200640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.300+0000 7f5cc5c00640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400e9f0 tx=0x7f5cb400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.301+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb400cd80 con 0x7f5cc0074140 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.301+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc01a1c40 con 0x7f5cc0074140 2024-04-25T02:09:43.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.301+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cb4010930 con 0x7f5cc0074140 2024-04-25T02:09:43.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.301+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4018b00 con 0x7f5cc0074140 2024-04-25T02:09:43.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.301+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc01a2190 con 0x7f5cc0074140 2024-04-25T02:09:43.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.302+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc01083e0 con 0x7f5cc0074140 2024-04-25T02:09:43.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.304+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f5cb4018ca0 con 0x7f5cc0074140 2024-04-25T02:09:43.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.305+0000 7f5cbe000640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 0x7f5ca80a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.305+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5cb40cf190 con 0x7f5cc0074140 2024-04-25T02:09:43.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.305+0000 7f5cc5200640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 0x7f5ca80a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.306+0000 7f5cc5200640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 0x7f5ca80a4ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009c20 tx=0x7f5cac005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:43.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.309+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f5cb409c2f0 con 0x7f5cc0074140 2024-04-25T02:09:43.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.511+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cc00623e0 con 0x7f5cc0074140 2024-04-25T02:09:43.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.514+0000 7f5cbe000640 1 -- 172.21.15.137:0/3894808651 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23059 (secure 0 0 0) 0x7f5cb409bbf0 con 0x7f5cc0074140 2024-04-25T02:09:43.522 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:43.522 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":88,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:09:41.978106+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:43.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 msgr2=0x7f5ca80a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 0x7f5ca80a4ed0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009c20 tx=0x7f5cac005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:43.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 msgr2=0x7f5cc0199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400e9f0 tx=0x7f5cb400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 shutdown_connections 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5ca80a2a10 0x7f5ca80a4ed0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5cc0109620 0x7f5cc01a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5cc0075720 0x7f5cc019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 --2- 172.21.15.137:0/3894808651 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5cc0074140 0x7f5cc0199d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 >> 172.21.15.137:0/3894808651 conn(0x7f5cc00fcd40 msgr2=0x7f5cc01055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 shutdown_connections 2024-04-25T02:09:43.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.516+0000 7f5cc8600640 1 -- 172.21.15.137:0/3894808651 wait complete. 2024-04-25T02:09:43.535 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:43.033+0000 7f5b5ce00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:43.535 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:43.033+0000 7f5b5ce00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:43.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:43.033+0000 7f5b5ce00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:43.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:43.033+0000 7f5b5ce00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:43.536 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:09:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:09:43.033+0000 7f5b5ce00700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:09:43.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:43.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.725+0000 7f2a0b000640 1 -- 172.21.15.137:0/180989526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 msgr2=0x7f2a04076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.725+0000 7f2a0b000640 1 --2- 172.21.15.137:0/180989526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a04076520 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f29f4009900 tx=0x7f29f402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 -- 172.21.15.137:0/180989526 shutdown_connections 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 --2- 172.21.15.137:0/180989526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077ce0 0x7f2a04078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 --2- 172.21.15.137:0/180989526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077340 0x7f2a040777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 --2- 172.21.15.137:0/180989526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a04076520 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 -- 172.21.15.137:0/180989526 >> 172.21.15.137:0/180989526 conn(0x7f2a040fef30 msgr2=0x7f2a04101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 -- 172.21.15.137:0/180989526 shutdown_connections 2024-04-25T02:09:43.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.726+0000 7f2a0b000640 1 -- 172.21.15.137:0/180989526 wait complete. 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 Processor -- start 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 -- start start 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a0419e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 0x7f2a041a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04113bb0 con 0x7f2a04076100 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04113a30 con 0x7f2a04077340 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.727+0000 7f2a0b000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04113d30 con 0x7f2a04077ce0 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a03400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a0419e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a03400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58462/0 (socket says 172.21.15.137:58462) 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a03400640 1 -- 172.21.15.137:0/3379117942 learned_addr learned my addr 172.21.15.137:0/3379117942 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 0x7f2a041a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 -- 172.21.15.137:0/3379117942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 msgr2=0x7f2a0419e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 -- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 msgr2=0x7f2a0419e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a0419e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 -- 172.21.15.137:0/3379117942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a041a5de0 con 0x7f2a04077ce0 2024-04-25T02:09:43.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a03400640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.728+0000 7f2a09000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 0x7f2a041a5770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00ec50 tx=0x7f29fc00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.729+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003b70 con 0x7f2a04077ce0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.729+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29fc003d10 con 0x7f2a04077ce0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.729+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc010920 con 0x7f2a04077ce0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.729+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a041a60d0 con 0x7f2a04077ce0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.729+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a041a6620 con 0x7f2a04077ce0 2024-04-25T02:09:43.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.730+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a04110330 con 0x7f2a04077ce0 2024-04-25T02:09:43.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.732+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f29fc004020 con 0x7f2a04077ce0 2024-04-25T02:09:43.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.733+0000 7f2a00c00640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 0x7f29e80a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:43.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.734+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f29fc0cf220 con 0x7f2a04077ce0 2024-04-25T02:09:43.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.734+0000 7f2a03e00640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 0x7f29e80a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:43.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.734+0000 7f2a03e00640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 0x7f29e80a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005ab0 tx=0x7f29f4005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:43.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.737+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f29fc09c340 con 0x7f2a04077ce0 2024-04-25T02:09:43.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.958+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a04062340 con 0x7f2a04077ce0 2024-04-25T02:09:43.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.959+0000 7f2a00c00640 1 -- 172.21.15.137:0/3379117942 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f29fc09bc40 con 0x7f2a04077ce0 2024-04-25T02:09:43.967 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:09:43.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 msgr2=0x7f29e80a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 0x7f29e80a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005ab0 tx=0x7f29f4005a20 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 msgr2=0x7f2a041a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 0x7f2a041a5770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00ec50 tx=0x7f29fc00c6a0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 shutdown_connections 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29e80a2a10 0x7f29e80a4ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a04077ce0 0x7f2a041a5770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a04077340 0x7f2a0419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 --2- 172.21.15.137:0/3379117942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a04076100 0x7f2a0419e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 >> 172.21.15.137:0/3379117942 conn(0x7f2a040fef30 msgr2=0x7f2a04102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 shutdown_connections 2024-04-25T02:09:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:43.962+0000 7f2a0b000640 1 -- 172.21.15.137:0/3379117942 wait complete. 2024-04-25T02:09:43.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:44.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 -- 172.21.15.137:0/3026581847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc102200 msgr2=0x7fd2dc1045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/3026581847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc102200 0x7fd2dc1045f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009900 tx=0x7fd2d002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 -- 172.21.15.137:0/3026581847 shutdown_connections 2024-04-25T02:09:44.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/3026581847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc107460 0x7fd2dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/3026581847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc104b30 0x7fd2dc106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/3026581847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc102200 0x7fd2dc1045f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 -- 172.21.15.137:0/3026581847 >> 172.21.15.137:0/3026581847 conn(0x7fd2dc0fbbf0 msgr2=0x7fd2dc0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:44.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 -- 172.21.15.137:0/3026581847 shutdown_connections 2024-04-25T02:09:44.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.169+0000 7fd2e3c00640 1 -- 172.21.15.137:0/3026581847 wait complete. 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.170+0000 7fd2e3c00640 1 Processor -- start 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.170+0000 7fd2e3c00640 1 -- start start 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.170+0000 7fd2e3c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 0x7fd2dc199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e3c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e3c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc107460 0x7fd2dc1a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e3c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc10d580 con 0x7fd2dc107460 2024-04-25T02:09:44.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e3c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc10d400 con 0x7fd2dc104b30 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e3c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2dc10d700 con 0x7fd2dc102200 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2dbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2dbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58512/0 (socket says 172.21.15.137:58512) 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2dbe00640 1 -- 172.21.15.137:0/2353686183 learned_addr learned my addr 172.21.15.137:0/2353686183 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 0x7fd2dc199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc107460 0x7fd2dc1a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 -- 172.21.15.137:0/2353686183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 msgr2=0x7fd2dc19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 -- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc107460 msgr2=0x7fd2dc1a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc107460 0x7fd2dc1a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2e1200640 1 -- 172.21.15.137:0/2353686183 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc1a19f0 con 0x7fd2dc102200 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.171+0000 7fd2dbe00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2e1200640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 0x7fd2dc199dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002a910 tx=0x7fd2d0032d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:44.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d003f030 con 0x7fd2dc102200 2024-04-25T02:09:44.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2d0003d00 con 0x7fd2dc102200 2024-04-25T02:09:44.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2dc1a1c80 con 0x7fd2dc102200 2024-04-25T02:09:44.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0035070 con 0x7fd2dc102200 2024-04-25T02:09:44.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.172+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2dc1a2140 con 0x7fd2dc102200 2024-04-25T02:09:44.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.174+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2dc108fb0 con 0x7fd2dc102200 2024-04-25T02:09:44.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.175+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fd2d0042030 con 0x7fd2dc102200 2024-04-25T02:09:44.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.176+0000 7fd2d9600640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 0x7fd2c40a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.177+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd2d00ef120 con 0x7fd2dc102200 2024-04-25T02:09:44.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.177+0000 7fd2dbe00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 0x7fd2c40a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.177+0000 7fd2dbe00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 0x7fd2c40a4e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc19b2e0 tx=0x7fd2c800b410 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:44.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.180+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fd2d00bbbf0 con 0x7fd2dc102200 2024-04-25T02:09:44.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.229+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7fd2d00b8260 con 0x7fd2dc102200 2024-04-25T02:09:44.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: mgrmap e22: x(active, since 1.02456s), standbys: y, z 2024-04-25T02:09:44.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: [25/Apr/2024:02:09:43] ENGINE Bus STARTING 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: [25/Apr/2024:02:09:43] ENGINE Serving on https://172.21.15.137:7150 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: [25/Apr/2024:02:09:43] ENGINE Serving on http://172.21.15.137:8765 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: [25/Apr/2024:02:09:43] ENGINE Bus STARTED 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3894808651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:44.284 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:44 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3379117942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:44.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.381+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2dc02d170 con 0x7fd2dc102200 2024-04-25T02:09:44.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.382+0000 7fd2d9600640 1 -- 172.21.15.137:0/2353686183 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fd2d0071030 con 0x7fd2dc102200 2024-04-25T02:09:44.390 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:09:44.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 msgr2=0x7fd2c40a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 0x7fd2c40a4e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc19b2e0 tx=0x7fd2c800b410 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 msgr2=0x7fd2dc199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 0x7fd2dc199dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002a910 tx=0x7fd2d0032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 shutdown_connections 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd2c40a2990 0x7fd2c40a4e50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2dc107460 0x7fd2dc1a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2dc104b30 0x7fd2dc19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 --2- 172.21.15.137:0/2353686183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2dc102200 0x7fd2dc199dd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.384+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 >> 172.21.15.137:0/2353686183 conn(0x7fd2dc0fbbf0 msgr2=0x7fd2dc1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.385+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 shutdown_connections 2024-04-25T02:09:44.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.385+0000 7fd2e3c00640 1 -- 172.21.15.137:0/2353686183 wait complete. 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: mgrmap e22: x(active, since 1.02456s), standbys: y, z 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: [25/Apr/2024:02:09:43] ENGINE Bus STARTING 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: [25/Apr/2024:02:09:43] ENGINE Serving on https://172.21.15.137:7150 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: [25/Apr/2024:02:09:43] ENGINE Serving on http://172.21.15.137:8765 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: [25/Apr/2024:02:09:43] ENGINE Bus STARTED 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3894808651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:44.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:44 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3379117942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:44.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: mgrmap e22: x(active, since 1.02456s), standbys: y, z 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: [25/Apr/2024:02:09:43] ENGINE Bus STARTING 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: from='client.25285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: [25/Apr/2024:02:09:43] ENGINE Serving on https://172.21.15.137:7150 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: [25/Apr/2024:02:09:43] ENGINE Serving on http://172.21.15.137:8765 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: [25/Apr/2024:02:09:43] ENGINE Bus STARTED 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3894808651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:44.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:44 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3379117942' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:44.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 -- 172.21.15.137:0/840256178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 msgr2=0x7f99b80745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 --2- 172.21.15.137:0/840256178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b80745a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009900 tx=0x7f99a402a480 comp rx=0 tx=0).stop 2024-04-25T02:09:44.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 -- 172.21.15.137:0/840256178 shutdown_connections 2024-04-25T02:09:44.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 --2- 172.21.15.137:0/840256178 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8109620 0x7f99b810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 --2- 172.21.15.137:0/840256178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b80745a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 --2- 172.21.15.137:0/840256178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8075720 0x7f99b8073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 -- 172.21.15.137:0/840256178 >> 172.21.15.137:0/840256178 conn(0x7f99b80fcd20 msgr2=0x7f99b80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:44.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 -- 172.21.15.137:0/840256178 shutdown_connections 2024-04-25T02:09:44.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.598+0000 7f99c0000640 1 -- 172.21.15.137:0/840256178 wait complete. 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 Processor -- start 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 -- start start 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 0x7f99b819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 0x7f99b81a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99b810f790 con 0x7f99b8075720 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f99b810f610 con 0x7f99b8109620 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.599+0000 7f99c0000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99b810f910 con 0x7f99b8074140 2024-04-25T02:09:44.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36974/0 (socket says 172.21.15.137:36974) 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 -- 172.21.15.137:0/1301446919 learned_addr learned my addr 172.21.15.137:0/1301446919 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bcc00640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 0x7f99b819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99be000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 0x7f99b81a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 -- 172.21.15.137:0/1301446919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 msgr2=0x7f99b81a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 0x7f99b81a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 -- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 msgr2=0x7f99b819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 0x7f99b819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 -- 172.21.15.137:0/1301446919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81a1960 con 0x7f99b8074140 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99be000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 0x7f99b81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bcc00640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 0x7f99b819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.600+0000 7f99bd600640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00eb90 tx=0x7f99ac00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.601+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004d20 con 0x7f99b8074140 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.601+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99ac00ee90 con 0x7f99b8074140 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.601+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0108b0 con 0x7f99b8074140 2024-04-25T02:09:44.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.601+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b81a1c50 con 0x7f99b8074140 2024-04-25T02:09:44.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.601+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b81a2120 con 0x7f99b8074140 2024-04-25T02:09:44.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.602+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b81083e0 con 0x7f99b8074140 2024-04-25T02:09:44.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.604+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7f99ac005020 con 0x7f99b8074140 2024-04-25T02:09:44.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.605+0000 7f99b6000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 0x7f99a00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:44.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.605+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f99ac0cfd50 con 0x7f99b8074140 2024-04-25T02:09:44.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.605+0000 7f99bcc00640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 0x7f99a00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:44.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.606+0000 7f99bcc00640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 0x7f99a00a52d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006010 tx=0x7f99a4031640 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.609+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f99ac09c7d0 con 0x7f99b8074140 2024-04-25T02:09:44.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.813+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99b802d400 con 0x7f99b8074140 2024-04-25T02:09:44.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.814+0000 7f99b6000640 1 -- 172.21.15.137:0/1301446919 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f99ac09c0d0 con 0x7f99b8074140 2024-04-25T02:09:44.822 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.816+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 msgr2=0x7f99a00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 0x7f99a00a52d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006010 tx=0x7f99a4031640 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 msgr2=0x7f99b8199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00eb90 tx=0x7f99ac00c6a0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 shutdown_connections 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f99a00a2e10 0x7f99a00a52d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99b8109620 0x7f99b81a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99b8075720 0x7f99b819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 --2- 172.21.15.137:0/1301446919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b8074140 0x7f99b8199d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:44.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 >> 172.21.15.137:0/1301446919 conn(0x7f99b80fcd20 msgr2=0x7f99b81055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:44.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 shutdown_connections 2024-04-25T02:09:44.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:44.817+0000 7f99c0000640 1 -- 172.21.15.137:0/1301446919 wait complete. 2024-04-25T02:09:44.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 -- 172.21.15.137:0/1780272128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc103340 msgr2=0x7f88cc109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 --2- 172.21.15.137:0/1780272128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc103340 0x7f88cc109bd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009ca0 tx=0x7f88c402a8c0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 -- 172.21.15.137:0/1780272128 shutdown_connections 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 --2- 172.21.15.137:0/1780272128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc103340 0x7f88cc109bd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 --2- 172.21.15.137:0/1780272128 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc102980 0x7f88cc102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 --2- 172.21.15.137:0/1780272128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 -- 172.21.15.137:0/1780272128 >> 172.21.15.137:0/1780272128 conn(0x7f88cc0fcd20 msgr2=0x7f88cc0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:45.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 -- 172.21.15.137:0/1780272128 shutdown_connections 2024-04-25T02:09:45.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.029+0000 7f88d2600640 1 -- 172.21.15.137:0/1780272128 wait complete. 2024-04-25T02:09:45.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 Processor -- start 2024-04-25T02:09:45.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 -- start start 2024-04-25T02:09:45.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc0754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 0x7f88cc073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 0x7f88cc074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10d530 con 0x7f88cc101790 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10d3b0 con 0x7f88cc103340 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88d2600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10d6b0 con 0x7f88cc102980 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.031+0000 7f88cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc0754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc0754f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41142/0 (socket says 172.21.15.137:41142) 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 0x7f88cc073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88cb400640 1 -- 172.21.15.137:0/3399552908 learned_addr learned my addr 172.21.15.137:0/3399552908 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88cbe00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 0x7f88cc074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 -- 172.21.15.137:0/3399552908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 msgr2=0x7f88cc074070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 0x7f88cc074070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 -- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 msgr2=0x7f88cc0754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc0754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 -- 172.21.15.137:0/3399552908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc074900 con 0x7f88cc102980 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88cbe00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 0x7f88cc074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:45.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c3e00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 0x7f88cc073b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88b400e9f0 tx=0x7f88b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.032+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b400ccc0 con 0x7f88cc102980 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.033+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc1a1c00 con 0x7f88cc102980 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.033+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88b4010930 con 0x7f88cc102980 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.033+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b40189f0 con 0x7f88cc102980 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.033+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc1a21a0 con 0x7f88cc102980 2024-04-25T02:09:45.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.034+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc1089e0 con 0x7f88cc102980 2024-04-25T02:09:45.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.036+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7f88b4010ae0 con 0x7f88cc102980 2024-04-25T02:09:45.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.037+0000 7f88c8c00640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 0x7f88b00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.038+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f88b40cfb20 con 0x7f88cc102980 2024-04-25T02:09:45.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.038+0000 7f88cb400640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 0x7f88b00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.038+0000 7f88cb400640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 0x7f88b00a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0058c0 tx=0x7f88bc005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.044+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f88b409bf50 con 0x7f88cc102980 2024-04-25T02:09:45.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.262+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88cc02d340 con 0x7f88cc102980 2024-04-25T02:09:45.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.265+0000 7f88c8c00640 1 -- 172.21.15.137:0/3399552908 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23059 (secure 0 0 0) 0x7f88b40a0250 con 0x7f88cc102980 2024-04-25T02:09:45.273 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:45.273 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":88,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:09:41.978106+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 msgr2=0x7f88b00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 0x7f88b00a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0058c0 tx=0x7f88bc005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 msgr2=0x7f88cc073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 0x7f88cc073b30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88b400e9f0 tx=0x7f88b400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 shutdown_connections 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f88b00a2e10 0x7f88b00a52d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f88cc103340 0x7f88cc074070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88cc102980 0x7f88cc073b30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 --2- 172.21.15.137:0/3399552908 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88cc101790 0x7f88cc0754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 >> 172.21.15.137:0/3399552908 conn(0x7f88cc0fcd20 msgr2=0x7f88cc105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:45.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 shutdown_connections 2024-04-25T02:09:45.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.268+0000 7f88d2600640 1 -- 172.21.15.137:0/3399552908 wait complete. 2024-04-25T02:09:45.294 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:45.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:45.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:45.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.355 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.356 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T02:09:45.356 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2353686183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.356 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:45 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1301446919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:45.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T02:09:45.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2353686183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:45 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1301446919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2353686183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:45 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1301446919' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 -- 172.21.15.137:0/905796428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40077ce0 msgr2=0x7f6a40078580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 --2- 172.21.15.137:0/905796428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40077ce0 0x7f6a40078580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009ca0 tx=0x7f6a3802a8c0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 -- 172.21.15.137:0/905796428 shutdown_connections 2024-04-25T02:09:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 --2- 172.21.15.137:0/905796428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40077ce0 0x7f6a40078580 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 --2- 172.21.15.137:0/905796428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077340 0x7f6a400777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 --2- 172.21.15.137:0/905796428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40076100 0x7f6a40076520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 -- 172.21.15.137:0/905796428 >> 172.21.15.137:0/905796428 conn(0x7f6a400fef30 msgr2=0x7f6a40101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:45.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 -- 172.21.15.137:0/905796428 shutdown_connections 2024-04-25T02:09:45.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.484+0000 7f6a44a00640 1 -- 172.21.15.137:0/905796428 wait complete. 2024-04-25T02:09:45.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.485+0000 7f6a44a00640 1 Processor -- start 2024-04-25T02:09:45.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.485+0000 7f6a44a00640 1 -- start start 2024-04-25T02:09:45.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 0x7f6a4019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40077340 0x7f6a4019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 0x7f6a401a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113b90 con 0x7f6a40076100 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113a10 con 0x7f6a40077340 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a44a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113d10 con 0x7f6a40077ce0 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 0x7f6a4019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3de00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 0x7f6a4019e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41172/0 (socket says 172.21.15.137:41172) 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3de00640 1 -- 172.21.15.137:0/2145724924 learned_addr learned my addr 172.21.15.137:0/2145724924 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3e800640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 0x7f6a401a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a35400640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40077340 0x7f6a4019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3e800640 1 -- 172.21.15.137:0/2145724924 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40077340 msgr2=0x7f6a4019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.486+0000 7f6a3e800640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40077340 0x7f6a4019e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a3e800640 1 -- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 msgr2=0x7f6a4019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a3e800640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 0x7f6a4019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a3e800640 1 -- 172.21.15.137:0/2145724924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a401a5d20 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a3e800640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 0x7f6a401a56b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a38031ae0 tx=0x7f6a38031750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38003b70 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a38003d10 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a401a5fb0 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.487+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3802fb80 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.488+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401a6470 con 0x7f6a40077ce0 2024-04-25T02:09:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.489+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40110310 con 0x7f6a40077ce0 2024-04-25T02:09:45.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.492+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7f6a380046d0 con 0x7f6a40077ce0 2024-04-25T02:09:45.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.493+0000 7f6a37400640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 0x7f6a200a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.493+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f6a380f07a0 con 0x7f6a40077ce0 2024-04-25T02:09:45.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.493+0000 7f6a3de00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 0x7f6a200a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.494+0000 7f6a3de00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 0x7f6a200a5250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009c90 tx=0x7f6a30005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.497+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f6a380bd390 con 0x7f6a40077ce0 2024-04-25T02:09:45.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.707+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a4002d370 con 0x7f6a40077ce0 2024-04-25T02:09:45.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.708+0000 7f6a37400640 1 -- 172.21.15.137:0/2145724924 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f6a380bcc90 con 0x7f6a40077ce0 2024-04-25T02:09:45.716 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.710+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 msgr2=0x7f6a200a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.710+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 0x7f6a200a5250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009c90 tx=0x7f6a30005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.710+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 msgr2=0x7f6a401a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.710+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 0x7f6a401a56b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a38031ae0 tx=0x7f6a38031750 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 shutdown_connections 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6a200a2d90 0x7f6a200a5250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a40077ce0 0x7f6a401a56b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a40077340 0x7f6a4019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 --2- 172.21.15.137:0/2145724924 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a40076100 0x7f6a4019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 >> 172.21.15.137:0/2145724924 conn(0x7f6a400fef30 msgr2=0x7f6a40100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 shutdown_connections 2024-04-25T02:09:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.711+0000 7f6a44a00640 1 -- 172.21.15.137:0/2145724924 wait complete. 2024-04-25T02:09:45.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:45.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 -- 172.21.15.137:0/1782553273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 msgr2=0x7fc24c105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 --2- 172.21.15.137:0/1782553273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c105030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc238009860 tx=0x7fc23802a340 comp rx=0 tx=0).stop 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 -- 172.21.15.137:0/1782553273 shutdown_connections 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 --2- 172.21.15.137:0/1782553273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 0x7fc24c10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 --2- 172.21.15.137:0/1782553273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c105030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 --2- 172.21.15.137:0/1782553273 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 -- 172.21.15.137:0/1782553273 >> 172.21.15.137:0/1782553273 conn(0x7fc24c0fef30 msgr2=0x7fc24c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 -- 172.21.15.137:0/1782553273 shutdown_connections 2024-04-25T02:09:45.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.917+0000 7fc253200640 1 -- 172.21.15.137:0/1782553273 wait complete. 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 Processor -- start 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 -- start start 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 0x7fc24c1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c10f770 con 0x7fc24c1039c0 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c10f5f0 con 0x7fc24c105570 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc253200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c10f8f0 con 0x7fc24c104bb0 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc24be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc24be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41194/0 (socket says 172.21.15.137:41194) 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc24be00640 1 -- 172.21.15.137:0/1280977257 learned_addr learned my addr 172.21.15.137:0/1280977257 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc24b400640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.919+0000 7fc251200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 0x7fc24c1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 -- 172.21.15.137:0/1280977257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 msgr2=0x7fc24c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 -- 172.21.15.137:0/1280977257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 msgr2=0x7fc24c1a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 0x7fc24c1a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 -- 172.21.15.137:0/1280977257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c1a19b0 con 0x7fc24c1039c0 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24b400640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:45.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.920+0000 7fc24be00640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00e9f0 tx=0x7fc23c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.921+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ccc0 con 0x7fc24c1039c0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.921+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c1a1ca0 con 0x7fc24c1039c0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.921+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc23c0035f0 con 0x7fc24c1039c0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.921+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00ce60 con 0x7fc24c1039c0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.921+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c1a2190 con 0x7fc24c1039c0 2024-04-25T02:09:45.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.922+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c10ace0 con 0x7fc24c1039c0 2024-04-25T02:09:45.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.924+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7fc23c0037a0 con 0x7fc24c1039c0 2024-04-25T02:09:45.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.925+0000 7fc248c00640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 0x7fc2300a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:45.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.926+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc23c0cf890 con 0x7fc24c1039c0 2024-04-25T02:09:45.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.926+0000 7fc24b400640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 0x7fc2300a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:45.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.927+0000 7fc24b400640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 0x7fc2300a52d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc23802a930 tx=0x7fc2380305c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:45.931+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc23c09c310 con 0x7fc24c1039c0 2024-04-25T02:09:46.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.143+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc24c02d3e0 con 0x7fc24c1039c0 2024-04-25T02:09:46.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.144+0000 7fc248c00640 1 -- 172.21.15.137:0/1280977257 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fc23c09bc10 con 0x7fc24c1039c0 2024-04-25T02:09:46.152 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:09:46.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 msgr2=0x7fc2300a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 0x7fc2300a52d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc23802a930 tx=0x7fc2380305c0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 msgr2=0x7fc24c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00e9f0 tx=0x7fc23c00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 shutdown_connections 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc2300a2e10 0x7fc2300a52d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc24c105570 0x7fc24c1a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc24c104bb0 0x7fc24c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 --2- 172.21.15.137:0/1280977257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc24c1039c0 0x7fc24c199da0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 >> 172.21.15.137:0/1280977257 conn(0x7fc24c0fef30 msgr2=0x7fc24c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 shutdown_connections 2024-04-25T02:09:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.146+0000 7fc253200640 1 -- 172.21.15.137:0/1280977257 wait complete. 2024-04-25T02:09:46.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:46.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 -- 172.21.15.137:0/2826077589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28102980 msgr2=0x7f1b28102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 --2- 172.21.15.137:0/2826077589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28102980 0x7f1b28102e00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009860 tx=0x7f1b1002a340 comp rx=0 tx=0).stop 2024-04-25T02:09:46.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 -- 172.21.15.137:0/2826077589 shutdown_connections 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 --2- 172.21.15.137:0/2826077589 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28103340 0x7f1b28109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 --2- 172.21.15.137:0/2826077589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28102980 0x7f1b28102e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 --2- 172.21.15.137:0/2826077589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28101790 0x7f1b28101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 -- 172.21.15.137:0/2826077589 >> 172.21.15.137:0/2826077589 conn(0x7f1b280fcd20 msgr2=0x7f1b280ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 -- 172.21.15.137:0/2826077589 shutdown_connections 2024-04-25T02:09:46.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.355+0000 7f1b2f200640 1 -- 172.21.15.137:0/2826077589 wait complete. 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.356+0000 7f1b2f200640 1 Processor -- start 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.356+0000 7f1b2f200640 1 -- start start 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.356+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 0x7f1b280754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28102980 0x7f1b28073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2f200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2f200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2810d540 con 0x7f1b28103340 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2f200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2810d3c0 con 0x7f1b28102980 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2f200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2810d6c0 con 0x7f1b28101790 2024-04-25T02:09:46.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41214/0 (socket says 172.21.15.137:41214) 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 -- 172.21.15.137:0/1445894398 learned_addr learned my addr 172.21.15.137:0/1445894398 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b27e00640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 0x7f1b280754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b1fe00640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28102980 0x7f1b28073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 -- 172.21.15.137:0/1445894398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 msgr2=0x7f1b280754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 0x7f1b280754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 -- 172.21.15.137:0/1445894398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28102980 msgr2=0x7f1b28073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28102980 0x7f1b28073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b2d200640 1 -- 172.21.15.137:0/1445894398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b28074900 con 0x7f1b28103340 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.357+0000 7f1b27e00640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 0x7f1b280754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b2d200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000eb10 tx=0x7f1b2000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000ce20 con 0x7f1b28103340 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b281a1cd0 con 0x7f1b28103340 2024-04-25T02:09:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b20004b20 con 0x7f1b28103340 2024-04-25T02:09:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20010760 con 0x7f1b28103340 2024-04-25T02:09:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.358+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b281a21a0 con 0x7f1b28103340 2024-04-25T02:09:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.359+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b280689b0 con 0x7f1b28103340 2024-04-25T02:09:46.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.361+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7f1b20005020 con 0x7f1b28103340 2024-04-25T02:09:46.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.363+0000 7f1b25600640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 0x7f1b0c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.363+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f1b200cfd00 con 0x7f1b28103340 2024-04-25T02:09:46.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.363+0000 7f1b27e00640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 0x7f1b0c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.364+0000 7f1b27e00640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 0x7f1b0c0a5250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b281027e0 tx=0x7f1b18009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:46.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.367+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f1b2009c780 con 0x7f1b28103340 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3399552908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2145724924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:46.394 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.395 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:46 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3399552908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:46.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2145724924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.430 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:46 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3399552908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2145724924' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:46 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:46.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.571+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b2802d210 con 0x7f1b28103340 2024-04-25T02:09:46.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.571+0000 7f1b25600640 1 -- 172.21.15.137:0/1445894398 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f1b2802d210 con 0x7f1b28103340 2024-04-25T02:09:46.579 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:09:46.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 msgr2=0x7f1b0c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 0x7f1b0c0a5250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b281027e0 tx=0x7f1b18009260 comp rx=0 tx=0).stop 2024-04-25T02:09:46.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 msgr2=0x7f1b28074070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000eb10 tx=0x7f1b2000ef10 comp rx=0 tx=0).stop 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 shutdown_connections 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1b0c0a2d90 0x7f1b0c0a5250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b28103340 0x7f1b28074070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b28102980 0x7f1b28073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.574+0000 7f1b2f200640 1 --2- 172.21.15.137:0/1445894398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b28101790 0x7f1b280754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.575+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 >> 172.21.15.137:0/1445894398 conn(0x7f1b280fcd20 msgr2=0x7f1b28105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.575+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 shutdown_connections 2024-04-25T02:09:46.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.575+0000 7f1b2f200640 1 -- 172.21.15.137:0/1445894398 wait complete. 2024-04-25T02:09:46.599 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-25T02:09:46.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:46.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 -- 172.21.15.137:0/360761030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c109670 msgr2=0x7ff57c10bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 --2- 172.21.15.137:0/360761030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c109670 0x7ff57c10bb00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff574009ca0 tx=0x7ff57402a8c0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 -- 172.21.15.137:0/360761030 shutdown_connections 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 --2- 172.21.15.137:0/360761030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c109670 0x7ff57c10bb00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 --2- 172.21.15.137:0/360761030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c0741a0 0x7ff57c074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 --2- 172.21.15.137:0/360761030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c075780 0x7ff57c073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 -- 172.21.15.137:0/360761030 >> 172.21.15.137:0/360761030 conn(0x7ff57c0fcd20 msgr2=0x7ff57c0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 -- 172.21.15.137:0/360761030 shutdown_connections 2024-04-25T02:09:46.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.772+0000 7ff580e00640 1 -- 172.21.15.137:0/360761030 wait complete. 2024-04-25T02:09:46.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.773+0000 7ff580e00640 1 Processor -- start 2024-04-25T02:09:46.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 -- start start 2024-04-25T02:09:46.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 0x7ff57c199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 0x7ff57c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 0x7ff57c1a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c10f7a0 con 0x7ff57c109670 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c10f620 con 0x7ff57c075780 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff580e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c10f920 con 0x7ff57c0741a0 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff57a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 0x7ff57c1a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff579e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 0x7ff57c199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff57a800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 0x7ff57c1a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41232/0 (socket says 172.21.15.137:41232) 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff573e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 0x7ff57c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.774+0000 7ff57a800640 1 -- 172.21.15.137:0/1664149756 learned_addr learned my addr 172.21.15.137:0/1664149756 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 -- 172.21.15.137:0/1664149756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 msgr2=0x7ff57c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 0x7ff57c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 -- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 msgr2=0x7ff57c1a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 0x7ff57c1a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 -- 172.21.15.137:0/1664149756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c1a1920 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff573e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 0x7ff57c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff579e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 0x7ff57c199d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00e9f0 tx=0x7ff56c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00ccc0 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff56c010930 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.775+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c1a1c10 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.776+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0189f0 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.776+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c1a2160 con 0x7ff57c0741a0 2024-04-25T02:09:46.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.777+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c1083a0 con 0x7ff57c0741a0 2024-04-25T02:09:46.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.779+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 23) ==== 138005+0+0 (secure 0 0 0) 0x7ff56c010ae0 con 0x7ff57c0741a0 2024-04-25T02:09:46.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.780+0000 7ff572a00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 0x7ff5600a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:46.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.780+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff56c0cfe30 con 0x7ff57c0741a0 2024-04-25T02:09:46.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.781+0000 7ff573e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 0x7ff5600a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:46.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.781+0000 7ff573e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 0x7ff5600a5250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff564009fc0 tx=0x7ff564005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:46.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.782+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7ff56c09c260 con 0x7ff57c0741a0 2024-04-25T02:09:46.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:46.900+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7ff56c098840 con 0x7ff57c0741a0 2024-04-25T02:09:47.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.024+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff57c02d170 con 0x7ff57c0741a0 2024-04-25T02:09:47.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.025+0000 7ff572a00640 1 -- 172.21.15.137:0/1664149756 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11884 (secure 0 0 0) 0x7ff56c028560 con 0x7ff57c0741a0 2024-04-25T02:09:47.034 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:47.034 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:09:41.384129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24559,24538]},"id":1}]} 2024-04-25T02:09:47.034 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 23 2024-04-25T02:09:47.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 msgr2=0x7ff5600a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 0x7ff5600a5250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff564009fc0 tx=0x7ff564005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 msgr2=0x7ff57c199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 0x7ff57c199d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00e9f0 tx=0x7ff56c00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 shutdown_connections 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5600a2d90 0x7ff5600a5250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff57c109670 0x7ff57c1a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff57c075780 0x7ff57c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 --2- 172.21.15.137:0/1664149756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff57c0741a0 0x7ff57c199d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.028+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 >> 172.21.15.137:0/1664149756 conn(0x7ff57c0fcd20 msgr2=0x7ff57c105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.029+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 shutdown_connections 2024-04-25T02:09:47.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.029+0000 7ff580e00640 1 -- 172.21.15.137:0/1664149756 wait complete. 2024-04-25T02:09:47.054 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-25T02:09:47.054 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-25T02:09:47.054 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:47.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 -- 172.21.15.137:0/2267637995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac100790 msgr2=0x7f72ac100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 --2- 172.21.15.137:0/2267637995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac100790 0x7f72ac100bf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7294009900 tx=0x7f729402a410 comp rx=0 tx=0).stop 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 -- 172.21.15.137:0/2267637995 shutdown_connections 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 --2- 172.21.15.137:0/2267637995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac101130 0x7f72ac1015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 --2- 172.21.15.137:0/2267637995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac100790 0x7f72ac100bf0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 --2- 172.21.15.137:0/2267637995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac0ffe30 0x7f72ac100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 -- 172.21.15.137:0/2267637995 >> 172.21.15.137:0/2267637995 conn(0x7f72ac0fba10 msgr2=0x7f72ac0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 -- 172.21.15.137:0/2267637995 shutdown_connections 2024-04-25T02:09:47.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.223+0000 7f72ab200640 1 -- 172.21.15.137:0/2267637995 wait complete. 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.224+0000 7f72ab200640 1 Processor -- start 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.224+0000 7f72ab200640 1 -- start start 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 0x7f72ac199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac100790 0x7f72ac19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 0x7f72ac1a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10f5d0 con 0x7f72ac101130 2024-04-25T02:09:47.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10f450 con 0x7f72ac100790 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72ab200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac10f750 con 0x7f72ac0ffe30 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72aa800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 0x7f72ac1a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 0x7f72ac199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72aa800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 0x7f72ac1a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41262/0 (socket says 172.21.15.137:41262) 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72aa800640 1 -- 172.21.15.137:0/692485098 learned_addr learned my addr 172.21.15.137:0/692485098 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a3e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac100790 0x7f72ac19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 -- 172.21.15.137:0/692485098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac100790 msgr2=0x7f72ac19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac100790 0x7f72ac19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 -- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 msgr2=0x7f72ac1a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 0x7f72ac1a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.225+0000 7f72a9e00640 1 -- 172.21.15.137:0/692485098 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac1a17c0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72a9e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 0x7f72ac199bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e9f0 tx=0x7f729c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ccc0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac1a1ab0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f729c010930 con 0x7f72ac0ffe30 2024-04-25T02:09:47.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0189f0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.226+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac1a1fd0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.227+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ac10ab80 con 0x7f72ac0ffe30 2024-04-25T02:09:47.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.229+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f729c010ae0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.230+0000 7f72a2a00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 0x7f72900a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.231+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f729c0cf9f0 con 0x7f72ac0ffe30 2024-04-25T02:09:47.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.231+0000 7f72a3e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 0x7f72900a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.231+0000 7f72a3e00640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 0x7f72900a52e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7294005ab0 tx=0x7f7294005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:47.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.235+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f729c09bd40 con 0x7f72ac0ffe30 2024-04-25T02:09:47.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:47 smithi163 ceph-mon[32577]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:47.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1280977257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1445894398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:47 smithi163 ceph-mon[32577]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T02:09:47.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:47 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1664149756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:47.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:47 smithi174 ceph-mon[33171]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:47.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1280977257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1445894398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:47 smithi174 ceph-mon[33171]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T02:09:47.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:47 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1664149756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:47.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.433+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72ac061b80 con 0x7f72900a2e20 2024-04-25T02:09:47.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.446+0000 7f72a2a00640 1 -- 172.21.15.137:0/692485098 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257758 (secure 0 0 0) 0x7f72ac061b80 con 0x7f72900a2e20 2024-04-25T02:09:47.458 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:47.460 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 msgr2=0x7f72900a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 0x7f72900a52e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7294005ab0 tx=0x7f7294005a20 comp rx=0 tx=0).stop 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 msgr2=0x7f72ac199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 0x7f72ac199bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e9f0 tx=0x7f729c00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 shutdown_connections 2024-04-25T02:09:47.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f72900a2e20 0x7f72900a52e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f72ac101130 0x7f72ac1a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72ac100790 0x7f72ac19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 --2- 172.21.15.137:0/692485098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72ac0ffe30 0x7f72ac199bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.451+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 >> 172.21.15.137:0/692485098 conn(0x7f72ac0fba10 msgr2=0x7f72ac0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.452+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 shutdown_connections 2024-04-25T02:09:47.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.452+0000 7f72ab200640 1 -- 172.21.15.137:0/692485098 wait complete. 2024-04-25T02:09:47.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:47 smithi137 ceph-mon[28303]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:47.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1280977257' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1445894398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:47.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:47 smithi137 ceph-mon[28303]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-25T02:09:47.476 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:47 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1664149756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:47.479 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-25T02:09:46.008230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187921,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1099,"num_read_kb":712,"num_write":473,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376288,"kb_used_data":14512,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565536,"statfs":{"total":1151940427776,"available":1151555108864,"internally_reserved":0,"allocated":14860288,"data_stored":8727197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.973703"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545939+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:09:42.545939+0000","last_peered":"2024-04-25T02:09:42.545939+0000","last_clean":"2024-04-25T02:09:42.545939+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:09:42.545939+0000","last_undegraded":"2024-04-25T02:09:42.545939+0000","last_fullsized":"2024-04-25T02:09:42.545939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309570+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:09:42.309570+0000","last_peered":"2024-04-25T02:09:42.309570+0000","last_clean":"2024-04-25T02:09:42.309570+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:09:42.309570+0000","last_undegraded":"2024-04-25T02:09:42.309570+0000","last_fullsized":"2024-04-25T02:09:42.309570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309599+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:09:42.309599+0000","last_peered":"2024-04-25T02:09:42.309599+0000","last_clean":"2024-04-25T02:09:42.309599+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:09:42.309599+0000","last_undegraded":"2024-04-25T02:09:42.309599+0000","last_fullsized":"2024-04-25T02:09:42.309599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991574+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:09:41.991574+0000","last_peered":"2024-04-25T02:09:41.991574+0000","last_clean":"2024-04-25T02:09:41.991574+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:09:41.991574+0000","last_undegraded":"2024-04-25T02:09:41.991574+0000","last_fullsized":"2024-04-25T02:09:41.991574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118456+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:09:42.118456+0000","last_peered":"2024-04-25T02:09:42.118456+0000","last_clean":"2024-04-25T02:09:42.118456+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:09:42.118456+0000","last_undegraded":"2024-04-25T02:09:42.118456+0000","last_fullsized":"2024-04-25T02:09:42.118456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129363+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:09:42.129363+0000","last_peered":"2024-04-25T02:09:42.129363+0000","last_clean":"2024-04-25T02:09:42.129363+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:09:42.129363+0000","last_undegraded":"2024-04-25T02:09:42.129363+0000","last_fullsized":"2024-04-25T02:09:42.129363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305802+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:09:42.305802+0000","last_peered":"2024-04-25T02:09:42.305802+0000","last_clean":"2024-04-25T02:09:42.305802+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:09:42.305802+0000","last_undegraded":"2024-04-25T02:09:42.305802+0000","last_fullsized":"2024-04-25T02:09:42.305802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118571+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:09:42.118571+0000","last_peered":"2024-04-25T02:09:42.118571+0000","last_clean":"2024-04-25T02:09:42.118571+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:09:42.118571+0000","last_undegraded":"2024-04-25T02:09:42.118571+0000","last_fullsized":"2024-04-25T02:09:42.118571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307187+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:09:42.307187+0000","last_peered":"2024-04-25T02:09:42.307187+0000","last_clean":"2024-04-25T02:09:42.307187+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:09:42.307187+0000","last_undegraded":"2024-04-25T02:09:42.307187+0000","last_fullsized":"2024-04-25T02:09:42.307187+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129671+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:09:42.129671+0000","last_peered":"2024-04-25T02:09:42.129671+0000","last_clean":"2024-04-25T02:09:42.129671+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:09:42.129671+0000","last_undegraded":"2024-04-25T02:09:42.129671+0000","last_fullsized":"2024-04-25T02:09:42.129671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306446+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:09:42.306446+0000","last_peered":"2024-04-25T02:09:42.306446+0000","last_clean":"2024-04-25T02:09:42.306446+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:09:42.306446+0000","last_undegraded":"2024-04-25T02:09:42.306446+0000","last_fullsized":"2024-04-25T02:09:42.306446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991259+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:09:41.991259+0000","last_peered":"2024-04-25T02:09:41.991259+0000","last_clean":"2024-04-25T02:09:41.991259+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:09:41.991259+0000","last_undegraded":"2024-04-25T02:09:41.991259+0000","last_fullsized":"2024-04-25T02:09:41.991259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306355+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:09:42.306355+0000","last_peered":"2024-04-25T02:09:42.306355+0000","last_clean":"2024-04-25T02:09:42.306355+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:09:42.306355+0000","last_undegraded":"2024-04-25T02:09:42.306355+0000","last_fullsized":"2024-04-25T02:09:42.306355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309378+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:09:42.309378+0000","last_peered":"2024-04-25T02:09:42.309378+0000","last_clean":"2024-04-25T02:09:42.309378+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:09:42.309378+0000","last_undegraded":"2024-04-25T02:09:42.309378+0000","last_fullsized":"2024-04-25T02:09:42.309378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309029+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:09:42.309029+0000","last_peered":"2024-04-25T02:09:42.309029+0000","last_clean":"2024-04-25T02:09:42.309029+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:09:42.309029+0000","last_undegraded":"2024-04-25T02:09:42.309029+0000","last_fullsized":"2024-04-25T02:09:42.309029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306254+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:09:42.306254+0000","last_peered":"2024-04-25T02:09:42.306254+0000","last_clean":"2024-04-25T02:09:42.306254+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:09:42.306254+0000","last_undegraded":"2024-04-25T02:09:42.306254+0000","last_fullsized":"2024-04-25T02:09:42.306254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.546025+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:09:42.546025+0000","last_peered":"2024-04-25T02:09:42.546025+0000","last_clean":"2024-04-25T02:09:42.546025+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:09:42.546025+0000","last_undegraded":"2024-04-25T02:09:42.546025+0000","last_fullsized":"2024-04-25T02:09:42.546025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990997+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:09:41.990997+0000","last_peered":"2024-04-25T02:09:41.990997+0000","last_clean":"2024-04-25T02:09:41.990997+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:09:41.990997+0000","last_undegraded":"2024-04-25T02:09:41.990997+0000","last_fullsized":"2024-04-25T02:09:41.990997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306448+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:09:42.306448+0000","last_peered":"2024-04-25T02:09:42.306448+0000","last_clean":"2024-04-25T02:09:42.306448+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:09:42.306448+0000","last_undegraded":"2024-04-25T02:09:42.306448+0000","last_fullsized":"2024-04-25T02:09:42.306448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991131+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:09:41.991131+0000","last_peered":"2024-04-25T02:09:41.991131+0000","last_clean":"2024-04-25T02:09:41.991131+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:09:41.991131+0000","last_undegraded":"2024-04-25T02:09:41.991131+0000","last_fullsized":"2024-04-25T02:09:41.991131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119983+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:09:42.119983+0000","last_peered":"2024-04-25T02:09:42.119983+0000","last_clean":"2024-04-25T02:09:42.119983+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:09:42.119983+0000","last_undegraded":"2024-04-25T02:09:42.119983+0000","last_fullsized":"2024-04-25T02:09:42.119983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119996+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:09:42.119996+0000","last_peered":"2024-04-25T02:09:42.119996+0000","last_clean":"2024-04-25T02:09:42.119996+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:09:42.119996+0000","last_undegraded":"2024-04-25T02:09:42.119996+0000","last_fullsized":"2024-04-25T02:09:42.119996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309862+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:09:42.309862+0000","last_peered":"2024-04-25T02:09:42.309862+0000","last_clean":"2024-04-25T02:09:42.309862+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:09:42.309862+0000","last_undegraded":"2024-04-25T02:09:42.309862+0000","last_fullsized":"2024-04-25T02:09:42.309862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118880+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:09:42.118880+0000","last_peered":"2024-04-25T02:09:42.118880+0000","last_clean":"2024-04-25T02:09:42.118880+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:09:42.118880+0000","last_undegraded":"2024-04-25T02:09:42.118880+0000","last_fullsized":"2024-04-25T02:09:42.118880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306809+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:09:42.306809+0000","last_peered":"2024-04-25T02:09:42.306809+0000","last_clean":"2024-04-25T02:09:42.306809+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:09:42.306809+0000","last_undegraded":"2024-04-25T02:09:42.306809+0000","last_fullsized":"2024-04-25T02:09:42.306809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118682+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:09:42.118682+0000","last_peered":"2024-04-25T02:09:42.118682+0000","last_clean":"2024-04-25T02:09:42.118682+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:09:42.118682+0000","last_undegraded":"2024-04-25T02:09:42.118682+0000","last_fullsized":"2024-04-25T02:09:42.118682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126159+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:09:42.126159+0000","last_peered":"2024-04-25T02:09:42.126159+0000","last_clean":"2024-04-25T02:09:42.126159+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:09:42.126159+0000","last_undegraded":"2024-04-25T02:09:42.126159+0000","last_fullsized":"2024-04-25T02:09:42.126159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":175,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.613924+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:09:42.613924+0000","last_peered":"2024-04-25T02:09:42.613924+0000","last_clean":"2024-04-25T02:09:42.613924+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:09:42.613924+0000","last_undegraded":"2024-04-25T02:09:42.613924+0000","last_fullsized":"2024-04-25T02:09:42.613924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1855,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118453+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:09:42.118453+0000","last_peered":"2024-04-25T02:09:42.118453+0000","last_clean":"2024-04-25T02:09:42.118453+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:09:42.118453+0000","last_undegraded":"2024-04-25T02:09:42.118453+0000","last_fullsized":"2024-04-25T02:09:42.118453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129304+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:09:42.129304+0000","last_peered":"2024-04-25T02:09:42.129304+0000","last_clean":"2024-04-25T02:09:42.129304+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:09:42.129304+0000","last_undegraded":"2024-04-25T02:09:42.129304+0000","last_fullsized":"2024-04-25T02:09:42.129304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126290+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:09:42.126290+0000","last_peered":"2024-04-25T02:09:42.126290+0000","last_clean":"2024-04-25T02:09:42.126290+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:09:42.126290+0000","last_undegraded":"2024-04-25T02:09:42.126290+0000","last_fullsized":"2024-04-25T02:09:42.126290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305884+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:09:42.305884+0000","last_peered":"2024-04-25T02:09:42.305884+0000","last_clean":"2024-04-25T02:09:42.305884+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:09:42.305884+0000","last_undegraded":"2024-04-25T02:09:42.305884+0000","last_fullsized":"2024-04-25T02:09:42.305884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990606+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:09:41.990606+0000","last_peered":"2024-04-25T02:09:41.990606+0000","last_clean":"2024-04-25T02:09:41.990606+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:09:41.990606+0000","last_undegraded":"2024-04-25T02:09:41.990606+0000","last_fullsized":"2024-04-25T02:09:41.990606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125897+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:09:42.125897+0000","last_peered":"2024-04-25T02:09:42.125897+0000","last_clean":"2024-04-25T02:09:42.125897+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:09:42.125897+0000","last_undegraded":"2024-04-25T02:09:42.125897+0000","last_fullsized":"2024-04-25T02:09:42.125897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990888+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:09:41.990888+0000","last_peered":"2024-04-25T02:09:41.990888+0000","last_clean":"2024-04-25T02:09:41.990888+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:09:41.990888+0000","last_undegraded":"2024-04-25T02:09:41.990888+0000","last_fullsized":"2024-04-25T02:09:41.990888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129680+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:09:42.129680+0000","last_peered":"2024-04-25T02:09:42.129680+0000","last_clean":"2024-04-25T02:09:42.129680+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:09:42.129680+0000","last_undegraded":"2024-04-25T02:09:42.129680+0000","last_fullsized":"2024-04-25T02:09:42.129680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306964+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:09:42.306964+0000","last_peered":"2024-04-25T02:09:42.306964+0000","last_clean":"2024-04-25T02:09:42.306964+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:09:42.306964+0000","last_undegraded":"2024-04-25T02:09:42.306964+0000","last_fullsized":"2024-04-25T02:09:42.306964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306627+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:09:42.306627+0000","last_peered":"2024-04-25T02:09:42.306627+0000","last_clean":"2024-04-25T02:09:42.306627+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:09:42.306627+0000","last_undegraded":"2024-04-25T02:09:42.306627+0000","last_fullsized":"2024-04-25T02:09:42.306627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309831+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:09:42.309831+0000","last_peered":"2024-04-25T02:09:42.309831+0000","last_clean":"2024-04-25T02:09:42.309831+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:09:42.309831+0000","last_undegraded":"2024-04-25T02:09:42.309831+0000","last_fullsized":"2024-04-25T02:09:42.309831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126381+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:09:42.126381+0000","last_peered":"2024-04-25T02:09:42.126381+0000","last_clean":"2024-04-25T02:09:42.126381+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:09:42.126381+0000","last_undegraded":"2024-04-25T02:09:42.126381+0000","last_fullsized":"2024-04-25T02:09:42.126381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307032+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:09:42.307032+0000","last_peered":"2024-04-25T02:09:42.307032+0000","last_clean":"2024-04-25T02:09:42.307032+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:09:42.307032+0000","last_undegraded":"2024-04-25T02:09:42.307032+0000","last_fullsized":"2024-04-25T02:09:42.307032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'38","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.619183+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:09:42.619183+0000","last_peered":"2024-04-25T02:09:42.619183+0000","last_clean":"2024-04-25T02:09:42.619183+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:09:42.619183+0000","last_undegraded":"2024-04-25T02:09:42.619183+0000","last_fullsized":"2024-04-25T02:09:42.619183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66737,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":211,"num_write":39,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118694+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:09:42.118694+0000","last_peered":"2024-04-25T02:09:42.118694+0000","last_clean":"2024-04-25T02:09:42.118694+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:09:42.118694+0000","last_undegraded":"2024-04-25T02:09:42.118694+0000","last_fullsized":"2024-04-25T02:09:42.118694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545625+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:09:42.545625+0000","last_peered":"2024-04-25T02:09:42.545625+0000","last_clean":"2024-04-25T02:09:42.545625+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:09:42.545625+0000","last_undegraded":"2024-04-25T02:09:42.545625+0000","last_fullsized":"2024-04-25T02:09:42.545625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306139+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:09:42.306139+0000","last_peered":"2024-04-25T02:09:42.306139+0000","last_clean":"2024-04-25T02:09:42.306139+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:09:42.306139+0000","last_undegraded":"2024-04-25T02:09:42.306139+0000","last_fullsized":"2024-04-25T02:09:42.306139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306924+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:09:42.306924+0000","last_peered":"2024-04-25T02:09:42.306924+0000","last_clean":"2024-04-25T02:09:42.306924+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:09:42.306924+0000","last_undegraded":"2024-04-25T02:09:42.306924+0000","last_fullsized":"2024-04-25T02:09:42.306924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":172,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.659652+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:09:42.659652+0000","last_peered":"2024-04-25T02:09:42.659652+0000","last_clean":"2024-04-25T02:09:42.659652+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:09:42.659652+0000","last_undegraded":"2024-04-25T02:09:42.659652+0000","last_fullsized":"2024-04-25T02:09:42.659652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305822+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:09:42.305822+0000","last_peered":"2024-04-25T02:09:42.305822+0000","last_clean":"2024-04-25T02:09:42.305822+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:09:42.305822+0000","last_undegraded":"2024-04-25T02:09:42.305822+0000","last_fullsized":"2024-04-25T02:09:42.305822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118537+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:09:42.118537+0000","last_peered":"2024-04-25T02:09:42.118537+0000","last_clean":"2024-04-25T02:09:42.118537+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:09:42.118537+0000","last_undegraded":"2024-04-25T02:09:42.118537+0000","last_fullsized":"2024-04-25T02:09:42.118537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118892+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:09:42.118892+0000","last_peered":"2024-04-25T02:09:42.118892+0000","last_clean":"2024-04-25T02:09:42.118892+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:09:42.118892+0000","last_undegraded":"2024-04-25T02:09:42.118892+0000","last_fullsized":"2024-04-25T02:09:42.118892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545886+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:09:42.545886+0000","last_peered":"2024-04-25T02:09:42.545886+0000","last_clean":"2024-04-25T02:09:42.545886+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:09:42.545886+0000","last_undegraded":"2024-04-25T02:09:42.545886+0000","last_fullsized":"2024-04-25T02:09:42.545886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991184+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:09:41.991184+0000","last_peered":"2024-04-25T02:09:41.991184+0000","last_clean":"2024-04-25T02:09:41.991184+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:09:41.991184+0000","last_undegraded":"2024-04-25T02:09:41.991184+0000","last_fullsized":"2024-04-25T02:09:41.991184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129411+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:09:42.129411+0000","last_peered":"2024-04-25T02:09:42.129411+0000","last_clean":"2024-04-25T02:09:42.129411+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:09:42.129411+0000","last_undegraded":"2024-04-25T02:09:42.129411+0000","last_fullsized":"2024-04-25T02:09:42.129411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306025+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:09:42.306025+0000","last_peered":"2024-04-25T02:09:42.306025+0000","last_clean":"2024-04-25T02:09:42.306025+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:09:42.306025+0000","last_undegraded":"2024-04-25T02:09:42.306025+0000","last_fullsized":"2024-04-25T02:09:42.306025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129377+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:09:42.129377+0000","last_peered":"2024-04-25T02:09:42.129377+0000","last_clean":"2024-04-25T02:09:42.129377+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:09:42.129377+0000","last_undegraded":"2024-04-25T02:09:42.129377+0000","last_fullsized":"2024-04-25T02:09:42.129377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126314+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:09:42.126314+0000","last_peered":"2024-04-25T02:09:42.126314+0000","last_clean":"2024-04-25T02:09:42.126314+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:09:42.126314+0000","last_undegraded":"2024-04-25T02:09:42.126314+0000","last_fullsized":"2024-04-25T02:09:42.126314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.308494+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:09:42.308494+0000","last_peered":"2024-04-25T02:09:42.308494+0000","last_clean":"2024-04-25T02:09:42.308494+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:09:42.308494+0000","last_undegraded":"2024-04-25T02:09:42.308494+0000","last_fullsized":"2024-04-25T02:09:42.308494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118910+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:09:42.118910+0000","last_peered":"2024-04-25T02:09:42.118910+0000","last_clean":"2024-04-25T02:09:42.118910+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:09:42.118910+0000","last_undegraded":"2024-04-25T02:09:42.118910+0000","last_fullsized":"2024-04-25T02:09:42.118910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991533+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:09:41.991533+0000","last_peered":"2024-04-25T02:09:41.991533+0000","last_clean":"2024-04-25T02:09:41.991533+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:09:41.991533+0000","last_undegraded":"2024-04-25T02:09:41.991533+0000","last_fullsized":"2024-04-25T02:09:41.991533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305821+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:09:42.305821+0000","last_peered":"2024-04-25T02:09:42.305821+0000","last_clean":"2024-04-25T02:09:42.305821+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:09:42.305821+0000","last_undegraded":"2024-04-25T02:09:42.305821+0000","last_fullsized":"2024-04-25T02:09:42.305821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305460+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:09:42.305460+0000","last_peered":"2024-04-25T02:09:42.305460+0000","last_clean":"2024-04-25T02:09:42.305460+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:09:42.305460+0000","last_undegraded":"2024-04-25T02:09:42.305460+0000","last_fullsized":"2024-04-25T02:09:42.305460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306016+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:09:42.306016+0000","last_peered":"2024-04-25T02:09:42.306016+0000","last_clean":"2024-04-25T02:09:42.306016+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:09:42.306016+0000","last_undegraded":"2024-04-25T02:09:42.306016+0000","last_fullsized":"2024-04-25T02:09:42.306016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118759+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:09:42.118759+0000","last_peered":"2024-04-25T02:09:42.118759+0000","last_clean":"2024-04-25T02:09:42.118759+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:09:42.118759+0000","last_undegraded":"2024-04-25T02:09:42.118759+0000","last_fullsized":"2024-04-25T02:09:42.118759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306389+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:09:42.306389+0000","last_peered":"2024-04-25T02:09:42.306389+0000","last_clean":"2024-04-25T02:09:42.306389+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:09:42.306389+0000","last_undegraded":"2024-04-25T02:09:42.306389+0000","last_fullsized":"2024-04-25T02:09:42.306389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'45","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.258362+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:09:42.258362+0000","last_peered":"2024-04-25T02:09:42.258362+0000","last_clean":"2024-04-25T02:09:42.258362+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:09:42.258362+0000","last_undegraded":"2024-04-25T02:09:42.258362+0000","last_fullsized":"2024-04-25T02:09:42.258362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119692+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:09:42.119692+0000","last_peered":"2024-04-25T02:09:42.119692+0000","last_clean":"2024-04-25T02:09:42.119692+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:09:42.119692+0000","last_undegraded":"2024-04-25T02:09:42.119692+0000","last_fullsized":"2024-04-25T02:09:42.119692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991500+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:09:41.991500+0000","last_peered":"2024-04-25T02:09:41.991500+0000","last_clean":"2024-04-25T02:09:41.991500+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:09:41.991500+0000","last_undegraded":"2024-04-25T02:09:41.991500+0000","last_fullsized":"2024-04-25T02:09:41.991500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309723+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:09:42.309723+0000","last_peered":"2024-04-25T02:09:42.309723+0000","last_clean":"2024-04-25T02:09:42.309723+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:09:42.309723+0000","last_undegraded":"2024-04-25T02:09:42.309723+0000","last_fullsized":"2024-04-25T02:09:42.309723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306365+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:09:42.306365+0000","last_peered":"2024-04-25T02:09:42.306365+0000","last_clean":"2024-04-25T02:09:42.306365+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:09:42.306365+0000","last_undegraded":"2024-04-25T02:09:42.306365+0000","last_fullsized":"2024-04-25T02:09:42.306365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118366+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:09:42.118366+0000","last_peered":"2024-04-25T02:09:42.118366+0000","last_clean":"2024-04-25T02:09:42.118366+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:09:42.118366+0000","last_undegraded":"2024-04-25T02:09:42.118366+0000","last_fullsized":"2024-04-25T02:09:42.118366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119418+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:09:42.119418+0000","last_peered":"2024-04-25T02:09:42.119418+0000","last_clean":"2024-04-25T02:09:42.119418+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:09:42.119418+0000","last_undegraded":"2024-04-25T02:09:42.119418+0000","last_fullsized":"2024-04-25T02:09:42.119418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545541+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:09:42.545541+0000","last_peered":"2024-04-25T02:09:42.545541+0000","last_clean":"2024-04-25T02:09:42.545541+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:09:42.545541+0000","last_undegraded":"2024-04-25T02:09:42.545541+0000","last_fullsized":"2024-04-25T02:09:42.545541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306171+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:09:42.306171+0000","last_peered":"2024-04-25T02:09:42.306171+0000","last_clean":"2024-04-25T02:09:42.306171+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:09:42.306171+0000","last_undegraded":"2024-04-25T02:09:42.306171+0000","last_fullsized":"2024-04-25T02:09:42.306171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119204+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:09:42.119204+0000","last_peered":"2024-04-25T02:09:42.119204+0000","last_clean":"2024-04-25T02:09:42.119204+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:09:42.119204+0000","last_undegraded":"2024-04-25T02:09:42.119204+0000","last_fullsized":"2024-04-25T02:09:42.119204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118605+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:09:42.118605+0000","last_peered":"2024-04-25T02:09:42.118605+0000","last_clean":"2024-04-25T02:09:42.118605+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:09:42.118605+0000","last_undegraded":"2024-04-25T02:09:42.118605+0000","last_fullsized":"2024-04-25T02:09:42.118605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306148+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:09:42.306148+0000","last_peered":"2024-04-25T02:09:42.306148+0000","last_clean":"2024-04-25T02:09:42.306148+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:09:42.306148+0000","last_undegraded":"2024-04-25T02:09:42.306148+0000","last_fullsized":"2024-04-25T02:09:42.306148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306554+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:09:42.306554+0000","last_peered":"2024-04-25T02:09:42.306554+0000","last_clean":"2024-04-25T02:09:42.306554+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:09:42.306554+0000","last_undegraded":"2024-04-25T02:09:42.306554+0000","last_fullsized":"2024-04-25T02:09:42.306554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306541+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:09:42.306541+0000","last_peered":"2024-04-25T02:09:42.306541+0000","last_clean":"2024-04-25T02:09:42.306541+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:09:42.306541+0000","last_undegraded":"2024-04-25T02:09:42.306541+0000","last_fullsized":"2024-04-25T02:09:42.306541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.256134+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:09:42.256134+0000","last_peered":"2024-04-25T02:09:42.256134+0000","last_clean":"2024-04-25T02:09:42.256134+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:09:42.256134+0000","last_undegraded":"2024-04-25T02:09:42.256134+0000","last_fullsized":"2024-04-25T02:09:42.256134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306297+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:09:42.306297+0000","last_peered":"2024-04-25T02:09:42.306297+0000","last_clean":"2024-04-25T02:09:42.306297+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:09:42.306297+0000","last_undegraded":"2024-04-25T02:09:42.306297+0000","last_fullsized":"2024-04-25T02:09:42.306297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306490+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:09:42.306490+0000","last_peered":"2024-04-25T02:09:42.306490+0000","last_clean":"2024-04-25T02:09:42.306490+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:09:42.306490+0000","last_undegraded":"2024-04-25T02:09:42.306490+0000","last_fullsized":"2024-04-25T02:09:42.306490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306826+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:09:42.306826+0000","last_peered":"2024-04-25T02:09:42.306826+0000","last_clean":"2024-04-25T02:09:42.306826+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:09:42.306826+0000","last_undegraded":"2024-04-25T02:09:42.306826+0000","last_fullsized":"2024-04-25T02:09:42.306826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545546+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:09:42.545546+0000","last_peered":"2024-04-25T02:09:42.545546+0000","last_clean":"2024-04-25T02:09:42.545546+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:09:42.545546+0000","last_undegraded":"2024-04-25T02:09:42.545546+0000","last_fullsized":"2024-04-25T02:09:42.545546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306198+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:09:42.306198+0000","last_peered":"2024-04-25T02:09:42.306198+0000","last_clean":"2024-04-25T02:09:42.306198+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:09:42.306198+0000","last_undegraded":"2024-04-25T02:09:42.306198+0000","last_fullsized":"2024-04-25T02:09:42.306198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306140+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:09:42.306140+0000","last_peered":"2024-04-25T02:09:42.306140+0000","last_clean":"2024-04-25T02:09:42.306140+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:09:42.306140+0000","last_undegraded":"2024-04-25T02:09:42.306140+0000","last_fullsized":"2024-04-25T02:09:42.306140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309279+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:09:42.309279+0000","last_peered":"2024-04-25T02:09:42.309279+0000","last_clean":"2024-04-25T02:09:42.309279+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:09:42.309279+0000","last_undegraded":"2024-04-25T02:09:42.309279+0000","last_fullsized":"2024-04-25T02:09:42.309279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306788+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:09:42.306788+0000","last_peered":"2024-04-25T02:09:42.306788+0000","last_clean":"2024-04-25T02:09:42.306788+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:09:42.306788+0000","last_undegraded":"2024-04-25T02:09:42.306788+0000","last_fullsized":"2024-04-25T02:09:42.306788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545845+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:09:42.545845+0000","last_peered":"2024-04-25T02:09:42.545845+0000","last_clean":"2024-04-25T02:09:42.545845+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:09:42.545845+0000","last_undegraded":"2024-04-25T02:09:42.545845+0000","last_fullsized":"2024-04-25T02:09:42.545845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306516+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:09:42.306516+0000","last_peered":"2024-04-25T02:09:42.306516+0000","last_clean":"2024-04-25T02:09:42.306516+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:09:42.306516+0000","last_undegraded":"2024-04-25T02:09:42.306516+0000","last_fullsized":"2024-04-25T02:09:42.306516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119593+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:09:42.119593+0000","last_peered":"2024-04-25T02:09:42.119593+0000","last_clean":"2024-04-25T02:09:42.119593+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:09:42.119593+0000","last_undegraded":"2024-04-25T02:09:42.119593+0000","last_fullsized":"2024-04-25T02:09:42.119593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125930+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:09:42.125930+0000","last_peered":"2024-04-25T02:09:42.125930+0000","last_clean":"2024-04-25T02:09:42.125930+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:09:42.125930+0000","last_undegraded":"2024-04-25T02:09:42.125930+0000","last_fullsized":"2024-04-25T02:09:42.125930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119467+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:09:42.119467+0000","last_peered":"2024-04-25T02:09:42.119467+0000","last_clean":"2024-04-25T02:09:42.119467+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:09:42.119467+0000","last_undegraded":"2024-04-25T02:09:42.119467+0000","last_fullsized":"2024-04-25T02:09:42.119467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306576+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:09:42.306576+0000","last_peered":"2024-04-25T02:09:42.306576+0000","last_clean":"2024-04-25T02:09:42.306576+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:09:42.306576+0000","last_undegraded":"2024-04-25T02:09:42.306576+0000","last_fullsized":"2024-04-25T02:09:42.306576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306324+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:09:42.306324+0000","last_peered":"2024-04-25T02:09:42.306324+0000","last_clean":"2024-04-25T02:09:42.306324+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:09:42.306324+0000","last_undegraded":"2024-04-25T02:09:42.306324+0000","last_fullsized":"2024-04-25T02:09:42.306324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545697+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:09:42.545697+0000","last_peered":"2024-04-25T02:09:42.545697+0000","last_clean":"2024-04-25T02:09:42.545697+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:09:42.545697+0000","last_undegraded":"2024-04-25T02:09:42.545697+0000","last_fullsized":"2024-04-25T02:09:42.545697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597319,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":963,"num_read_kb":593,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1791957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383723,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":456231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645359,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1798144,"data_stored":1255865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28352,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716800,"statfs":{"total":95995035648,"available":95966003200,"internally_reserved":0,"allocated":1368064,"data_stored":858576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":455771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712440,"statfs":{"total":95995035648,"available":95961538560,"internally_reserved":0,"allocated":1568768,"data_stored":1058975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":464749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1032192,"data_stored":531279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1052672,"data_stored":533828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1507328,"data_stored":989876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920849,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":970752,"data_stored":466691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757324,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32912,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712240,"statfs":{"total":95995035648,"available":95961333760,"internally_reserved":0,"allocated":1716224,"data_stored":1189336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:47.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:47.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 -- 172.21.15.137:0/2971261483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd01039c0 msgr2=0x7f4fd0103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 --2- 172.21.15.137:0/2971261483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd01039c0 0x7f4fd0103de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009900 tx=0x7f4fc002a400 comp rx=0 tx=0).stop 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 -- 172.21.15.137:0/2971261483 shutdown_connections 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 --2- 172.21.15.137:0/2971261483 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd0105570 0x7f4fd010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 --2- 172.21.15.137:0/2971261483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd0105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 --2- 172.21.15.137:0/2971261483 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd01039c0 0x7f4fd0103de0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 -- 172.21.15.137:0/2971261483 >> 172.21.15.137:0/2971261483 conn(0x7f4fd00fef30 msgr2=0x7f4fd0101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 -- 172.21.15.137:0/2971261483 shutdown_connections 2024-04-25T02:09:47.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.703+0000 7f4fd7200640 1 -- 172.21.15.137:0/2971261483 wait complete. 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.704+0000 7f4fd7200640 1 Processor -- start 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.704+0000 7f4fd7200640 1 -- start start 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd01039c0 0x7f4fd0199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 0x7f4fd01a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010f760 con 0x7f4fd0104bb0 2024-04-25T02:09:47.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010f5e0 con 0x7f4fd0105570 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd7200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010f8e0 con 0x7f4fd01039c0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41270/0 (socket says 172.21.15.137:41270) 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 -- 172.21.15.137:0/1978028458 learned_addr learned my addr 172.21.15.137:0/1978028458 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcfe00640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd01039c0 0x7f4fd0199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd5200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 0x7f4fd01a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 -- 172.21.15.137:0/1978028458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd01039c0 msgr2=0x7f4fd0199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd01039c0 0x7f4fd0199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 -- 172.21.15.137:0/1978028458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 msgr2=0x7f4fd01a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 0x7f4fd01a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fcf400640 1 -- 172.21.15.137:0/1978028458 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd01a19d0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.705+0000 7f4fd5200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 0x7f4fd01a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fcf400640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00ea60 tx=0x7f4fbc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00cde0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fbc0035f0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc010720 con 0x7f4fd0104bb0 2024-04-25T02:09:47.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd01a1cc0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.706+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01a21c0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.707+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd010ace0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.710+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f4fbc0037a0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.711+0000 7f4fccc00640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 0x7f4fb40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:47.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.711+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4fbc0cfc50 con 0x7f4fd0104bb0 2024-04-25T02:09:47.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.711+0000 7f4fcfe00640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 0x7f4fb40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:47.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.712+0000 7f4fcfe00640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 0x7f4fb40a52e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fd019b290 tx=0x7f4fc0031640 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:47.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.715+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4fbc09c5f0 con 0x7f4fd0104bb0 2024-04-25T02:09:47.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.916+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fd0061b80 con 0x7f4fb40a2e20 2024-04-25T02:09:47.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.924+0000 7f4fccc00640 1 -- 172.21.15.137:0/1978028458 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257758 (secure 0 0 0) 0x7f4fd0061b80 con 0x7f4fb40a2e20 2024-04-25T02:09:47.936 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:47.937 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 msgr2=0x7f4fb40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 0x7f4fb40a52e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fd019b290 tx=0x7f4fc0031640 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 msgr2=0x7f4fd019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00ea60 tx=0x7f4fbc00ef20 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 shutdown_connections 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4fb40a2e20 0x7f4fb40a52e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd0105570 0x7f4fd01a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd0104bb0 0x7f4fd019a300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 --2- 172.21.15.137:0/1978028458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4fd01039c0 0x7f4fd0199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 >> 172.21.15.137:0/1978028458 conn(0x7f4fd00fef30 msgr2=0x7f4fd0107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 shutdown_connections 2024-04-25T02:09:47.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:47.930+0000 7f4fd7200640 1 -- 172.21.15.137:0/1978028458 wait complete. 2024-04-25T02:09:47.956 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-25T02:09:46.008230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187921,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1099,"num_read_kb":712,"num_write":473,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376288,"kb_used_data":14512,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565536,"statfs":{"total":1151940427776,"available":1151555108864,"internally_reserved":0,"allocated":14860288,"data_stored":8727197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.973703"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545939+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:09:42.545939+0000","last_peered":"2024-04-25T02:09:42.545939+0000","last_clean":"2024-04-25T02:09:42.545939+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:09:42.545939+0000","last_undegraded":"2024-04-25T02:09:42.545939+0000","last_fullsized":"2024-04-25T02:09:42.545939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309570+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:09:42.309570+0000","last_peered":"2024-04-25T02:09:42.309570+0000","last_clean":"2024-04-25T02:09:42.309570+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:09:42.309570+0000","last_undegraded":"2024-04-25T02:09:42.309570+0000","last_fullsized":"2024-04-25T02:09:42.309570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309599+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:09:42.309599+0000","last_peered":"2024-04-25T02:09:42.309599+0000","last_clean":"2024-04-25T02:09:42.309599+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:09:42.309599+0000","last_undegraded":"2024-04-25T02:09:42.309599+0000","last_fullsized":"2024-04-25T02:09:42.309599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991574+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:09:41.991574+0000","last_peered":"2024-04-25T02:09:41.991574+0000","last_clean":"2024-04-25T02:09:41.991574+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:09:41.991574+0000","last_undegraded":"2024-04-25T02:09:41.991574+0000","last_fullsized":"2024-04-25T02:09:41.991574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118456+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:09:42.118456+0000","last_peered":"2024-04-25T02:09:42.118456+0000","last_clean":"2024-04-25T02:09:42.118456+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:09:42.118456+0000","last_undegraded":"2024-04-25T02:09:42.118456+0000","last_fullsized":"2024-04-25T02:09:42.118456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129363+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:09:42.129363+0000","last_peered":"2024-04-25T02:09:42.129363+0000","last_clean":"2024-04-25T02:09:42.129363+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:09:42.129363+0000","last_undegraded":"2024-04-25T02:09:42.129363+0000","last_fullsized":"2024-04-25T02:09:42.129363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305802+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:09:42.305802+0000","last_peered":"2024-04-25T02:09:42.305802+0000","last_clean":"2024-04-25T02:09:42.305802+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:09:42.305802+0000","last_undegraded":"2024-04-25T02:09:42.305802+0000","last_fullsized":"2024-04-25T02:09:42.305802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118571+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:09:42.118571+0000","last_peered":"2024-04-25T02:09:42.118571+0000","last_clean":"2024-04-25T02:09:42.118571+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:09:42.118571+0000","last_undegraded":"2024-04-25T02:09:42.118571+0000","last_fullsized":"2024-04-25T02:09:42.118571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307187+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:09:42.307187+0000","last_peered":"2024-04-25T02:09:42.307187+0000","last_clean":"2024-04-25T02:09:42.307187+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:09:42.307187+0000","last_undegraded":"2024-04-25T02:09:42.307187+0000","last_fullsized":"2024-04-25T02:09:42.307187+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129671+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:09:42.129671+0000","last_peered":"2024-04-25T02:09:42.129671+0000","last_clean":"2024-04-25T02:09:42.129671+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:09:42.129671+0000","last_undegraded":"2024-04-25T02:09:42.129671+0000","last_fullsized":"2024-04-25T02:09:42.129671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306446+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:09:42.306446+0000","last_peered":"2024-04-25T02:09:42.306446+0000","last_clean":"2024-04-25T02:09:42.306446+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:09:42.306446+0000","last_undegraded":"2024-04-25T02:09:42.306446+0000","last_fullsized":"2024-04-25T02:09:42.306446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991259+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:09:41.991259+0000","last_peered":"2024-04-25T02:09:41.991259+0000","last_clean":"2024-04-25T02:09:41.991259+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:09:41.991259+0000","last_undegraded":"2024-04-25T02:09:41.991259+0000","last_fullsized":"2024-04-25T02:09:41.991259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306355+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:09:42.306355+0000","last_peered":"2024-04-25T02:09:42.306355+0000","last_clean":"2024-04-25T02:09:42.306355+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:09:42.306355+0000","last_undegraded":"2024-04-25T02:09:42.306355+0000","last_fullsized":"2024-04-25T02:09:42.306355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309378+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:09:42.309378+0000","last_peered":"2024-04-25T02:09:42.309378+0000","last_clean":"2024-04-25T02:09:42.309378+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:09:42.309378+0000","last_undegraded":"2024-04-25T02:09:42.309378+0000","last_fullsized":"2024-04-25T02:09:42.309378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309029+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:09:42.309029+0000","last_peered":"2024-04-25T02:09:42.309029+0000","last_clean":"2024-04-25T02:09:42.309029+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:09:42.309029+0000","last_undegraded":"2024-04-25T02:09:42.309029+0000","last_fullsized":"2024-04-25T02:09:42.309029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306254+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:09:42.306254+0000","last_peered":"2024-04-25T02:09:42.306254+0000","last_clean":"2024-04-25T02:09:42.306254+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:09:42.306254+0000","last_undegraded":"2024-04-25T02:09:42.306254+0000","last_fullsized":"2024-04-25T02:09:42.306254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.546025+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:09:42.546025+0000","last_peered":"2024-04-25T02:09:42.546025+0000","last_clean":"2024-04-25T02:09:42.546025+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:09:42.546025+0000","last_undegraded":"2024-04-25T02:09:42.546025+0000","last_fullsized":"2024-04-25T02:09:42.546025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990997+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:09:41.990997+0000","last_peered":"2024-04-25T02:09:41.990997+0000","last_clean":"2024-04-25T02:09:41.990997+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:09:41.990997+0000","last_undegraded":"2024-04-25T02:09:41.990997+0000","last_fullsized":"2024-04-25T02:09:41.990997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306448+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:09:42.306448+0000","last_peered":"2024-04-25T02:09:42.306448+0000","last_clean":"2024-04-25T02:09:42.306448+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:09:42.306448+0000","last_undegraded":"2024-04-25T02:09:42.306448+0000","last_fullsized":"2024-04-25T02:09:42.306448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991131+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:09:41.991131+0000","last_peered":"2024-04-25T02:09:41.991131+0000","last_clean":"2024-04-25T02:09:41.991131+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:09:41.991131+0000","last_undegraded":"2024-04-25T02:09:41.991131+0000","last_fullsized":"2024-04-25T02:09:41.991131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119983+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:09:42.119983+0000","last_peered":"2024-04-25T02:09:42.119983+0000","last_clean":"2024-04-25T02:09:42.119983+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:09:42.119983+0000","last_undegraded":"2024-04-25T02:09:42.119983+0000","last_fullsized":"2024-04-25T02:09:42.119983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119996+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:09:42.119996+0000","last_peered":"2024-04-25T02:09:42.119996+0000","last_clean":"2024-04-25T02:09:42.119996+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:09:42.119996+0000","last_undegraded":"2024-04-25T02:09:42.119996+0000","last_fullsized":"2024-04-25T02:09:42.119996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309862+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:09:42.309862+0000","last_peered":"2024-04-25T02:09:42.309862+0000","last_clean":"2024-04-25T02:09:42.309862+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:09:42.309862+0000","last_undegraded":"2024-04-25T02:09:42.309862+0000","last_fullsized":"2024-04-25T02:09:42.309862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118880+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:09:42.118880+0000","last_peered":"2024-04-25T02:09:42.118880+0000","last_clean":"2024-04-25T02:09:42.118880+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:09:42.118880+0000","last_undegraded":"2024-04-25T02:09:42.118880+0000","last_fullsized":"2024-04-25T02:09:42.118880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306809+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:09:42.306809+0000","last_peered":"2024-04-25T02:09:42.306809+0000","last_clean":"2024-04-25T02:09:42.306809+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:09:42.306809+0000","last_undegraded":"2024-04-25T02:09:42.306809+0000","last_fullsized":"2024-04-25T02:09:42.306809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118682+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:09:42.118682+0000","last_peered":"2024-04-25T02:09:42.118682+0000","last_clean":"2024-04-25T02:09:42.118682+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:09:42.118682+0000","last_undegraded":"2024-04-25T02:09:42.118682+0000","last_fullsized":"2024-04-25T02:09:42.118682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126159+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:09:42.126159+0000","last_peered":"2024-04-25T02:09:42.126159+0000","last_clean":"2024-04-25T02:09:42.126159+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:09:42.126159+0000","last_undegraded":"2024-04-25T02:09:42.126159+0000","last_fullsized":"2024-04-25T02:09:42.126159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":175,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.613924+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:09:42.613924+0000","last_peered":"2024-04-25T02:09:42.613924+0000","last_clean":"2024-04-25T02:09:42.613924+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:09:42.613924+0000","last_undegraded":"2024-04-25T02:09:42.613924+0000","last_fullsized":"2024-04-25T02:09:42.613924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1855,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118453+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:09:42.118453+0000","last_peered":"2024-04-25T02:09:42.118453+0000","last_clean":"2024-04-25T02:09:42.118453+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:09:42.118453+0000","last_undegraded":"2024-04-25T02:09:42.118453+0000","last_fullsized":"2024-04-25T02:09:42.118453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129304+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:09:42.129304+0000","last_peered":"2024-04-25T02:09:42.129304+0000","last_clean":"2024-04-25T02:09:42.129304+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:09:42.129304+0000","last_undegraded":"2024-04-25T02:09:42.129304+0000","last_fullsized":"2024-04-25T02:09:42.129304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126290+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:09:42.126290+0000","last_peered":"2024-04-25T02:09:42.126290+0000","last_clean":"2024-04-25T02:09:42.126290+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:09:42.126290+0000","last_undegraded":"2024-04-25T02:09:42.126290+0000","last_fullsized":"2024-04-25T02:09:42.126290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305884+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:09:42.305884+0000","last_peered":"2024-04-25T02:09:42.305884+0000","last_clean":"2024-04-25T02:09:42.305884+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:09:42.305884+0000","last_undegraded":"2024-04-25T02:09:42.305884+0000","last_fullsized":"2024-04-25T02:09:42.305884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990606+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:09:41.990606+0000","last_peered":"2024-04-25T02:09:41.990606+0000","last_clean":"2024-04-25T02:09:41.990606+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:09:41.990606+0000","last_undegraded":"2024-04-25T02:09:41.990606+0000","last_fullsized":"2024-04-25T02:09:41.990606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125897+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:09:42.125897+0000","last_peered":"2024-04-25T02:09:42.125897+0000","last_clean":"2024-04-25T02:09:42.125897+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:09:42.125897+0000","last_undegraded":"2024-04-25T02:09:42.125897+0000","last_fullsized":"2024-04-25T02:09:42.125897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990888+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:09:41.990888+0000","last_peered":"2024-04-25T02:09:41.990888+0000","last_clean":"2024-04-25T02:09:41.990888+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:09:41.990888+0000","last_undegraded":"2024-04-25T02:09:41.990888+0000","last_fullsized":"2024-04-25T02:09:41.990888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129680+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:09:42.129680+0000","last_peered":"2024-04-25T02:09:42.129680+0000","last_clean":"2024-04-25T02:09:42.129680+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:09:42.129680+0000","last_undegraded":"2024-04-25T02:09:42.129680+0000","last_fullsized":"2024-04-25T02:09:42.129680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306964+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:09:42.306964+0000","last_peered":"2024-04-25T02:09:42.306964+0000","last_clean":"2024-04-25T02:09:42.306964+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:09:42.306964+0000","last_undegraded":"2024-04-25T02:09:42.306964+0000","last_fullsized":"2024-04-25T02:09:42.306964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306627+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:09:42.306627+0000","last_peered":"2024-04-25T02:09:42.306627+0000","last_clean":"2024-04-25T02:09:42.306627+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:09:42.306627+0000","last_undegraded":"2024-04-25T02:09:42.306627+0000","last_fullsized":"2024-04-25T02:09:42.306627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309831+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:09:42.309831+0000","last_peered":"2024-04-25T02:09:42.309831+0000","last_clean":"2024-04-25T02:09:42.309831+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:09:42.309831+0000","last_undegraded":"2024-04-25T02:09:42.309831+0000","last_fullsized":"2024-04-25T02:09:42.309831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126381+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:09:42.126381+0000","last_peered":"2024-04-25T02:09:42.126381+0000","last_clean":"2024-04-25T02:09:42.126381+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:09:42.126381+0000","last_undegraded":"2024-04-25T02:09:42.126381+0000","last_fullsized":"2024-04-25T02:09:42.126381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307032+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:09:42.307032+0000","last_peered":"2024-04-25T02:09:42.307032+0000","last_clean":"2024-04-25T02:09:42.307032+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:09:42.307032+0000","last_undegraded":"2024-04-25T02:09:42.307032+0000","last_fullsized":"2024-04-25T02:09:42.307032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'38","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.619183+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:09:42.619183+0000","last_peered":"2024-04-25T02:09:42.619183+0000","last_clean":"2024-04-25T02:09:42.619183+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:09:42.619183+0000","last_undegraded":"2024-04-25T02:09:42.619183+0000","last_fullsized":"2024-04-25T02:09:42.619183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66737,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":211,"num_write":39,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118694+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:09:42.118694+0000","last_peered":"2024-04-25T02:09:42.118694+0000","last_clean":"2024-04-25T02:09:42.118694+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:09:42.118694+0000","last_undegraded":"2024-04-25T02:09:42.118694+0000","last_fullsized":"2024-04-25T02:09:42.118694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545625+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:09:42.545625+0000","last_peered":"2024-04-25T02:09:42.545625+0000","last_clean":"2024-04-25T02:09:42.545625+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:09:42.545625+0000","last_undegraded":"2024-04-25T02:09:42.545625+0000","last_fullsized":"2024-04-25T02:09:42.545625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306139+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:09:42.306139+0000","last_peered":"2024-04-25T02:09:42.306139+0000","last_clean":"2024-04-25T02:09:42.306139+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:09:42.306139+0000","last_undegraded":"2024-04-25T02:09:42.306139+0000","last_fullsized":"2024-04-25T02:09:42.306139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306924+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:09:42.306924+0000","last_peered":"2024-04-25T02:09:42.306924+0000","last_clean":"2024-04-25T02:09:42.306924+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:09:42.306924+0000","last_undegraded":"2024-04-25T02:09:42.306924+0000","last_fullsized":"2024-04-25T02:09:42.306924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":172,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.659652+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:09:42.659652+0000","last_peered":"2024-04-25T02:09:42.659652+0000","last_clean":"2024-04-25T02:09:42.659652+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:09:42.659652+0000","last_undegraded":"2024-04-25T02:09:42.659652+0000","last_fullsized":"2024-04-25T02:09:42.659652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305822+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:09:42.305822+0000","last_peered":"2024-04-25T02:09:42.305822+0000","last_clean":"2024-04-25T02:09:42.305822+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:09:42.305822+0000","last_undegraded":"2024-04-25T02:09:42.305822+0000","last_fullsized":"2024-04-25T02:09:42.305822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118537+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:09:42.118537+0000","last_peered":"2024-04-25T02:09:42.118537+0000","last_clean":"2024-04-25T02:09:42.118537+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:09:42.118537+0000","last_undegraded":"2024-04-25T02:09:42.118537+0000","last_fullsized":"2024-04-25T02:09:42.118537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118892+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:09:42.118892+0000","last_peered":"2024-04-25T02:09:42.118892+0000","last_clean":"2024-04-25T02:09:42.118892+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:09:42.118892+0000","last_undegraded":"2024-04-25T02:09:42.118892+0000","last_fullsized":"2024-04-25T02:09:42.118892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545886+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:09:42.545886+0000","last_peered":"2024-04-25T02:09:42.545886+0000","last_clean":"2024-04-25T02:09:42.545886+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:09:42.545886+0000","last_undegraded":"2024-04-25T02:09:42.545886+0000","last_fullsized":"2024-04-25T02:09:42.545886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991184+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:09:41.991184+0000","last_peered":"2024-04-25T02:09:41.991184+0000","last_clean":"2024-04-25T02:09:41.991184+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:09:41.991184+0000","last_undegraded":"2024-04-25T02:09:41.991184+0000","last_fullsized":"2024-04-25T02:09:41.991184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129411+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:09:42.129411+0000","last_peered":"2024-04-25T02:09:42.129411+0000","last_clean":"2024-04-25T02:09:42.129411+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:09:42.129411+0000","last_undegraded":"2024-04-25T02:09:42.129411+0000","last_fullsized":"2024-04-25T02:09:42.129411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306025+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:09:42.306025+0000","last_peered":"2024-04-25T02:09:42.306025+0000","last_clean":"2024-04-25T02:09:42.306025+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:09:42.306025+0000","last_undegraded":"2024-04-25T02:09:42.306025+0000","last_fullsized":"2024-04-25T02:09:42.306025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129377+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:09:42.129377+0000","last_peered":"2024-04-25T02:09:42.129377+0000","last_clean":"2024-04-25T02:09:42.129377+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:09:42.129377+0000","last_undegraded":"2024-04-25T02:09:42.129377+0000","last_fullsized":"2024-04-25T02:09:42.129377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126314+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:09:42.126314+0000","last_peered":"2024-04-25T02:09:42.126314+0000","last_clean":"2024-04-25T02:09:42.126314+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:09:42.126314+0000","last_undegraded":"2024-04-25T02:09:42.126314+0000","last_fullsized":"2024-04-25T02:09:42.126314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.308494+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:09:42.308494+0000","last_peered":"2024-04-25T02:09:42.308494+0000","last_clean":"2024-04-25T02:09:42.308494+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:09:42.308494+0000","last_undegraded":"2024-04-25T02:09:42.308494+0000","last_fullsized":"2024-04-25T02:09:42.308494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118910+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:09:42.118910+0000","last_peered":"2024-04-25T02:09:42.118910+0000","last_clean":"2024-04-25T02:09:42.118910+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:09:42.118910+0000","last_undegraded":"2024-04-25T02:09:42.118910+0000","last_fullsized":"2024-04-25T02:09:42.118910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991533+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:09:41.991533+0000","last_peered":"2024-04-25T02:09:41.991533+0000","last_clean":"2024-04-25T02:09:41.991533+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:09:41.991533+0000","last_undegraded":"2024-04-25T02:09:41.991533+0000","last_fullsized":"2024-04-25T02:09:41.991533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305821+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:09:42.305821+0000","last_peered":"2024-04-25T02:09:42.305821+0000","last_clean":"2024-04-25T02:09:42.305821+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:09:42.305821+0000","last_undegraded":"2024-04-25T02:09:42.305821+0000","last_fullsized":"2024-04-25T02:09:42.305821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305460+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:09:42.305460+0000","last_peered":"2024-04-25T02:09:42.305460+0000","last_clean":"2024-04-25T02:09:42.305460+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:09:42.305460+0000","last_undegraded":"2024-04-25T02:09:42.305460+0000","last_fullsized":"2024-04-25T02:09:42.305460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306016+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:09:42.306016+0000","last_peered":"2024-04-25T02:09:42.306016+0000","last_clean":"2024-04-25T02:09:42.306016+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:09:42.306016+0000","last_undegraded":"2024-04-25T02:09:42.306016+0000","last_fullsized":"2024-04-25T02:09:42.306016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118759+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:09:42.118759+0000","last_peered":"2024-04-25T02:09:42.118759+0000","last_clean":"2024-04-25T02:09:42.118759+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:09:42.118759+0000","last_undegraded":"2024-04-25T02:09:42.118759+0000","last_fullsized":"2024-04-25T02:09:42.118759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306389+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:09:42.306389+0000","last_peered":"2024-04-25T02:09:42.306389+0000","last_clean":"2024-04-25T02:09:42.306389+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:09:42.306389+0000","last_undegraded":"2024-04-25T02:09:42.306389+0000","last_fullsized":"2024-04-25T02:09:42.306389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'45","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.258362+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:09:42.258362+0000","last_peered":"2024-04-25T02:09:42.258362+0000","last_clean":"2024-04-25T02:09:42.258362+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:09:42.258362+0000","last_undegraded":"2024-04-25T02:09:42.258362+0000","last_fullsized":"2024-04-25T02:09:42.258362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119692+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:09:42.119692+0000","last_peered":"2024-04-25T02:09:42.119692+0000","last_clean":"2024-04-25T02:09:42.119692+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:09:42.119692+0000","last_undegraded":"2024-04-25T02:09:42.119692+0000","last_fullsized":"2024-04-25T02:09:42.119692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991500+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:09:41.991500+0000","last_peered":"2024-04-25T02:09:41.991500+0000","last_clean":"2024-04-25T02:09:41.991500+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:09:41.991500+0000","last_undegraded":"2024-04-25T02:09:41.991500+0000","last_fullsized":"2024-04-25T02:09:41.991500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309723+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:09:42.309723+0000","last_peered":"2024-04-25T02:09:42.309723+0000","last_clean":"2024-04-25T02:09:42.309723+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:09:42.309723+0000","last_undegraded":"2024-04-25T02:09:42.309723+0000","last_fullsized":"2024-04-25T02:09:42.309723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306365+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:09:42.306365+0000","last_peered":"2024-04-25T02:09:42.306365+0000","last_clean":"2024-04-25T02:09:42.306365+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:09:42.306365+0000","last_undegraded":"2024-04-25T02:09:42.306365+0000","last_fullsized":"2024-04-25T02:09:42.306365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118366+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:09:42.118366+0000","last_peered":"2024-04-25T02:09:42.118366+0000","last_clean":"2024-04-25T02:09:42.118366+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:09:42.118366+0000","last_undegraded":"2024-04-25T02:09:42.118366+0000","last_fullsized":"2024-04-25T02:09:42.118366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119418+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:09:42.119418+0000","last_peered":"2024-04-25T02:09:42.119418+0000","last_clean":"2024-04-25T02:09:42.119418+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:09:42.119418+0000","last_undegraded":"2024-04-25T02:09:42.119418+0000","last_fullsized":"2024-04-25T02:09:42.119418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545541+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:09:42.545541+0000","last_peered":"2024-04-25T02:09:42.545541+0000","last_clean":"2024-04-25T02:09:42.545541+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:09:42.545541+0000","last_undegraded":"2024-04-25T02:09:42.545541+0000","last_fullsized":"2024-04-25T02:09:42.545541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306171+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:09:42.306171+0000","last_peered":"2024-04-25T02:09:42.306171+0000","last_clean":"2024-04-25T02:09:42.306171+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:09:42.306171+0000","last_undegraded":"2024-04-25T02:09:42.306171+0000","last_fullsized":"2024-04-25T02:09:42.306171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119204+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:09:42.119204+0000","last_peered":"2024-04-25T02:09:42.119204+0000","last_clean":"2024-04-25T02:09:42.119204+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:09:42.119204+0000","last_undegraded":"2024-04-25T02:09:42.119204+0000","last_fullsized":"2024-04-25T02:09:42.119204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118605+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:09:42.118605+0000","last_peered":"2024-04-25T02:09:42.118605+0000","last_clean":"2024-04-25T02:09:42.118605+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:09:42.118605+0000","last_undegraded":"2024-04-25T02:09:42.118605+0000","last_fullsized":"2024-04-25T02:09:42.118605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306148+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:09:42.306148+0000","last_peered":"2024-04-25T02:09:42.306148+0000","last_clean":"2024-04-25T02:09:42.306148+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:09:42.306148+0000","last_undegraded":"2024-04-25T02:09:42.306148+0000","last_fullsized":"2024-04-25T02:09:42.306148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306554+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:09:42.306554+0000","last_peered":"2024-04-25T02:09:42.306554+0000","last_clean":"2024-04-25T02:09:42.306554+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:09:42.306554+0000","last_undegraded":"2024-04-25T02:09:42.306554+0000","last_fullsized":"2024-04-25T02:09:42.306554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306541+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:09:42.306541+0000","last_peered":"2024-04-25T02:09:42.306541+0000","last_clean":"2024-04-25T02:09:42.306541+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:09:42.306541+0000","last_undegraded":"2024-04-25T02:09:42.306541+0000","last_fullsized":"2024-04-25T02:09:42.306541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.256134+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:09:42.256134+0000","last_peered":"2024-04-25T02:09:42.256134+0000","last_clean":"2024-04-25T02:09:42.256134+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:09:42.256134+0000","last_undegraded":"2024-04-25T02:09:42.256134+0000","last_fullsized":"2024-04-25T02:09:42.256134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306297+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:09:42.306297+0000","last_peered":"2024-04-25T02:09:42.306297+0000","last_clean":"2024-04-25T02:09:42.306297+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:09:42.306297+0000","last_undegraded":"2024-04-25T02:09:42.306297+0000","last_fullsized":"2024-04-25T02:09:42.306297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306490+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:09:42.306490+0000","last_peered":"2024-04-25T02:09:42.306490+0000","last_clean":"2024-04-25T02:09:42.306490+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:09:42.306490+0000","last_undegraded":"2024-04-25T02:09:42.306490+0000","last_fullsized":"2024-04-25T02:09:42.306490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306826+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:09:42.306826+0000","last_peered":"2024-04-25T02:09:42.306826+0000","last_clean":"2024-04-25T02:09:42.306826+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:09:42.306826+0000","last_undegraded":"2024-04-25T02:09:42.306826+0000","last_fullsized":"2024-04-25T02:09:42.306826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545546+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:09:42.545546+0000","last_peered":"2024-04-25T02:09:42.545546+0000","last_clean":"2024-04-25T02:09:42.545546+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:09:42.545546+0000","last_undegraded":"2024-04-25T02:09:42.545546+0000","last_fullsized":"2024-04-25T02:09:42.545546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306198+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:09:42.306198+0000","last_peered":"2024-04-25T02:09:42.306198+0000","last_clean":"2024-04-25T02:09:42.306198+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:09:42.306198+0000","last_undegraded":"2024-04-25T02:09:42.306198+0000","last_fullsized":"2024-04-25T02:09:42.306198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306140+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:09:42.306140+0000","last_peered":"2024-04-25T02:09:42.306140+0000","last_clean":"2024-04-25T02:09:42.306140+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:09:42.306140+0000","last_undegraded":"2024-04-25T02:09:42.306140+0000","last_fullsized":"2024-04-25T02:09:42.306140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309279+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:09:42.309279+0000","last_peered":"2024-04-25T02:09:42.309279+0000","last_clean":"2024-04-25T02:09:42.309279+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:09:42.309279+0000","last_undegraded":"2024-04-25T02:09:42.309279+0000","last_fullsized":"2024-04-25T02:09:42.309279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306788+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:09:42.306788+0000","last_peered":"2024-04-25T02:09:42.306788+0000","last_clean":"2024-04-25T02:09:42.306788+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:09:42.306788+0000","last_undegraded":"2024-04-25T02:09:42.306788+0000","last_fullsized":"2024-04-25T02:09:42.306788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545845+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:09:42.545845+0000","last_peered":"2024-04-25T02:09:42.545845+0000","last_clean":"2024-04-25T02:09:42.545845+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:09:42.545845+0000","last_undegraded":"2024-04-25T02:09:42.545845+0000","last_fullsized":"2024-04-25T02:09:42.545845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306516+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:09:42.306516+0000","last_peered":"2024-04-25T02:09:42.306516+0000","last_clean":"2024-04-25T02:09:42.306516+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:09:42.306516+0000","last_undegraded":"2024-04-25T02:09:42.306516+0000","last_fullsized":"2024-04-25T02:09:42.306516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119593+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:09:42.119593+0000","last_peered":"2024-04-25T02:09:42.119593+0000","last_clean":"2024-04-25T02:09:42.119593+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:09:42.119593+0000","last_undegraded":"2024-04-25T02:09:42.119593+0000","last_fullsized":"2024-04-25T02:09:42.119593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125930+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:09:42.125930+0000","last_peered":"2024-04-25T02:09:42.125930+0000","last_clean":"2024-04-25T02:09:42.125930+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:09:42.125930+0000","last_undegraded":"2024-04-25T02:09:42.125930+0000","last_fullsized":"2024-04-25T02:09:42.125930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119467+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:09:42.119467+0000","last_peered":"2024-04-25T02:09:42.119467+0000","last_clean":"2024-04-25T02:09:42.119467+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:09:42.119467+0000","last_undegraded":"2024-04-25T02:09:42.119467+0000","last_fullsized":"2024-04-25T02:09:42.119467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306576+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:09:42.306576+0000","last_peered":"2024-04-25T02:09:42.306576+0000","last_clean":"2024-04-25T02:09:42.306576+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:09:42.306576+0000","last_undegraded":"2024-04-25T02:09:42.306576+0000","last_fullsized":"2024-04-25T02:09:42.306576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306324+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:09:42.306324+0000","last_peered":"2024-04-25T02:09:42.306324+0000","last_clean":"2024-04-25T02:09:42.306324+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:09:42.306324+0000","last_undegraded":"2024-04-25T02:09:42.306324+0000","last_fullsized":"2024-04-25T02:09:42.306324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545697+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:09:42.545697+0000","last_peered":"2024-04-25T02:09:42.545697+0000","last_clean":"2024-04-25T02:09:42.545697+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:09:42.545697+0000","last_undegraded":"2024-04-25T02:09:42.545697+0000","last_fullsized":"2024-04-25T02:09:42.545697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597319,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":963,"num_read_kb":593,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1791957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383723,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":456231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645359,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1798144,"data_stored":1255865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28352,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716800,"statfs":{"total":95995035648,"available":95966003200,"internally_reserved":0,"allocated":1368064,"data_stored":858576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":455771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712440,"statfs":{"total":95995035648,"available":95961538560,"internally_reserved":0,"allocated":1568768,"data_stored":1058975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":464749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1032192,"data_stored":531279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1052672,"data_stored":533828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1507328,"data_stored":989876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920849,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":970752,"data_stored":466691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757324,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32912,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712240,"statfs":{"total":95995035648,"available":95961333760,"internally_reserved":0,"allocated":1716224,"data_stored":1189336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:47.959 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-25T02:09:47.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 -- 172.21.15.137:0/153949591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 msgr2=0x7fee941045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 --2- 172.21.15.137:0/153949591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee941045f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee84009900 tx=0x7fee8402a410 comp rx=0 tx=0).stop 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 -- 172.21.15.137:0/153949591 shutdown_connections 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 --2- 172.21.15.137:0/153949591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94107460 0x7fee941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 --2- 172.21.15.137:0/153949591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94104b30 0x7fee94106f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 --2- 172.21.15.137:0/153949591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee941045f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 -- 172.21.15.137:0/153949591 >> 172.21.15.137:0/153949591 conn(0x7fee940fbbf0 msgr2=0x7fee940fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 -- 172.21.15.137:0/153949591 shutdown_connections 2024-04-25T02:09:48.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.177+0000 7fee9aa00640 1 -- 172.21.15.137:0/153949591 wait complete. 2024-04-25T02:09:48.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.178+0000 7fee9aa00640 1 Processor -- start 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.178+0000 7fee9aa00640 1 -- start start 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.178+0000 7fee9aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee9aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94104b30 0x7fee9419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee9aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94107460 0x7fee941a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee9aa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee9410d580 con 0x7fee94107460 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee9aa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee9410d400 con 0x7fee94104b30 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee9aa00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee9410d700 con 0x7fee94102200 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee98a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94107460 0x7fee941a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37088/0 (socket says 172.21.15.137:37088) 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 -- 172.21.15.137:0/3813322484 learned_addr learned my addr 172.21.15.137:0/3813322484 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93400640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94104b30 0x7fee9419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 -- 172.21.15.137:0/3813322484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94104b30 msgr2=0x7fee9419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94104b30 0x7fee9419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 -- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94107460 msgr2=0x7fee941a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94107460 0x7fee941a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.179+0000 7fee93e00640 1 -- 172.21.15.137:0/3813322484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee941a19c0 con 0x7fee94102200 2024-04-25T02:09:48.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.180+0000 7fee93e00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee840316a0 tx=0x7fee84032d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.180+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8403f030 con 0x7fee94102200 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.180+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee84003d00 con 0x7fee94102200 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.180+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84035070 con 0x7fee94102200 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.181+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee941a1c50 con 0x7fee94102200 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.181+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee941a20f0 con 0x7fee94102200 2024-04-25T02:09:48.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.182+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee94108fb0 con 0x7fee94102200 2024-04-25T02:09:48.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.184+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7fee84042030 con 0x7fee94102200 2024-04-25T02:09:48.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.186+0000 7fee90c00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 0x7fee780a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.187+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fee840ef850 con 0x7fee94102200 2024-04-25T02:09:48.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.187+0000 7fee93400640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 0x7fee780a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.188+0000 7fee93400640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 0x7fee780a52e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee94069430 tx=0x7fee80005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.189+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fee840bbc70 con 0x7fee94102200 2024-04-25T02:09:48.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.396+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee94061b80 con 0x7fee780a2e20 2024-04-25T02:09:48.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.405+0000 7fee90c00640 1 -- 172.21.15.137:0/3813322484 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257758 (secure 0 0 0) 0x7fee94061b80 con 0x7fee780a2e20 2024-04-25T02:09:48.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:48.418 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-25T02:09:48.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 msgr2=0x7fee780a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 0x7fee780a52e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee94069430 tx=0x7fee80005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 msgr2=0x7fee94199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee840316a0 tx=0x7fee84032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 shutdown_connections 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee780a2e20 0x7fee780a52e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee94107460 0x7fee941a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee94104b30 0x7fee9419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 --2- 172.21.15.137:0/3813322484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee94102200 0x7fee94199db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 >> 172.21.15.137:0/3813322484 conn(0x7fee940fbbf0 msgr2=0x7fee94101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 shutdown_connections 2024-04-25T02:09:48.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.410+0000 7fee9aa00640 1 -- 172.21.15.137:0/3813322484 wait complete. 2024-04-25T02:09:48.436 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-25T02:09:48.008719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1187921,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1099,"num_read_kb":712,"num_write":473,"num_write_kb":4381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181352,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376288,"kb_used_data":14512,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565536,"statfs":{"total":1151940427776,"available":1151555108864,"internally_reserved":0,"allocated":14860288,"data_stored":8727197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.974192"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545939+0000","last_change":"2024-04-25T02:07:19.400392+0000","last_active":"2024-04-25T02:09:42.545939+0000","last_peered":"2024-04-25T02:09:42.545939+0000","last_clean":"2024-04-25T02:09:42.545939+0000","last_became_active":"2024-04-25T02:07:19.400074+0000","last_became_peered":"2024-04-25T02:07:19.400074+0000","last_unstale":"2024-04-25T02:09:42.545939+0000","last_undegraded":"2024-04-25T02:09:42.545939+0000","last_fullsized":"2024-04-25T02:09:42.545939+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.020941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309570+0000","last_change":"2024-04-25T02:07:19.392379+0000","last_active":"2024-04-25T02:09:42.309570+0000","last_peered":"2024-04-25T02:09:42.309570+0000","last_clean":"2024-04-25T02:09:42.309570+0000","last_became_active":"2024-04-25T02:07:19.392023+0000","last_became_peered":"2024-04-25T02:07:19.392023+0000","last_unstale":"2024-04-25T02:09:42.309570+0000","last_undegraded":"2024-04-25T02:09:42.309570+0000","last_fullsized":"2024-04-25T02:09:42.309570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:57:46.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309599+0000","last_change":"2024-04-25T02:07:19.388999+0000","last_active":"2024-04-25T02:09:42.309599+0000","last_peered":"2024-04-25T02:09:42.309599+0000","last_clean":"2024-04-25T02:09:42.309599+0000","last_became_active":"2024-04-25T02:07:19.388655+0000","last_became_peered":"2024-04-25T02:07:19.388655+0000","last_unstale":"2024-04-25T02:09:42.309599+0000","last_undegraded":"2024-04-25T02:09:42.309599+0000","last_fullsized":"2024-04-25T02:09:42.309599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:59:53.671859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991574+0000","last_change":"2024-04-25T02:07:19.371848+0000","last_active":"2024-04-25T02:09:41.991574+0000","last_peered":"2024-04-25T02:09:41.991574+0000","last_clean":"2024-04-25T02:09:41.991574+0000","last_became_active":"2024-04-25T02:07:19.371510+0000","last_became_peered":"2024-04-25T02:07:19.371510+0000","last_unstale":"2024-04-25T02:09:41.991574+0000","last_undegraded":"2024-04-25T02:09:41.991574+0000","last_fullsized":"2024-04-25T02:09:41.991574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:09:12.304390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118456+0000","last_change":"2024-04-25T02:07:19.393968+0000","last_active":"2024-04-25T02:09:42.118456+0000","last_peered":"2024-04-25T02:09:42.118456+0000","last_clean":"2024-04-25T02:09:42.118456+0000","last_became_active":"2024-04-25T02:07:19.393516+0000","last_became_peered":"2024-04-25T02:07:19.393516+0000","last_unstale":"2024-04-25T02:09:42.118456+0000","last_undegraded":"2024-04-25T02:09:42.118456+0000","last_fullsized":"2024-04-25T02:09:42.118456+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:04.345907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129363+0000","last_change":"2024-04-25T02:07:19.377537+0000","last_active":"2024-04-25T02:09:42.129363+0000","last_peered":"2024-04-25T02:09:42.129363+0000","last_clean":"2024-04-25T02:09:42.129363+0000","last_became_active":"2024-04-25T02:07:19.377217+0000","last_became_peered":"2024-04-25T02:07:19.377217+0000","last_unstale":"2024-04-25T02:09:42.129363+0000","last_undegraded":"2024-04-25T02:09:42.129363+0000","last_fullsized":"2024-04-25T02:09:42.129363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:12.092890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305802+0000","last_change":"2024-04-25T02:07:19.377743+0000","last_active":"2024-04-25T02:09:42.305802+0000","last_peered":"2024-04-25T02:09:42.305802+0000","last_clean":"2024-04-25T02:09:42.305802+0000","last_became_active":"2024-04-25T02:07:19.377410+0000","last_became_peered":"2024-04-25T02:07:19.377410+0000","last_unstale":"2024-04-25T02:09:42.305802+0000","last_undegraded":"2024-04-25T02:09:42.305802+0000","last_fullsized":"2024-04-25T02:09:42.305802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:36.050102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118571+0000","last_change":"2024-04-25T02:07:19.390344+0000","last_active":"2024-04-25T02:09:42.118571+0000","last_peered":"2024-04-25T02:09:42.118571+0000","last_clean":"2024-04-25T02:09:42.118571+0000","last_became_active":"2024-04-25T02:07:19.389912+0000","last_became_peered":"2024-04-25T02:07:19.389912+0000","last_unstale":"2024-04-25T02:09:42.118571+0000","last_undegraded":"2024-04-25T02:09:42.118571+0000","last_fullsized":"2024-04-25T02:09:42.118571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:00:53.430979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307187+0000","last_change":"2024-04-25T02:07:28.162662+0000","last_active":"2024-04-25T02:09:42.307187+0000","last_peered":"2024-04-25T02:09:42.307187+0000","last_clean":"2024-04-25T02:09:42.307187+0000","last_became_active":"2024-04-25T02:07:28.162320+0000","last_became_peered":"2024-04-25T02:07:28.162320+0000","last_unstale":"2024-04-25T02:09:42.307187+0000","last_undegraded":"2024-04-25T02:09:42.307187+0000","last_fullsized":"2024-04-25T02:09:42.307187+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:05:13.653829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129671+0000","last_change":"2024-04-25T02:07:19.369539+0000","last_active":"2024-04-25T02:09:42.129671+0000","last_peered":"2024-04-25T02:09:42.129671+0000","last_clean":"2024-04-25T02:09:42.129671+0000","last_became_active":"2024-04-25T02:07:19.369225+0000","last_became_peered":"2024-04-25T02:07:19.369225+0000","last_unstale":"2024-04-25T02:09:42.129671+0000","last_undegraded":"2024-04-25T02:09:42.129671+0000","last_fullsized":"2024-04-25T02:09:42.129671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:21.065138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306446+0000","last_change":"2024-04-25T02:07:19.373797+0000","last_active":"2024-04-25T02:09:42.306446+0000","last_peered":"2024-04-25T02:09:42.306446+0000","last_clean":"2024-04-25T02:09:42.306446+0000","last_became_active":"2024-04-25T02:07:19.373493+0000","last_became_peered":"2024-04-25T02:07:19.373493+0000","last_unstale":"2024-04-25T02:09:42.306446+0000","last_undegraded":"2024-04-25T02:09:42.306446+0000","last_fullsized":"2024-04-25T02:09:42.306446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:32.128368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991259+0000","last_change":"2024-04-25T02:07:19.372938+0000","last_active":"2024-04-25T02:09:41.991259+0000","last_peered":"2024-04-25T02:09:41.991259+0000","last_clean":"2024-04-25T02:09:41.991259+0000","last_became_active":"2024-04-25T02:07:19.372372+0000","last_became_peered":"2024-04-25T02:07:19.372372+0000","last_unstale":"2024-04-25T02:09:41.991259+0000","last_undegraded":"2024-04-25T02:09:41.991259+0000","last_fullsized":"2024-04-25T02:09:41.991259+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:56:35.964832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306355+0000","last_change":"2024-04-25T02:07:19.369015+0000","last_active":"2024-04-25T02:09:42.306355+0000","last_peered":"2024-04-25T02:09:42.306355+0000","last_clean":"2024-04-25T02:09:42.306355+0000","last_became_active":"2024-04-25T02:07:19.367986+0000","last_became_peered":"2024-04-25T02:07:19.367986+0000","last_unstale":"2024-04-25T02:09:42.306355+0000","last_undegraded":"2024-04-25T02:09:42.306355+0000","last_fullsized":"2024-04-25T02:09:42.306355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:34.195067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309378+0000","last_change":"2024-04-25T02:07:19.387027+0000","last_active":"2024-04-25T02:09:42.309378+0000","last_peered":"2024-04-25T02:09:42.309378+0000","last_clean":"2024-04-25T02:09:42.309378+0000","last_became_active":"2024-04-25T02:07:19.384889+0000","last_became_peered":"2024-04-25T02:07:19.384889+0000","last_unstale":"2024-04-25T02:09:42.309378+0000","last_undegraded":"2024-04-25T02:09:42.309378+0000","last_fullsized":"2024-04-25T02:09:42.309378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:43.005654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309029+0000","last_change":"2024-04-25T02:07:27.457403+0000","last_active":"2024-04-25T02:09:42.309029+0000","last_peered":"2024-04-25T02:09:42.309029+0000","last_clean":"2024-04-25T02:09:42.309029+0000","last_became_active":"2024-04-25T02:07:27.457027+0000","last_became_peered":"2024-04-25T02:07:27.457027+0000","last_unstale":"2024-04-25T02:09:42.309029+0000","last_undegraded":"2024-04-25T02:09:42.309029+0000","last_fullsized":"2024-04-25T02:09:42.309029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:23.868854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306254+0000","last_change":"2024-04-25T02:07:19.391662+0000","last_active":"2024-04-25T02:09:42.306254+0000","last_peered":"2024-04-25T02:09:42.306254+0000","last_clean":"2024-04-25T02:09:42.306254+0000","last_became_active":"2024-04-25T02:07:19.391313+0000","last_became_peered":"2024-04-25T02:07:19.391313+0000","last_unstale":"2024-04-25T02:09:42.306254+0000","last_undegraded":"2024-04-25T02:09:42.306254+0000","last_fullsized":"2024-04-25T02:09:42.306254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:52.914328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.546025+0000","last_change":"2024-04-25T02:07:19.391639+0000","last_active":"2024-04-25T02:09:42.546025+0000","last_peered":"2024-04-25T02:09:42.546025+0000","last_clean":"2024-04-25T02:09:42.546025+0000","last_became_active":"2024-04-25T02:07:19.391164+0000","last_became_peered":"2024-04-25T02:07:19.391164+0000","last_unstale":"2024-04-25T02:09:42.546025+0000","last_undegraded":"2024-04-25T02:09:42.546025+0000","last_fullsized":"2024-04-25T02:09:42.546025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:21.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990997+0000","last_change":"2024-04-25T02:07:19.383980+0000","last_active":"2024-04-25T02:09:41.990997+0000","last_peered":"2024-04-25T02:09:41.990997+0000","last_clean":"2024-04-25T02:09:41.990997+0000","last_became_active":"2024-04-25T02:07:19.381975+0000","last_became_peered":"2024-04-25T02:07:19.381975+0000","last_unstale":"2024-04-25T02:09:41.990997+0000","last_undegraded":"2024-04-25T02:09:41.990997+0000","last_fullsized":"2024-04-25T02:09:41.990997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:21.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306448+0000","last_change":"2024-04-25T02:07:19.390791+0000","last_active":"2024-04-25T02:09:42.306448+0000","last_peered":"2024-04-25T02:09:42.306448+0000","last_clean":"2024-04-25T02:09:42.306448+0000","last_became_active":"2024-04-25T02:07:19.390456+0000","last_became_peered":"2024-04-25T02:07:19.390456+0000","last_unstale":"2024-04-25T02:09:42.306448+0000","last_undegraded":"2024-04-25T02:09:42.306448+0000","last_fullsized":"2024-04-25T02:09:42.306448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:51.768811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991131+0000","last_change":"2024-04-25T02:07:28.345920+0000","last_active":"2024-04-25T02:09:41.991131+0000","last_peered":"2024-04-25T02:09:41.991131+0000","last_clean":"2024-04-25T02:09:41.991131+0000","last_became_active":"2024-04-25T02:07:28.337766+0000","last_became_peered":"2024-04-25T02:07:28.337766+0000","last_unstale":"2024-04-25T02:09:41.991131+0000","last_undegraded":"2024-04-25T02:09:41.991131+0000","last_fullsized":"2024-04-25T02:09:41.991131+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:55:21.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119983+0000","last_change":"2024-04-25T02:07:19.391441+0000","last_active":"2024-04-25T02:09:42.119983+0000","last_peered":"2024-04-25T02:09:42.119983+0000","last_clean":"2024-04-25T02:09:42.119983+0000","last_became_active":"2024-04-25T02:07:19.391011+0000","last_became_peered":"2024-04-25T02:07:19.391011+0000","last_unstale":"2024-04-25T02:09:42.119983+0000","last_undegraded":"2024-04-25T02:09:42.119983+0000","last_fullsized":"2024-04-25T02:09:42.119983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:51.642905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119996+0000","last_change":"2024-04-25T02:07:18.421858+0000","last_active":"2024-04-25T02:09:42.119996+0000","last_peered":"2024-04-25T02:09:42.119996+0000","last_clean":"2024-04-25T02:09:42.119996+0000","last_became_active":"2024-04-25T02:07:18.419598+0000","last_became_peered":"2024-04-25T02:07:18.419598+0000","last_unstale":"2024-04-25T02:09:42.119996+0000","last_undegraded":"2024-04-25T02:09:42.119996+0000","last_fullsized":"2024-04-25T02:09:42.119996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:43.629777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309862+0000","last_change":"2024-04-25T02:07:19.398833+0000","last_active":"2024-04-25T02:09:42.309862+0000","last_peered":"2024-04-25T02:09:42.309862+0000","last_clean":"2024-04-25T02:09:42.309862+0000","last_became_active":"2024-04-25T02:07:19.398311+0000","last_became_peered":"2024-04-25T02:07:19.398311+0000","last_unstale":"2024-04-25T02:09:42.309862+0000","last_undegraded":"2024-04-25T02:09:42.309862+0000","last_fullsized":"2024-04-25T02:09:42.309862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:04.241250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118880+0000","last_change":"2024-04-25T02:07:18.411943+0000","last_active":"2024-04-25T02:09:42.118880+0000","last_peered":"2024-04-25T02:09:42.118880+0000","last_clean":"2024-04-25T02:09:42.118880+0000","last_became_active":"2024-04-25T02:07:18.411605+0000","last_became_peered":"2024-04-25T02:07:18.411605+0000","last_unstale":"2024-04-25T02:09:42.118880+0000","last_undegraded":"2024-04-25T02:09:42.118880+0000","last_fullsized":"2024-04-25T02:09:42.118880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:30.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306809+0000","last_change":"2024-04-25T02:07:19.375607+0000","last_active":"2024-04-25T02:09:42.306809+0000","last_peered":"2024-04-25T02:09:42.306809+0000","last_clean":"2024-04-25T02:09:42.306809+0000","last_became_active":"2024-04-25T02:07:19.375299+0000","last_became_peered":"2024-04-25T02:07:19.375299+0000","last_unstale":"2024-04-25T02:09:42.306809+0000","last_undegraded":"2024-04-25T02:09:42.306809+0000","last_fullsized":"2024-04-25T02:09:42.306809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.731049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118682+0000","last_change":"2024-04-25T02:07:18.403902+0000","last_active":"2024-04-25T02:09:42.118682+0000","last_peered":"2024-04-25T02:09:42.118682+0000","last_clean":"2024-04-25T02:09:42.118682+0000","last_became_active":"2024-04-25T02:07:18.403379+0000","last_became_peered":"2024-04-25T02:07:18.403379+0000","last_unstale":"2024-04-25T02:09:42.118682+0000","last_undegraded":"2024-04-25T02:09:42.118682+0000","last_fullsized":"2024-04-25T02:09:42.118682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:45.622318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126159+0000","last_change":"2024-04-25T02:07:19.369141+0000","last_active":"2024-04-25T02:09:42.126159+0000","last_peered":"2024-04-25T02:09:42.126159+0000","last_clean":"2024-04-25T02:09:42.126159+0000","last_became_active":"2024-04-25T02:07:19.368644+0000","last_became_peered":"2024-04-25T02:07:19.368644+0000","last_unstale":"2024-04-25T02:09:42.126159+0000","last_undegraded":"2024-04-25T02:09:42.126159+0000","last_fullsized":"2024-04-25T02:09:42.126159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:57.156047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":175,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.613924+0000","last_change":"2024-04-25T02:07:18.408199+0000","last_active":"2024-04-25T02:09:42.613924+0000","last_peered":"2024-04-25T02:09:42.613924+0000","last_clean":"2024-04-25T02:09:42.613924+0000","last_became_active":"2024-04-25T02:07:18.407834+0000","last_became_peered":"2024-04-25T02:07:18.407834+0000","last_unstale":"2024-04-25T02:09:42.613924+0000","last_undegraded":"2024-04-25T02:09:42.613924+0000","last_fullsized":"2024-04-25T02:09:42.613924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:45.951167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1855,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118453+0000","last_change":"2024-04-25T02:07:19.377887+0000","last_active":"2024-04-25T02:09:42.118453+0000","last_peered":"2024-04-25T02:09:42.118453+0000","last_clean":"2024-04-25T02:09:42.118453+0000","last_became_active":"2024-04-25T02:07:19.377521+0000","last_became_peered":"2024-04-25T02:07:19.377521+0000","last_unstale":"2024-04-25T02:09:42.118453+0000","last_undegraded":"2024-04-25T02:09:42.118453+0000","last_fullsized":"2024-04-25T02:09:42.118453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:36.467394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129304+0000","last_change":"2024-04-25T02:07:18.418786+0000","last_active":"2024-04-25T02:09:42.129304+0000","last_peered":"2024-04-25T02:09:42.129304+0000","last_clean":"2024-04-25T02:09:42.129304+0000","last_became_active":"2024-04-25T02:07:18.418394+0000","last_became_peered":"2024-04-25T02:07:18.418394+0000","last_unstale":"2024-04-25T02:09:42.129304+0000","last_undegraded":"2024-04-25T02:09:42.129304+0000","last_fullsized":"2024-04-25T02:09:42.129304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:29.344492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126290+0000","last_change":"2024-04-25T02:07:19.393952+0000","last_active":"2024-04-25T02:09:42.126290+0000","last_peered":"2024-04-25T02:09:42.126290+0000","last_clean":"2024-04-25T02:09:42.126290+0000","last_became_active":"2024-04-25T02:07:19.393514+0000","last_became_peered":"2024-04-25T02:07:19.393514+0000","last_unstale":"2024-04-25T02:09:42.126290+0000","last_undegraded":"2024-04-25T02:09:42.126290+0000","last_fullsized":"2024-04-25T02:09:42.126290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:46:05.417191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305884+0000","last_change":"2024-04-25T02:07:18.421002+0000","last_active":"2024-04-25T02:09:42.305884+0000","last_peered":"2024-04-25T02:09:42.305884+0000","last_clean":"2024-04-25T02:09:42.305884+0000","last_became_active":"2024-04-25T02:07:18.420415+0000","last_became_peered":"2024-04-25T02:07:18.420415+0000","last_unstale":"2024-04-25T02:09:42.305884+0000","last_undegraded":"2024-04-25T02:09:42.305884+0000","last_fullsized":"2024-04-25T02:09:42.305884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:14.336796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990606+0000","last_change":"2024-04-25T02:07:28.163409+0000","last_active":"2024-04-25T02:09:41.990606+0000","last_peered":"2024-04-25T02:09:41.990606+0000","last_clean":"2024-04-25T02:09:41.990606+0000","last_became_active":"2024-04-25T02:07:28.162199+0000","last_became_peered":"2024-04-25T02:07:28.162199+0000","last_unstale":"2024-04-25T02:09:41.990606+0000","last_undegraded":"2024-04-25T02:09:41.990606+0000","last_fullsized":"2024-04-25T02:09:41.990606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.086071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125897+0000","last_change":"2024-04-25T02:07:18.409361+0000","last_active":"2024-04-25T02:09:42.125897+0000","last_peered":"2024-04-25T02:09:42.125897+0000","last_clean":"2024-04-25T02:09:42.125897+0000","last_became_active":"2024-04-25T02:07:18.408993+0000","last_became_peered":"2024-04-25T02:07:18.408993+0000","last_unstale":"2024-04-25T02:09:42.125897+0000","last_undegraded":"2024-04-25T02:09:42.125897+0000","last_fullsized":"2024-04-25T02:09:42.125897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:00.005682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.990888+0000","last_change":"2024-04-25T02:07:19.391760+0000","last_active":"2024-04-25T02:09:41.990888+0000","last_peered":"2024-04-25T02:09:41.990888+0000","last_clean":"2024-04-25T02:09:41.990888+0000","last_became_active":"2024-04-25T02:07:19.391370+0000","last_became_peered":"2024-04-25T02:07:19.391370+0000","last_unstale":"2024-04-25T02:09:41.990888+0000","last_undegraded":"2024-04-25T02:09:41.990888+0000","last_fullsized":"2024-04-25T02:09:41.990888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:22:37.311048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129680+0000","last_change":"2024-04-25T02:07:18.416692+0000","last_active":"2024-04-25T02:09:42.129680+0000","last_peered":"2024-04-25T02:09:42.129680+0000","last_clean":"2024-04-25T02:09:42.129680+0000","last_became_active":"2024-04-25T02:07:18.416282+0000","last_became_peered":"2024-04-25T02:07:18.416282+0000","last_unstale":"2024-04-25T02:09:42.129680+0000","last_undegraded":"2024-04-25T02:09:42.129680+0000","last_fullsized":"2024-04-25T02:09:42.129680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:34:55.660586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306964+0000","last_change":"2024-04-25T02:07:19.379569+0000","last_active":"2024-04-25T02:09:42.306964+0000","last_peered":"2024-04-25T02:09:42.306964+0000","last_clean":"2024-04-25T02:09:42.306964+0000","last_became_active":"2024-04-25T02:07:19.379180+0000","last_became_peered":"2024-04-25T02:07:19.379180+0000","last_unstale":"2024-04-25T02:09:42.306964+0000","last_undegraded":"2024-04-25T02:09:42.306964+0000","last_fullsized":"2024-04-25T02:09:42.306964+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:44.489212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306627+0000","last_change":"2024-04-25T02:07:18.413558+0000","last_active":"2024-04-25T02:09:42.306627+0000","last_peered":"2024-04-25T02:09:42.306627+0000","last_clean":"2024-04-25T02:09:42.306627+0000","last_became_active":"2024-04-25T02:07:18.413091+0000","last_became_peered":"2024-04-25T02:07:18.413091+0000","last_unstale":"2024-04-25T02:09:42.306627+0000","last_undegraded":"2024-04-25T02:09:42.306627+0000","last_fullsized":"2024-04-25T02:09:42.306627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:45.179539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309831+0000","last_change":"2024-04-25T02:07:19.395341+0000","last_active":"2024-04-25T02:09:42.309831+0000","last_peered":"2024-04-25T02:09:42.309831+0000","last_clean":"2024-04-25T02:09:42.309831+0000","last_became_active":"2024-04-25T02:07:19.389614+0000","last_became_peered":"2024-04-25T02:07:19.389614+0000","last_unstale":"2024-04-25T02:09:42.309831+0000","last_undegraded":"2024-04-25T02:09:42.309831+0000","last_fullsized":"2024-04-25T02:09:42.309831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:26.890819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126381+0000","last_change":"2024-04-25T02:07:18.418793+0000","last_active":"2024-04-25T02:09:42.126381+0000","last_peered":"2024-04-25T02:09:42.126381+0000","last_clean":"2024-04-25T02:09:42.126381+0000","last_became_active":"2024-04-25T02:07:18.418433+0000","last_became_peered":"2024-04-25T02:07:18.418433+0000","last_unstale":"2024-04-25T02:09:42.126381+0000","last_undegraded":"2024-04-25T02:09:42.126381+0000","last_fullsized":"2024-04-25T02:09:42.126381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:05.683004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.307032+0000","last_change":"2024-04-25T02:07:19.372052+0000","last_active":"2024-04-25T02:09:42.307032+0000","last_peered":"2024-04-25T02:09:42.307032+0000","last_clean":"2024-04-25T02:09:42.307032+0000","last_became_active":"2024-04-25T02:07:19.371631+0000","last_became_peered":"2024-04-25T02:07:19.371631+0000","last_unstale":"2024-04-25T02:09:42.307032+0000","last_undegraded":"2024-04-25T02:09:42.307032+0000","last_fullsized":"2024-04-25T02:09:42.307032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:39:24.003018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'38","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.619183+0000","last_change":"2024-04-25T02:07:18.408675+0000","last_active":"2024-04-25T02:09:42.619183+0000","last_peered":"2024-04-25T02:09:42.619183+0000","last_clean":"2024-04-25T02:09:42.619183+0000","last_became_active":"2024-04-25T02:07:18.408193+0000","last_became_peered":"2024-04-25T02:07:18.408193+0000","last_unstale":"2024-04-25T02:09:42.619183+0000","last_undegraded":"2024-04-25T02:09:42.619183+0000","last_fullsized":"2024-04-25T02:09:42.619183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:05.786630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66737,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":290,"num_read_kb":211,"num_write":39,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118694+0000","last_change":"2024-04-25T02:07:19.368535+0000","last_active":"2024-04-25T02:09:42.118694+0000","last_peered":"2024-04-25T02:09:42.118694+0000","last_clean":"2024-04-25T02:09:42.118694+0000","last_became_active":"2024-04-25T02:07:19.368198+0000","last_became_peered":"2024-04-25T02:07:19.368198+0000","last_unstale":"2024-04-25T02:09:42.118694+0000","last_undegraded":"2024-04-25T02:09:42.118694+0000","last_fullsized":"2024-04-25T02:09:42.118694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:47.088466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545625+0000","last_change":"2024-04-25T02:07:27.465381+0000","last_active":"2024-04-25T02:09:42.545625+0000","last_peered":"2024-04-25T02:09:42.545625+0000","last_clean":"2024-04-25T02:09:42.545625+0000","last_became_active":"2024-04-25T02:07:27.452287+0000","last_became_peered":"2024-04-25T02:07:27.452287+0000","last_unstale":"2024-04-25T02:09:42.545625+0000","last_undegraded":"2024-04-25T02:09:42.545625+0000","last_fullsized":"2024-04-25T02:09:42.545625+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:23:46.879144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306139+0000","last_change":"2024-04-25T02:07:19.397307+0000","last_active":"2024-04-25T02:09:42.306139+0000","last_peered":"2024-04-25T02:09:42.306139+0000","last_clean":"2024-04-25T02:09:42.306139+0000","last_became_active":"2024-04-25T02:07:19.396919+0000","last_became_peered":"2024-04-25T02:07:19.396919+0000","last_unstale":"2024-04-25T02:09:42.306139+0000","last_undegraded":"2024-04-25T02:09:42.306139+0000","last_fullsized":"2024-04-25T02:09:42.306139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:18:28.011963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:18.412459+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:18.412058+0000","last_became_peered":"2024-04-25T02:07:18.412058+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:22:23.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306924+0000","last_change":"2024-04-25T02:07:19.383733+0000","last_active":"2024-04-25T02:09:42.306924+0000","last_peered":"2024-04-25T02:09:42.306924+0000","last_clean":"2024-04-25T02:09:42.306924+0000","last_became_active":"2024-04-25T02:07:19.383299+0000","last_became_peered":"2024-04-25T02:07:19.383299+0000","last_unstale":"2024-04-25T02:09:42.306924+0000","last_undegraded":"2024-04-25T02:09:42.306924+0000","last_fullsized":"2024-04-25T02:09:42.306924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:38:06.367080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":172,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.659652+0000","last_change":"2024-04-25T02:07:18.407822+0000","last_active":"2024-04-25T02:09:42.659652+0000","last_peered":"2024-04-25T02:09:42.659652+0000","last_clean":"2024-04-25T02:09:42.659652+0000","last_became_active":"2024-04-25T02:07:18.407443+0000","last_became_peered":"2024-04-25T02:07:18.407443+0000","last_unstale":"2024-04-25T02:09:42.659652+0000","last_undegraded":"2024-04-25T02:09:42.659652+0000","last_fullsized":"2024-04-25T02:09:42.659652+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:45:23.791490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305822+0000","last_change":"2024-04-25T02:07:19.369530+0000","last_active":"2024-04-25T02:09:42.305822+0000","last_peered":"2024-04-25T02:09:42.305822+0000","last_clean":"2024-04-25T02:09:42.305822+0000","last_became_active":"2024-04-25T02:07:19.369190+0000","last_became_peered":"2024-04-25T02:07:19.369190+0000","last_unstale":"2024-04-25T02:09:42.305822+0000","last_undegraded":"2024-04-25T02:09:42.305822+0000","last_fullsized":"2024-04-25T02:09:42.305822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:51:14.347035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118537+0000","last_change":"2024-04-25T02:07:18.418183+0000","last_active":"2024-04-25T02:09:42.118537+0000","last_peered":"2024-04-25T02:09:42.118537+0000","last_clean":"2024-04-25T02:09:42.118537+0000","last_became_active":"2024-04-25T02:07:18.417809+0000","last_became_peered":"2024-04-25T02:07:18.417809+0000","last_unstale":"2024-04-25T02:09:42.118537+0000","last_undegraded":"2024-04-25T02:09:42.118537+0000","last_fullsized":"2024-04-25T02:09:42.118537+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:51:24.926105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126035+0000","last_change":"2024-04-25T02:07:19.371024+0000","last_active":"2024-04-25T02:09:42.126035+0000","last_peered":"2024-04-25T02:09:42.126035+0000","last_clean":"2024-04-25T02:09:42.126035+0000","last_became_active":"2024-04-25T02:07:19.370675+0000","last_became_peered":"2024-04-25T02:07:19.370675+0000","last_unstale":"2024-04-25T02:09:42.126035+0000","last_undegraded":"2024-04-25T02:09:42.126035+0000","last_fullsized":"2024-04-25T02:09:42.126035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:27:34.680690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118892+0000","last_change":"2024-04-25T02:07:18.409416+0000","last_active":"2024-04-25T02:09:42.118892+0000","last_peered":"2024-04-25T02:09:42.118892+0000","last_clean":"2024-04-25T02:09:42.118892+0000","last_became_active":"2024-04-25T02:07:18.407333+0000","last_became_peered":"2024-04-25T02:07:18.407333+0000","last_unstale":"2024-04-25T02:09:42.118892+0000","last_undegraded":"2024-04-25T02:09:42.118892+0000","last_fullsized":"2024-04-25T02:09:42.118892+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:07.165924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545886+0000","last_change":"2024-04-25T02:07:19.374080+0000","last_active":"2024-04-25T02:09:42.545886+0000","last_peered":"2024-04-25T02:09:42.545886+0000","last_clean":"2024-04-25T02:09:42.545886+0000","last_became_active":"2024-04-25T02:07:19.373625+0000","last_became_peered":"2024-04-25T02:07:19.373625+0000","last_unstale":"2024-04-25T02:09:42.545886+0000","last_undegraded":"2024-04-25T02:09:42.545886+0000","last_fullsized":"2024-04-25T02:09:42.545886+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.713231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991184+0000","last_change":"2024-04-25T02:07:27.457333+0000","last_active":"2024-04-25T02:09:41.991184+0000","last_peered":"2024-04-25T02:09:41.991184+0000","last_clean":"2024-04-25T02:09:41.991184+0000","last_became_active":"2024-04-25T02:07:27.456824+0000","last_became_peered":"2024-04-25T02:07:27.456824+0000","last_unstale":"2024-04-25T02:09:41.991184+0000","last_undegraded":"2024-04-25T02:09:41.991184+0000","last_fullsized":"2024-04-25T02:09:41.991184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:34:34.617011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129411+0000","last_change":"2024-04-25T02:07:19.396029+0000","last_active":"2024-04-25T02:09:42.129411+0000","last_peered":"2024-04-25T02:09:42.129411+0000","last_clean":"2024-04-25T02:09:42.129411+0000","last_became_active":"2024-04-25T02:07:19.395640+0000","last_became_peered":"2024-04-25T02:07:19.395640+0000","last_unstale":"2024-04-25T02:09:42.129411+0000","last_undegraded":"2024-04-25T02:09:42.129411+0000","last_fullsized":"2024-04-25T02:09:42.129411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:45:10.469823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306025+0000","last_change":"2024-04-25T02:07:18.419206+0000","last_active":"2024-04-25T02:09:42.306025+0000","last_peered":"2024-04-25T02:09:42.306025+0000","last_clean":"2024-04-25T02:09:42.306025+0000","last_became_active":"2024-04-25T02:07:18.418392+0000","last_became_peered":"2024-04-25T02:07:18.418392+0000","last_unstale":"2024-04-25T02:09:42.306025+0000","last_undegraded":"2024-04-25T02:09:42.306025+0000","last_fullsized":"2024-04-25T02:09:42.306025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:44.263475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.129377+0000","last_change":"2024-04-25T02:07:27.454152+0000","last_active":"2024-04-25T02:09:42.129377+0000","last_peered":"2024-04-25T02:09:42.129377+0000","last_clean":"2024-04-25T02:09:42.129377+0000","last_became_active":"2024-04-25T02:07:27.453636+0000","last_became_peered":"2024-04-25T02:07:27.453636+0000","last_unstale":"2024-04-25T02:09:42.129377+0000","last_undegraded":"2024-04-25T02:09:42.129377+0000","last_fullsized":"2024-04-25T02:09:42.129377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:29:57.437123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.126314+0000","last_change":"2024-04-25T02:07:19.370022+0000","last_active":"2024-04-25T02:09:42.126314+0000","last_peered":"2024-04-25T02:09:42.126314+0000","last_clean":"2024-04-25T02:09:42.126314+0000","last_became_active":"2024-04-25T02:07:19.369696+0000","last_became_peered":"2024-04-25T02:07:19.369696+0000","last_unstale":"2024-04-25T02:09:42.126314+0000","last_undegraded":"2024-04-25T02:09:42.126314+0000","last_fullsized":"2024-04-25T02:09:42.126314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:41.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.308494+0000","last_change":"2024-04-25T02:07:18.424553+0000","last_active":"2024-04-25T02:09:42.308494+0000","last_peered":"2024-04-25T02:09:42.308494+0000","last_clean":"2024-04-25T02:09:42.308494+0000","last_became_active":"2024-04-25T02:07:18.423419+0000","last_became_peered":"2024-04-25T02:07:18.423419+0000","last_unstale":"2024-04-25T02:09:42.308494+0000","last_undegraded":"2024-04-25T02:09:42.308494+0000","last_fullsized":"2024-04-25T02:09:42.308494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:54.260534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118910+0000","last_change":"2024-04-25T02:07:19.394930+0000","last_active":"2024-04-25T02:09:42.118910+0000","last_peered":"2024-04-25T02:09:42.118910+0000","last_clean":"2024-04-25T02:09:42.118910+0000","last_became_active":"2024-04-25T02:07:19.394241+0000","last_became_peered":"2024-04-25T02:07:19.394241+0000","last_unstale":"2024-04-25T02:09:42.118910+0000","last_undegraded":"2024-04-25T02:09:42.118910+0000","last_fullsized":"2024-04-25T02:09:42.118910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:19.427408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991533+0000","last_change":"2024-04-25T02:07:18.410742+0000","last_active":"2024-04-25T02:09:41.991533+0000","last_peered":"2024-04-25T02:09:41.991533+0000","last_clean":"2024-04-25T02:09:41.991533+0000","last_became_active":"2024-04-25T02:07:18.410201+0000","last_became_peered":"2024-04-25T02:07:18.410201+0000","last_unstale":"2024-04-25T02:09:41.991533+0000","last_undegraded":"2024-04-25T02:09:41.991533+0000","last_fullsized":"2024-04-25T02:09:41.991533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:03:53.929110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305821+0000","last_change":"2024-04-25T02:05:55.357543+0000","last_active":"2024-04-25T02:09:42.305821+0000","last_peered":"2024-04-25T02:09:42.305821+0000","last_clean":"2024-04-25T02:09:42.305821+0000","last_became_active":"2024-04-25T02:05:55.356906+0000","last_became_peered":"2024-04-25T02:05:55.356906+0000","last_unstale":"2024-04-25T02:09:42.305821+0000","last_undegraded":"2024-04-25T02:09:42.305821+0000","last_fullsized":"2024-04-25T02:09:42.305821+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:02:10.948776+0000","last_clean_scrub_stamp":"2024-04-25T02:02:10.948776+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:32:08.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.305460+0000","last_change":"2024-04-25T02:07:19.372546+0000","last_active":"2024-04-25T02:09:42.305460+0000","last_peered":"2024-04-25T02:09:42.305460+0000","last_clean":"2024-04-25T02:09:42.305460+0000","last_became_active":"2024-04-25T02:07:19.372170+0000","last_became_peered":"2024-04-25T02:07:19.372170+0000","last_unstale":"2024-04-25T02:09:42.305460+0000","last_undegraded":"2024-04-25T02:09:42.305460+0000","last_fullsized":"2024-04-25T02:09:42.305460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.727566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306016+0000","last_change":"2024-04-25T02:07:18.413121+0000","last_active":"2024-04-25T02:09:42.306016+0000","last_peered":"2024-04-25T02:09:42.306016+0000","last_clean":"2024-04-25T02:09:42.306016+0000","last_became_active":"2024-04-25T02:07:18.412737+0000","last_became_peered":"2024-04-25T02:07:18.412737+0000","last_unstale":"2024-04-25T02:09:42.306016+0000","last_undegraded":"2024-04-25T02:09:42.306016+0000","last_fullsized":"2024-04-25T02:09:42.306016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:42.498366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118759+0000","last_change":"2024-04-25T02:07:18.421590+0000","last_active":"2024-04-25T02:09:42.118759+0000","last_peered":"2024-04-25T02:09:42.118759+0000","last_clean":"2024-04-25T02:09:42.118759+0000","last_became_active":"2024-04-25T02:07:18.421165+0000","last_became_peered":"2024-04-25T02:07:18.421165+0000","last_unstale":"2024-04-25T02:09:42.118759+0000","last_undegraded":"2024-04-25T02:09:42.118759+0000","last_fullsized":"2024-04-25T02:09:42.118759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:33:43.307355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306389+0000","last_change":"2024-04-25T02:07:19.381127+0000","last_active":"2024-04-25T02:09:42.306389+0000","last_peered":"2024-04-25T02:09:42.306389+0000","last_clean":"2024-04-25T02:09:42.306389+0000","last_became_active":"2024-04-25T02:07:19.379948+0000","last_became_peered":"2024-04-25T02:07:19.379948+0000","last_unstale":"2024-04-25T02:09:42.306389+0000","last_undegraded":"2024-04-25T02:09:42.306389+0000","last_fullsized":"2024-04-25T02:09:42.306389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:16:56.119425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'45","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.258362+0000","last_change":"2024-04-25T02:07:18.420503+0000","last_active":"2024-04-25T02:09:42.258362+0000","last_peered":"2024-04-25T02:09:42.258362+0000","last_clean":"2024-04-25T02:09:42.258362+0000","last_became_active":"2024-04-25T02:07:18.420186+0000","last_became_peered":"2024-04-25T02:07:18.420186+0000","last_unstale":"2024-04-25T02:09:42.258362+0000","last_undegraded":"2024-04-25T02:09:42.258362+0000","last_fullsized":"2024-04-25T02:09:42.258362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:50.285350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119692+0000","last_change":"2024-04-25T02:07:19.393485+0000","last_active":"2024-04-25T02:09:42.119692+0000","last_peered":"2024-04-25T02:09:42.119692+0000","last_clean":"2024-04-25T02:09:42.119692+0000","last_became_active":"2024-04-25T02:07:19.393130+0000","last_became_peered":"2024-04-25T02:07:19.393130+0000","last_unstale":"2024-04-25T02:09:42.119692+0000","last_undegraded":"2024-04-25T02:09:42.119692+0000","last_fullsized":"2024-04-25T02:09:42.119692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:38:13.990886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:41.991500+0000","last_change":"2024-04-25T02:07:18.417537+0000","last_active":"2024-04-25T02:09:41.991500+0000","last_peered":"2024-04-25T02:09:41.991500+0000","last_clean":"2024-04-25T02:09:41.991500+0000","last_became_active":"2024-04-25T02:07:18.417221+0000","last_became_peered":"2024-04-25T02:07:18.417221+0000","last_unstale":"2024-04-25T02:09:41.991500+0000","last_undegraded":"2024-04-25T02:09:41.991500+0000","last_fullsized":"2024-04-25T02:09:41.991500+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:01.969958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309723+0000","last_change":"2024-04-25T02:07:19.400206+0000","last_active":"2024-04-25T02:09:42.309723+0000","last_peered":"2024-04-25T02:09:42.309723+0000","last_clean":"2024-04-25T02:09:42.309723+0000","last_became_active":"2024-04-25T02:07:19.399877+0000","last_became_peered":"2024-04-25T02:07:19.399877+0000","last_unstale":"2024-04-25T02:09:42.309723+0000","last_undegraded":"2024-04-25T02:09:42.309723+0000","last_fullsized":"2024-04-25T02:09:42.309723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:15:38.326063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306365+0000","last_change":"2024-04-25T02:07:18.411630+0000","last_active":"2024-04-25T02:09:42.306365+0000","last_peered":"2024-04-25T02:09:42.306365+0000","last_clean":"2024-04-25T02:09:42.306365+0000","last_became_active":"2024-04-25T02:07:18.411281+0000","last_became_peered":"2024-04-25T02:07:18.411281+0000","last_unstale":"2024-04-25T02:09:42.306365+0000","last_undegraded":"2024-04-25T02:09:42.306365+0000","last_fullsized":"2024-04-25T02:09:42.306365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:47.602586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118366+0000","last_change":"2024-04-25T02:07:19.366905+0000","last_active":"2024-04-25T02:09:42.118366+0000","last_peered":"2024-04-25T02:09:42.118366+0000","last_clean":"2024-04-25T02:09:42.118366+0000","last_became_active":"2024-04-25T02:07:19.366275+0000","last_became_peered":"2024-04-25T02:07:19.366275+0000","last_unstale":"2024-04-25T02:09:42.118366+0000","last_undegraded":"2024-04-25T02:09:42.118366+0000","last_fullsized":"2024-04-25T02:09:42.118366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:52.377936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119418+0000","last_change":"2024-04-25T02:07:18.426508+0000","last_active":"2024-04-25T02:09:42.119418+0000","last_peered":"2024-04-25T02:09:42.119418+0000","last_clean":"2024-04-25T02:09:42.119418+0000","last_became_active":"2024-04-25T02:07:18.426171+0000","last_became_peered":"2024-04-25T02:07:18.426171+0000","last_unstale":"2024-04-25T02:09:42.119418+0000","last_undegraded":"2024-04-25T02:09:42.119418+0000","last_fullsized":"2024-04-25T02:09:42.119418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:03.132973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545541+0000","last_change":"2024-04-25T02:07:19.391692+0000","last_active":"2024-04-25T02:09:42.545541+0000","last_peered":"2024-04-25T02:09:42.545541+0000","last_clean":"2024-04-25T02:09:42.545541+0000","last_became_active":"2024-04-25T02:07:19.391113+0000","last_became_peered":"2024-04-25T02:07:19.391113+0000","last_unstale":"2024-04-25T02:09:42.545541+0000","last_undegraded":"2024-04-25T02:09:42.545541+0000","last_fullsized":"2024-04-25T02:09:42.545541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:40.064598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306171+0000","last_change":"2024-04-25T02:07:18.411150+0000","last_active":"2024-04-25T02:09:42.306171+0000","last_peered":"2024-04-25T02:09:42.306171+0000","last_clean":"2024-04-25T02:09:42.306171+0000","last_became_active":"2024-04-25T02:07:18.410753+0000","last_became_peered":"2024-04-25T02:07:18.410753+0000","last_unstale":"2024-04-25T02:09:42.306171+0000","last_undegraded":"2024-04-25T02:09:42.306171+0000","last_fullsized":"2024-04-25T02:09:42.306171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:19.304404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119204+0000","last_change":"2024-04-25T02:07:19.401820+0000","last_active":"2024-04-25T02:09:42.119204+0000","last_peered":"2024-04-25T02:09:42.119204+0000","last_clean":"2024-04-25T02:09:42.119204+0000","last_became_active":"2024-04-25T02:07:19.401400+0000","last_became_peered":"2024-04-25T02:07:19.401400+0000","last_unstale":"2024-04-25T02:09:42.119204+0000","last_undegraded":"2024-04-25T02:09:42.119204+0000","last_fullsized":"2024-04-25T02:09:42.119204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:29.637106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.118605+0000","last_change":"2024-04-25T02:07:18.409074+0000","last_active":"2024-04-25T02:09:42.118605+0000","last_peered":"2024-04-25T02:09:42.118605+0000","last_clean":"2024-04-25T02:09:42.118605+0000","last_became_active":"2024-04-25T02:07:18.408710+0000","last_became_peered":"2024-04-25T02:07:18.408710+0000","last_unstale":"2024-04-25T02:09:42.118605+0000","last_undegraded":"2024-04-25T02:09:42.118605+0000","last_fullsized":"2024-04-25T02:09:42.118605+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:00.693653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306148+0000","last_change":"2024-04-25T02:07:19.377334+0000","last_active":"2024-04-25T02:09:42.306148+0000","last_peered":"2024-04-25T02:09:42.306148+0000","last_clean":"2024-04-25T02:09:42.306148+0000","last_became_active":"2024-04-25T02:07:19.376976+0000","last_became_peered":"2024-04-25T02:07:19.376976+0000","last_unstale":"2024-04-25T02:09:42.306148+0000","last_undegraded":"2024-04-25T02:09:42.306148+0000","last_fullsized":"2024-04-25T02:09:42.306148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:41:55.328312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306554+0000","last_change":"2024-04-25T02:07:18.417029+0000","last_active":"2024-04-25T02:09:42.306554+0000","last_peered":"2024-04-25T02:09:42.306554+0000","last_clean":"2024-04-25T02:09:42.306554+0000","last_became_active":"2024-04-25T02:07:18.416648+0000","last_became_peered":"2024-04-25T02:07:18.416648+0000","last_unstale":"2024-04-25T02:09:42.306554+0000","last_undegraded":"2024-04-25T02:09:42.306554+0000","last_fullsized":"2024-04-25T02:09:42.306554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:57.027177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306541+0000","last_change":"2024-04-25T02:07:19.373762+0000","last_active":"2024-04-25T02:09:42.306541+0000","last_peered":"2024-04-25T02:09:42.306541+0000","last_clean":"2024-04-25T02:09:42.306541+0000","last_became_active":"2024-04-25T02:07:19.373402+0000","last_became_peered":"2024-04-25T02:07:19.373402+0000","last_unstale":"2024-04-25T02:09:42.306541+0000","last_undegraded":"2024-04-25T02:09:42.306541+0000","last_fullsized":"2024-04-25T02:09:42.306541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:23:58.554633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'39","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.256134+0000","last_change":"2024-04-25T02:07:18.412365+0000","last_active":"2024-04-25T02:09:42.256134+0000","last_peered":"2024-04-25T02:09:42.256134+0000","last_clean":"2024-04-25T02:09:42.256134+0000","last_became_active":"2024-04-25T02:07:18.411863+0000","last_became_peered":"2024-04-25T02:07:18.411863+0000","last_unstale":"2024-04-25T02:09:42.256134+0000","last_undegraded":"2024-04-25T02:09:42.256134+0000","last_fullsized":"2024-04-25T02:09:42.256134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:43.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306297+0000","last_change":"2024-04-25T02:07:19.395946+0000","last_active":"2024-04-25T02:09:42.306297+0000","last_peered":"2024-04-25T02:09:42.306297+0000","last_clean":"2024-04-25T02:09:42.306297+0000","last_became_active":"2024-04-25T02:07:19.395536+0000","last_became_peered":"2024-04-25T02:07:19.395536+0000","last_unstale":"2024-04-25T02:09:42.306297+0000","last_undegraded":"2024-04-25T02:09:42.306297+0000","last_fullsized":"2024-04-25T02:09:42.306297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:17.186064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306490+0000","last_change":"2024-04-25T02:07:18.425087+0000","last_active":"2024-04-25T02:09:42.306490+0000","last_peered":"2024-04-25T02:09:42.306490+0000","last_clean":"2024-04-25T02:09:42.306490+0000","last_became_active":"2024-04-25T02:07:18.423485+0000","last_became_peered":"2024-04-25T02:07:18.423485+0000","last_unstale":"2024-04-25T02:09:42.306490+0000","last_undegraded":"2024-04-25T02:09:42.306490+0000","last_fullsized":"2024-04-25T02:09:42.306490+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:17.384268+0000","last_clean_scrub_stamp":"2024-04-25T02:07:17.384268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:29.665410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306826+0000","last_change":"2024-04-25T02:07:19.368056+0000","last_active":"2024-04-25T02:09:42.306826+0000","last_peered":"2024-04-25T02:09:42.306826+0000","last_clean":"2024-04-25T02:09:42.306826+0000","last_became_active":"2024-04-25T02:07:19.367698+0000","last_became_peered":"2024-04-25T02:07:19.367698+0000","last_unstale":"2024-04-25T02:09:42.306826+0000","last_undegraded":"2024-04-25T02:09:42.306826+0000","last_fullsized":"2024-04-25T02:09:42.306826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:29.687946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545546+0000","last_change":"2024-04-25T02:07:19.366990+0000","last_active":"2024-04-25T02:09:42.545546+0000","last_peered":"2024-04-25T02:09:42.545546+0000","last_clean":"2024-04-25T02:09:42.545546+0000","last_became_active":"2024-04-25T02:07:19.365949+0000","last_became_peered":"2024-04-25T02:07:19.365949+0000","last_unstale":"2024-04-25T02:09:42.545546+0000","last_undegraded":"2024-04-25T02:09:42.545546+0000","last_fullsized":"2024-04-25T02:09:42.545546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:03.060149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306198+0000","last_change":"2024-04-25T02:07:19.371049+0000","last_active":"2024-04-25T02:09:42.306198+0000","last_peered":"2024-04-25T02:09:42.306198+0000","last_clean":"2024-04-25T02:09:42.306198+0000","last_became_active":"2024-04-25T02:07:19.370606+0000","last_became_peered":"2024-04-25T02:07:19.370606+0000","last_unstale":"2024-04-25T02:09:42.306198+0000","last_undegraded":"2024-04-25T02:09:42.306198+0000","last_fullsized":"2024-04-25T02:09:42.306198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:36:12.682255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306140+0000","last_change":"2024-04-25T02:07:19.396172+0000","last_active":"2024-04-25T02:09:42.306140+0000","last_peered":"2024-04-25T02:09:42.306140+0000","last_clean":"2024-04-25T02:09:42.306140+0000","last_became_active":"2024-04-25T02:07:19.395735+0000","last_became_peered":"2024-04-25T02:07:19.395735+0000","last_unstale":"2024-04-25T02:09:42.306140+0000","last_undegraded":"2024-04-25T02:09:42.306140+0000","last_fullsized":"2024-04-25T02:09:42.306140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.917186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.309279+0000","last_change":"2024-04-25T02:07:19.389350+0000","last_active":"2024-04-25T02:09:42.309279+0000","last_peered":"2024-04-25T02:09:42.309279+0000","last_clean":"2024-04-25T02:09:42.309279+0000","last_became_active":"2024-04-25T02:07:19.388771+0000","last_became_peered":"2024-04-25T02:07:19.388771+0000","last_unstale":"2024-04-25T02:09:42.309279+0000","last_undegraded":"2024-04-25T02:09:42.309279+0000","last_fullsized":"2024-04-25T02:09:42.309279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:37:52.840953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306788+0000","last_change":"2024-04-25T02:07:19.389361+0000","last_active":"2024-04-25T02:09:42.306788+0000","last_peered":"2024-04-25T02:09:42.306788+0000","last_clean":"2024-04-25T02:09:42.306788+0000","last_became_active":"2024-04-25T02:07:19.388973+0000","last_became_peered":"2024-04-25T02:07:19.388973+0000","last_unstale":"2024-04-25T02:09:42.306788+0000","last_undegraded":"2024-04-25T02:09:42.306788+0000","last_fullsized":"2024-04-25T02:09:42.306788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:13:55.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545845+0000","last_change":"2024-04-25T02:07:19.366706+0000","last_active":"2024-04-25T02:09:42.545845+0000","last_peered":"2024-04-25T02:09:42.545845+0000","last_clean":"2024-04-25T02:09:42.545845+0000","last_became_active":"2024-04-25T02:07:19.366342+0000","last_became_peered":"2024-04-25T02:07:19.366342+0000","last_unstale":"2024-04-25T02:09:42.545845+0000","last_undegraded":"2024-04-25T02:09:42.545845+0000","last_fullsized":"2024-04-25T02:09:42.545845+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:40:48.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306516+0000","last_change":"2024-04-25T02:07:19.368678+0000","last_active":"2024-04-25T02:09:42.306516+0000","last_peered":"2024-04-25T02:09:42.306516+0000","last_clean":"2024-04-25T02:09:42.306516+0000","last_became_active":"2024-04-25T02:07:19.368300+0000","last_became_peered":"2024-04-25T02:07:19.368300+0000","last_unstale":"2024-04-25T02:09:42.306516+0000","last_undegraded":"2024-04-25T02:09:42.306516+0000","last_fullsized":"2024-04-25T02:09:42.306516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:24.443798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119593+0000","last_change":"2024-04-25T02:07:19.399389+0000","last_active":"2024-04-25T02:09:42.119593+0000","last_peered":"2024-04-25T02:09:42.119593+0000","last_clean":"2024-04-25T02:09:42.119593+0000","last_became_active":"2024-04-25T02:07:19.395453+0000","last_became_peered":"2024-04-25T02:07:19.395453+0000","last_unstale":"2024-04-25T02:09:42.119593+0000","last_undegraded":"2024-04-25T02:09:42.119593+0000","last_fullsized":"2024-04-25T02:09:42.119593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:16.324572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.125930+0000","last_change":"2024-04-25T02:07:19.392752+0000","last_active":"2024-04-25T02:09:42.125930+0000","last_peered":"2024-04-25T02:09:42.125930+0000","last_clean":"2024-04-25T02:09:42.125930+0000","last_became_active":"2024-04-25T02:07:19.392407+0000","last_became_peered":"2024-04-25T02:07:19.392407+0000","last_unstale":"2024-04-25T02:09:42.125930+0000","last_undegraded":"2024-04-25T02:09:42.125930+0000","last_fullsized":"2024-04-25T02:09:42.125930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:28.936240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.119467+0000","last_change":"2024-04-25T02:07:19.390709+0000","last_active":"2024-04-25T02:09:42.119467+0000","last_peered":"2024-04-25T02:09:42.119467+0000","last_clean":"2024-04-25T02:09:42.119467+0000","last_became_active":"2024-04-25T02:07:19.390336+0000","last_became_peered":"2024-04-25T02:07:19.390336+0000","last_unstale":"2024-04-25T02:09:42.119467+0000","last_undegraded":"2024-04-25T02:09:42.119467+0000","last_fullsized":"2024-04-25T02:09:42.119467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:29.474262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306576+0000","last_change":"2024-04-25T02:07:19.397212+0000","last_active":"2024-04-25T02:09:42.306576+0000","last_peered":"2024-04-25T02:09:42.306576+0000","last_clean":"2024-04-25T02:09:42.306576+0000","last_became_active":"2024-04-25T02:07:19.396813+0000","last_became_peered":"2024-04-25T02:07:19.396813+0000","last_unstale":"2024-04-25T02:09:42.306576+0000","last_undegraded":"2024-04-25T02:09:42.306576+0000","last_fullsized":"2024-04-25T02:09:42.306576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:23.289818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.306324+0000","last_change":"2024-04-25T02:07:19.385870+0000","last_active":"2024-04-25T02:09:42.306324+0000","last_peered":"2024-04-25T02:09:42.306324+0000","last_clean":"2024-04-25T02:09:42.306324+0000","last_became_active":"2024-04-25T02:07:19.385319+0000","last_became_peered":"2024-04-25T02:07:19.385319+0000","last_unstale":"2024-04-25T02:09:42.306324+0000","last_undegraded":"2024-04-25T02:09:42.306324+0000","last_fullsized":"2024-04-25T02:09:42.306324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:52:38.263099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T02:09:42.545697+0000","last_change":"2024-04-25T02:07:27.447491+0000","last_active":"2024-04-25T02:09:42.545697+0000","last_peered":"2024-04-25T02:09:42.545697+0000","last_clean":"2024-04-25T02:09:42.545697+0000","last_became_active":"2024-04-25T02:07:27.447127+0000","last_became_peered":"2024-04-25T02:07:27.447127+0000","last_unstale":"2024-04-25T02:09:42.545697+0000","last_undegraded":"2024-04-25T02:09:42.545697+0000","last_fullsized":"2024-04-25T02:09:42.545697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:07:18.389719+0000","last_clean_scrub_stamp":"2024-04-25T02:07:18.389719+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:27:22.561721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597319,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":963,"num_read_kb":593,"num_write":290,"num_write_kb":1441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":616,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1791957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383723,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":456231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645359,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1798144,"data_stored":1255865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28352,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716800,"statfs":{"total":95995035648,"available":95966003200,"internally_reserved":0,"allocated":1368064,"data_stored":858576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":455771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712440,"statfs":{"total":95995035648,"available":95961538560,"internally_reserved":0,"allocated":1568768,"data_stored":1058975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":962560,"data_stored":464749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1032192,"data_stored":531279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":983040,"data_stored":466020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1052672,"data_stored":533828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1507328,"data_stored":989876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920849,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":970752,"data_stored":466691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757324,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32912,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712240,"statfs":{"total":95995035648,"available":95961333760,"internally_reserved":0,"allocated":1716224,"data_stored":1189336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:09:48.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 -- 172.21.15.137:0/1355467259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 msgr2=0x7f1ddc076520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 --2- 172.21.15.137:0/1355467259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc076520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009900 tx=0x7f1dcc02a410 comp rx=0 tx=0).stop 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 -- 172.21.15.137:0/1355467259 shutdown_connections 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 --2- 172.21.15.137:0/1355467259 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 --2- 172.21.15.137:0/1355467259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077340 0x7f1ddc0777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 --2- 172.21.15.137:0/1355467259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc076520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.646+0000 7f1de0c00640 1 -- 172.21.15.137:0/1355467259 >> 172.21.15.137:0/1355467259 conn(0x7f1ddc0fef30 msgr2=0x7f1ddc101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.647+0000 7f1de0c00640 1 -- 172.21.15.137:0/1355467259 shutdown_connections 2024-04-25T02:09:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.647+0000 7f1de0c00640 1 -- 172.21.15.137:0/1355467259 wait complete. 2024-04-25T02:09:48.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 Processor -- start 2024-04-25T02:09:48.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 -- start start 2024-04-25T02:09:48.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 0x7f1ddc19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc1a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc113b90 con 0x7f1ddc077ce0 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc113a10 con 0x7f1ddc076100 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1de0c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc113d10 con 0x7f1ddc077340 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dd9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dd9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 0x7f1ddc19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dd9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58720/0 (socket says 172.21.15.137:58720) 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dd9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 0x7f1ddc19e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37110/0 (socket says 172.21.15.137:37110) 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dd9e00640 1 -- 172.21.15.137:0/918868793 learned_addr learned my addr 172.21.15.137:0/918868793 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.648+0000 7f1dda800640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc1a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 -- 172.21.15.137:0/918868793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 msgr2=0x7f1ddc19e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 0x7f1ddc19e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 -- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 msgr2=0x7f1ddc1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc1a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 -- 172.21.15.137:0/918868793 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc1a5d60 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dda800640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc1a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd9e00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0316a0 tx=0x7f1dcc032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc03f030 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1dcc003d00 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc1a5ff0 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.649+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc035070 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.650+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1a6450 con 0x7f1ddc076100 2024-04-25T02:09:48.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.651+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc110400 con 0x7f1ddc076100 2024-04-25T02:09:48.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.653+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f1dcc042030 con 0x7f1ddc076100 2024-04-25T02:09:48.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.654+0000 7f1dd2a00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 0x7f1dc00a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:48.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.654+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f1dcc0ef9d0 con 0x7f1ddc076100 2024-04-25T02:09:48.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.654+0000 7f1dd9400640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 0x7f1dc00a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:48.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.655+0000 7f1dd9400640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 0x7f1dc00a5360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc19f650 tx=0x7f1dc8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:48.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.658+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f1dcc0bc440 con 0x7f1ddc076100 2024-04-25T02:09:48.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.877+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ddc02d370 con 0x7f1ddc076100 2024-04-25T02:09:48.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.879+0000 7f1dd2a00640 1 -- 172.21.15.137:0/918868793 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23059 (secure 0 0 0) 0x7f1dcc0bbd40 con 0x7f1ddc076100 2024-04-25T02:09:48.888 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:48.888 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":88,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:09:41.978106+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.881+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 msgr2=0x7f1dc00a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.881+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 0x7f1dc00a5360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc19f650 tx=0x7f1dc8005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 msgr2=0x7f1ddc19e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0316a0 tx=0x7f1dcc032d70 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 shutdown_connections 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f1dc00a2ea0 0x7f1dc00a5360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1ddc077ce0 0x7f1ddc1a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ddc077340 0x7f1ddc19e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 --2- 172.21.15.137:0/918868793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ddc076100 0x7f1ddc19e140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:48.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 >> 172.21.15.137:0/918868793 conn(0x7f1ddc0fef30 msgr2=0x7f1ddc100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:48.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 shutdown_connections 2024-04-25T02:09:48.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:48.882+0000 7f1de0c00640 1 -- 172.21.15.137:0/918868793 wait complete. 2024-04-25T02:09:48.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:48.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:48 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:48.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:09:48.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:09:49.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:49.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:49.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.036 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.036 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.036 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:09:49.036 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:49.036 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:48 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 -- 172.21.15.137:0/4136779645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668104b90 msgr2=0x7f0668105010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 --2- 172.21.15.137:0/4136779645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668104b90 0x7f0668105010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0650009900 tx=0x7f065002a410 comp rx=0 tx=0).stop 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 -- 172.21.15.137:0/4136779645 shutdown_connections 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 --2- 172.21.15.137:0/4136779645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668105550 0x7f066810bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 --2- 172.21.15.137:0/4136779645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0668104b90 0x7f0668105010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 --2- 172.21.15.137:0/4136779645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f06681039a0 0x7f0668103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 -- 172.21.15.137:0/4136779645 >> 172.21.15.137:0/4136779645 conn(0x7f06680feef0 msgr2=0x7f0668101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 -- 172.21.15.137:0/4136779645 shutdown_connections 2024-04-25T02:09:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.085+0000 7f066ec00640 1 -- 172.21.15.137:0/4136779645 wait complete. 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.086+0000 7f066ec00640 1 Processor -- start 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.086+0000 7f066ec00640 1 -- start start 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06681039a0 0x7f0668199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668104b90 0x7f066819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f066810f750 con 0x7f0668104b90 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f066810f5d0 con 0x7f0668105550 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066ec00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f066810f8d0 con 0x7f06681039a0 2024-04-25T02:09:49.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f065f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668104b90 0x7f066819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f0667e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06681039a0 0x7f0668199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58750/0 (socket says 172.21.15.137:58750) 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066cc00640 1 -- 172.21.15.137:0/3050275082 learned_addr learned my addr 172.21.15.137:0/3050275082 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066cc00640 1 -- 172.21.15.137:0/3050275082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06681039a0 msgr2=0x7f0668199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.087+0000 7f066cc00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06681039a0 0x7f0668199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066cc00640 1 -- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668104b90 msgr2=0x7f066819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066cc00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668104b90 0x7f066819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066cc00640 1 -- 172.21.15.137:0/3050275082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06681a19e0 con 0x7f0668105550 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066cc00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f066000e9b0 tx=0x7f066000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000cd80 con 0x7f0668105550 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06600035f0 con 0x7f0668105550 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06681a1cd0 con 0x7f0668105550 2024-04-25T02:09:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660010690 con 0x7f0668105550 2024-04-25T02:09:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.088+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681a21a0 con 0x7f0668105550 2024-04-25T02:09:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.089+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066810acc0 con 0x7f0668105550 2024-04-25T02:09:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.091+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f06600037a0 con 0x7f0668105550 2024-04-25T02:09:49.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.092+0000 7f0665600640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 0x7f064c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.093+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f06600cf9c0 con 0x7f0668105550 2024-04-25T02:09:49.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.093+0000 7f0667e00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 0x7f064c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.093+0000 7f0667e00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 0x7f064c0a5360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06681049f0 tx=0x7f0658009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.096+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f066009c360 con 0x7f0668105550 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='client.25387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:49.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:48 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:49.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.311+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f066802d320 con 0x7f0668105550 2024-04-25T02:09:49.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.312+0000 7f0665600640 1 -- 172.21.15.137:0/3050275082 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f066009bc60 con 0x7f0668105550 2024-04-25T02:09:49.320 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:09:49.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 msgr2=0x7f064c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 0x7f064c0a5360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06681049f0 tx=0x7f0658009500 comp rx=0 tx=0).stop 2024-04-25T02:09:49.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 msgr2=0x7f06681a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f066000e9b0 tx=0x7f066000ee70 comp rx=0 tx=0).stop 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 shutdown_connections 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f064c0a2ea0 0x7f064c0a5360 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0668105550 0x7f06681a1370 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0668104b90 0x7f066819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 --2- 172.21.15.137:0/3050275082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06681039a0 0x7f0668199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 >> 172.21.15.137:0/3050275082 conn(0x7f06680feef0 msgr2=0x7f0668107e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 shutdown_connections 2024-04-25T02:09:49.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.314+0000 7f066ec00640 1 -- 172.21.15.137:0/3050275082 wait complete. 2024-04-25T02:09:49.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.511+0000 7f069be00640 1 -- 172.21.15.137:0/329103415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1028c0 msgr2=0x7f069c102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.511+0000 7f069be00640 1 --2- 172.21.15.137:0/329103415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1028c0 0x7f069c102d40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0688009860 tx=0x7f068802a340 comp rx=0 tx=0).stop 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 -- 172.21.15.137:0/329103415 shutdown_connections 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 --2- 172.21.15.137:0/329103415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 0x7f069c109b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 --2- 172.21.15.137:0/329103415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1028c0 0x7f069c102d40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 --2- 172.21.15.137:0/329103415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1016d0 0x7f069c101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 -- 172.21.15.137:0/329103415 >> 172.21.15.137:0/329103415 conn(0x7f069c0fcc40 msgr2=0x7f069c0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 -- 172.21.15.137:0/329103415 shutdown_connections 2024-04-25T02:09:49.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.512+0000 7f069be00640 1 -- 172.21.15.137:0/329103415 wait complete. 2024-04-25T02:09:49.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 Processor -- start 2024-04-25T02:09:49.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 -- start start 2024-04-25T02:09:49.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 0x7f069c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 0x7f069c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10d410 con 0x7f069c1028c0 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10d290 con 0x7f069c103280 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f069c10d590 con 0x7f069c1016d0 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 0x7f069c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41324/0 (socket says 172.21.15.137:41324) 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069a000640 1 -- 172.21.15.137:0/2514607602 learned_addr learned my addr 172.21.15.137:0/2514607602 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.513+0000 7f069b400640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 0x7f069c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 -- 172.21.15.137:0/2514607602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 msgr2=0x7f069c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 0x7f069c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 -- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 msgr2=0x7f069c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 -- 172.21.15.137:0/2514607602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c19f620 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069a000640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069aa00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 0x7f069c197a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f069c102720 tx=0x7f068c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c004440 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f068c00cdc0 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c0196e0 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.514+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c19f910 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.515+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c19feb0 con 0x7f069c1016d0 2024-04-25T02:09:49.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.516+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c1089f0 con 0x7f069c1016d0 2024-04-25T02:09:49.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.518+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f068c0037f0 con 0x7f069c1016d0 2024-04-25T02:09:49.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.519+0000 7f0693400640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 0x7f06800a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.520+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f068c0cfa20 con 0x7f069c1016d0 2024-04-25T02:09:49.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.520+0000 7f069a000640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 0x7f06800a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.520+0000 7f069a000640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 0x7f06800a5360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0688030480 tx=0x7f06880305c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.521+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f068c009510 con 0x7f069c1016d0 2024-04-25T02:09:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.729+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f069c062340 con 0x7f069c1016d0 2024-04-25T02:09:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.729+0000 7f0693400640 1 -- 172.21.15.137:0/2514607602 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f068c0035f0 con 0x7f069c1016d0 2024-04-25T02:09:49.737 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 msgr2=0x7f06800a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 0x7f06800a5360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0688030480 tx=0x7f06880305c0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 msgr2=0x7f069c197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 0x7f069c197a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f069c102720 tx=0x7f068c00ee50 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 shutdown_connections 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f06800a2ea0 0x7f06800a5360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f069c103280 0x7f069c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f069c1028c0 0x7f069c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 --2- 172.21.15.137:0/2514607602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f069c1016d0 0x7f069c197a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.733+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 >> 172.21.15.137:0/2514607602 conn(0x7f069c0fcc40 msgr2=0x7f069c105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.734+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 shutdown_connections 2024-04-25T02:09:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.734+0000 7f069be00640 1 -- 172.21.15.137:0/2514607602 wait complete. 2024-04-25T02:09:49.760 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 -- 172.21.15.137:0/885789803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 msgr2=0x7f9fc010d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 --2- 172.21.15.137:0/885789803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc010d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9fac009900 tx=0x7f9fac02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 -- 172.21.15.137:0/885789803 shutdown_connections 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 --2- 172.21.15.137:0/885789803 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc0110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 --2- 172.21.15.137:0/885789803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc010d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 --2- 172.21.15.137:0/885789803 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc0100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 -- 172.21.15.137:0/885789803 >> 172.21.15.137:0/885789803 conn(0x7f9fc00fbfc0 msgr2=0x7f9fc00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:49.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 -- 172.21.15.137:0/885789803 shutdown_connections 2024-04-25T02:09:49.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.926+0000 7f9fc6400640 1 -- 172.21.15.137:0/885789803 wait complete. 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 Processor -- start 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 -- start start 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc0113d60 con 0x7f9fc010df60 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc0113be0 con 0x7f9fc0100d60 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.927+0000 7f9fc6400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc0113ee0 con 0x7f9fc01003b0 2024-04-25T02:09:49.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:37168/0 (socket says 172.21.15.137:37168) 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 -- 172.21.15.137:0/4175797493 learned_addr learned my addr 172.21.15.137:0/4175797493 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fbfe00640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 -- 172.21.15.137:0/4175797493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 msgr2=0x7f9fc019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 -- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 msgr2=0x7f9fc019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5000640 1 -- 172.21.15.137:0/4175797493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc019f230 con 0x7f9fc01003b0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.928+0000 7f9fc5a00640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fc5000640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e9f0 tx=0x7f9fb400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400cd80 con 0x7f9fc01003b0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fb4010930 con 0x7f9fc01003b0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc019f520 con 0x7f9fc01003b0 2024-04-25T02:09:49.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4018b00 con 0x7f9fc01003b0 2024-04-25T02:09:49.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.929+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc01a6db0 con 0x7f9fc01003b0 2024-04-25T02:09:49.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.930+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc0068480 con 0x7f9fc01003b0 2024-04-25T02:09:49.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.932+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f9fb4018ca0 con 0x7f9fc01003b0 2024-04-25T02:09:49.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.933+0000 7f9fbd600640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 0x7f9fa80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:49.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.934+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9fb40cfe70 con 0x7f9fc01003b0 2024-04-25T02:09:49.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.934+0000 7f9fbfe00640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 0x7f9fa80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:49.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.934+0000 7f9fbfe00640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 0x7f9fa80a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fac000c00 tx=0x7f9fac005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:49.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:49.936+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9fb409c1c0 con 0x7f9fc01003b0 2024-04-25T02:09:50.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:09:50.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-25T02:09:50.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/918868793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:50.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:49 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3050275082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/918868793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:50.144 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:49 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3050275082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:50.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.140+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9fc0109060 con 0x7f9fc01003b0 2024-04-25T02:09:50.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.141+0000 7f9fbd600640 1 -- 172.21.15.137:0/4175797493 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f9fb40a04c0 con 0x7f9fc01003b0 2024-04-25T02:09:50.149 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 msgr2=0x7f9fa80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 0x7f9fa80a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fac000c00 tx=0x7f9fac005e80 comp rx=0 tx=0).stop 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 msgr2=0x7f9fc019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e9f0 tx=0x7f9fb400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 shutdown_connections 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9fa80a2e20 0x7f9fa80a52e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fc010df60 0x7f9fc019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9fc0100d60 0x7f9fc019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 --2- 172.21.15.137:0/4175797493 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9fc01003b0 0x7f9fc019a240 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 >> 172.21.15.137:0/4175797493 conn(0x7f9fc00fbfc0 msgr2=0x7f9fc010f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 shutdown_connections 2024-04-25T02:09:50.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.144+0000 7f9fc6400640 1 -- 172.21.15.137:0/4175797493 wait complete. 2024-04-25T02:09:50.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi137:/etc/ceph/ceph.conf 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi163:/etc/ceph/ceph.conf 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi174:/etc/ceph/ceph.conf 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: Updating smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/918868793' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:50.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:49 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3050275082' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 -- 172.21.15.137:0/3075614116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20101f40 msgr2=0x7f4c2010e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 --2- 172.21.15.137:0/3075614116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20101f40 0x7f4c2010e400 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009cd0 tx=0x7f4c1802a8e0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 -- 172.21.15.137:0/3075614116 shutdown_connections 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 --2- 172.21.15.137:0/3075614116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20101f40 0x7f4c2010e400 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 --2- 172.21.15.137:0/3075614116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 --2- 172.21.15.137:0/3075614116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20107640 0x7f4c20107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 -- 172.21.15.137:0/3075614116 >> 172.21.15.137:0/3075614116 conn(0x7f4c200fd070 msgr2=0x7f4c200ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 -- 172.21.15.137:0/3075614116 shutdown_connections 2024-04-25T02:09:50.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.330+0000 7f4c25600640 1 -- 172.21.15.137:0/3075614116 wait complete. 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 Processor -- start 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 -- start start 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20101f40 0x7f4c201983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20107640 0x7f4c2019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.331+0000 7f4c25600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20111a60 con 0x7f4c20101580 2024-04-25T02:09:50.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c25600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201118e0 con 0x7f4c20101f40 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c25600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20111be0 con 0x7f4c20107640 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41360/0 (socket says 172.21.15.137:41360) 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 -- 172.21.15.137:0/3867524279 learned_addr learned my addr 172.21.15.137:0/3867524279 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c24c00640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20107640 0x7f4c2019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1f400640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20101f40 0x7f4c201983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 -- 172.21.15.137:0/3867524279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20107640 msgr2=0x7f4c2019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20107640 0x7f4c2019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 -- 172.21.15.137:0/3867524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20101f40 msgr2=0x7f4c201983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20101f40 0x7f4c201983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 -- 172.21.15.137:0/3867524279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2019ce90 con 0x7f4c20101580 2024-04-25T02:09:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.332+0000 7f4c1fe00640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000e9f0 tx=0x7f4c1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.333+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000cd80 con 0x7f4c20101580 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.333+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2019d180 con 0x7f4c20101580 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.333+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4c10005520 con 0x7f4c20101580 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.333+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10018650 con 0x7f4c20101580 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.333+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201a4a10 con 0x7f4c20101580 2024-04-25T02:09:50.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.334+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c20068480 con 0x7f4c20101580 2024-04-25T02:09:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.336+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f4c100046c0 con 0x7f4c20101580 2024-04-25T02:09:50.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.337+0000 7f4c1cc00640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 0x7f4c040a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.338+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4c100cfc50 con 0x7f4c20101580 2024-04-25T02:09:50.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.338+0000 7f4c1f400640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 0x7f4c040a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.338+0000 7f4c1f400640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 0x7f4c040a52e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c20106350 tx=0x7f4c0c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.342+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f4c1009c5f0 con 0x7f4c20101580 2024-04-25T02:09:50.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.586+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c201991f0 con 0x7f4c20101580 2024-04-25T02:09:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.588+0000 7f4c1cc00640 1 -- 172.21.15.137:0/3867524279 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11884 (secure 0 0 0) 0x7f4c1009bef0 con 0x7f4c20101580 2024-04-25T02:09:50.596 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:50.596 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:09:41.384129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24559,24538]},"id":1}]} 2024-04-25T02:09:50.596 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 23 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 msgr2=0x7f4c040a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 0x7f4c040a52e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c20106350 tx=0x7f4c0c005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 msgr2=0x7f4c20197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000e9f0 tx=0x7f4c1000edf0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 shutdown_connections 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f4c040a2e20 0x7f4c040a52e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c20107640 0x7f4c2019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c20101f40 0x7f4c201983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 --2- 172.21.15.137:0/3867524279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c20101580 0x7f4c20197ea0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 >> 172.21.15.137:0/3867524279 conn(0x7f4c200fd070 msgr2=0x7f4c200fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 shutdown_connections 2024-04-25T02:09:50.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.591+0000 7f4c25600640 1 -- 172.21.15.137:0/3867524279 wait complete. 2024-04-25T02:09:50.619 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 -- 172.21.15.137:0/566689660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c441125c0 msgr2=0x7f8c441149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 --2- 172.21.15.137:0/566689660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c441125c0 0x7f8c441149b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009ca0 tx=0x7f8c3c02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 -- 172.21.15.137:0/566689660 shutdown_connections 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 --2- 172.21.15.137:0/566689660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c441125c0 0x7f8c441149b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 --2- 172.21.15.137:0/566689660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c44076590 0x7f8c44112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 --2- 172.21.15.137:0/566689660 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44075c70 0x7f8c44076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 -- 172.21.15.137:0/566689660 >> 172.21.15.137:0/566689660 conn(0x7f8c440ff3f0 msgr2=0x7f8c44101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 -- 172.21.15.137:0/566689660 shutdown_connections 2024-04-25T02:09:50.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.804+0000 7f8c4b800640 1 -- 172.21.15.137:0/566689660 wait complete. 2024-04-25T02:09:50.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.805+0000 7f8c4b800640 1 Processor -- start 2024-04-25T02:09:50.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.805+0000 7f8c4b800640 1 -- start start 2024-04-25T02:09:50.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44076590 0x7f8c4419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c44118240 con 0x7f8c44075c70 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8c441180c0 con 0x7f8c441125c0 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c4b800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c441183c0 con 0x7f8c44076590 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c48e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c49800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c49800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:58838/0 (socket says 172.21.15.137:58838) 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c48e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41382/0 (socket says 172.21.15.137:41382) 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c49800640 1 -- 172.21.15.137:0/1326464549 learned_addr learned my addr 172.21.15.137:0/1326464549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.806+0000 7f8c43e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44076590 0x7f8c4419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 -- 172.21.15.137:0/1326464549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44076590 msgr2=0x7f8c4419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44076590 0x7f8c4419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 -- 172.21.15.137:0/1326464549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 msgr2=0x7f8c441a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 -- 172.21.15.137:0/1326464549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c441a3710 con 0x7f8c44075c70 2024-04-25T02:09:50.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c49800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c48e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800e9f0 tx=0x7f8c3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800ccc0 con 0x7f8c44075c70 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c441a3a00 con 0x7f8c44075c70 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c38010930 con 0x7f8c44075c70 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c380189f0 con 0x7f8c44075c70 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.807+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c441ab290 con 0x7f8c44075c70 2024-04-25T02:09:50.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.809+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c44068560 con 0x7f8c44075c70 2024-04-25T02:09:50.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.811+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f8c38010ae0 con 0x7f8c44075c70 2024-04-25T02:09:50.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.812+0000 7f8c41600640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 0x7f8c2c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:50.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.813+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8c380cfee0 con 0x7f8c44075c70 2024-04-25T02:09:50.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.813+0000 7f8c43e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 0x7f8c2c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:50.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.814+0000 7f8c43e00640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 0x7f8c2c0a52e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c300095f0 tx=0x7f8c30005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:50.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:50.814+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f8c3809c230 con 0x7f8c44075c70 2024-04-25T02:09:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.002+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c4410d780 con 0x7f8c44075c70 2024-04-25T02:09:51.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.004+0000 7f8c41600640 1 -- 172.21.15.137:0/1326464549 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23059 (secure 0 0 0) 0x7f8c380a0530 con 0x7f8c44075c70 2024-04-25T02:09:51.012 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:09:51.012 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":88,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:09:41.978106+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 msgr2=0x7f8c2c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 0x7f8c2c0a52e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c300095f0 tx=0x7f8c30005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 msgr2=0x7f8c4419e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800e9f0 tx=0x7f8c3800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 shutdown_connections 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c2c0a2e20 0x7f8c2c0a52e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c441125c0 0x7f8c441a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c44076590 0x7f8c4419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 --2- 172.21.15.137:0/1326464549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c44075c70 0x7f8c4419e720 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.006+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 >> 172.21.15.137:0/1326464549 conn(0x7f8c440ff3f0 msgr2=0x7f8c441140c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.007+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 shutdown_connections 2024-04-25T02:09:51.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.007+0000 7f8c4b800640 1 -- 172.21.15.137:0/1326464549 wait complete. 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2514607602' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4175797493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:51.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:51.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:50 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3867524279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.033 DEBUG:tasks.fwd_scrub:Yielding 2024-04-25T02:09:51.033 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:09:51.042 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:09:51.042 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:51.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-25T02:09:51.043 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-25T02:09:51.043 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T02:09:51.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:09:51.043 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2514607602' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4175797493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:50 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3867524279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: Updating smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2514607602' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4175797493' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:09:51.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:09:51.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:09:51.179 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:50 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3867524279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.215+0000 7f63c5a00640 1 -- 172.21.15.137:0/902713328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0107940 msgr2=0x7f63c0107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.215+0000 7f63c5a00640 1 --2- 172.21.15.137:0/902713328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0107940 0x7f63c0107d20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009930 tx=0x7f63b002a4d0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 -- 172.21.15.137:0/902713328 shutdown_connections 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 --2- 172.21.15.137:0/902713328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 0x7f63c010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 --2- 172.21.15.137:0/902713328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0069f70 0x7f63c006a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 --2- 172.21.15.137:0/902713328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0107940 0x7f63c0107d20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 -- 172.21.15.137:0/902713328 >> 172.21.15.137:0/902713328 conn(0x7f63c0076440 msgr2=0x7f63c0076850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 -- 172.21.15.137:0/902713328 shutdown_connections 2024-04-25T02:09:51.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.216+0000 7f63c5a00640 1 -- 172.21.15.137:0/902713328 wait complete. 2024-04-25T02:09:51.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 Processor -- start 2024-04-25T02:09:51.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 -- start start 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 0x7f63c0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0107940 0x7f63c019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63c0111c90 con 0x7f63c006a930 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f63c0111b10 con 0x7f63c0069f70 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.217+0000 7f63c5a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63c0111e10 con 0x7f63c0107940 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63b7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 0x7f63c0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51660/0 (socket says 172.21.15.137:51660) 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 -- 172.21.15.137:0/2690244713 learned_addr learned my addr 172.21.15.137:0/2690244713 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bf400640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0107940 0x7f63c019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 -- 172.21.15.137:0/2690244713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0107940 msgr2=0x7f63c019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0107940 0x7f63c019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 -- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 msgr2=0x7f63c0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 0x7f63c0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 -- 172.21.15.137:0/2690244713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c019cfb0 con 0x7f63c0069f70 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.218+0000 7f63bea00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63b002a9f0 tx=0x7f63b0032910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.219+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b003f030 con 0x7f63c0069f70 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.219+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c019d240 con 0x7f63c0069f70 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.219+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63b0032d40 con 0x7f63c0069f70 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.219+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0035070 con 0x7f63c0069f70 2024-04-25T02:09:51.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.219+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c01a4b30 con 0x7f63c0069f70 2024-04-25T02:09:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.220+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c0102e50 con 0x7f63c0069f70 2024-04-25T02:09:51.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.223+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f63b0042030 con 0x7f63c0069f70 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 -- 172.21.15.137:0/365600231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 msgr2=0x7f26b0102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 --2- 172.21.15.137:0/365600231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0102da0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009900 tx=0x7f26a002a510 comp rx=0 tx=0).stop 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 -- 172.21.15.137:0/365600231 shutdown_connections 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 --2- 172.21.15.137:0/365600231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b010bd00 0x7f26b010e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 --2- 172.21.15.137:0/365600231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b01032e0 0x7f26b010b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f63b7400640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 0x7f63a40a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 --2- 172.21.15.137:0/365600231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0102da0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 -- 172.21.15.137:0/365600231 >> 172.21.15.137:0/365600231 conn(0x7f26b0077740 msgr2=0x7f26b0077b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 -- 172.21.15.137:0/365600231 shutdown_connections 2024-04-25T02:09:51.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f63b00ef920 con 0x7f63c0069f70 2024-04-25T02:09:51.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f26b6000640 1 -- 172.21.15.137:0/365600231 wait complete. 2024-04-25T02:09:51.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.224+0000 7f63b7e00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 0x7f63a40a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.225+0000 7f63b7e00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 0x7f63a40a5380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63c0106da0 tx=0x7f63a8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.225+0000 7f26b6000640 1 Processor -- start 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.225+0000 7f26b6000640 1 -- start start 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 0x7f26b0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 0x7f26b0101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0111c70 con 0x7f26b01029c0 2024-04-25T02:09:51.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f63b00bbd40 con 0x7f63c0069f70 2024-04-25T02:09:51.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0111af0 con 0x7f26b010bd00 2024-04-25T02:09:51.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26b6000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0111df0 con 0x7f26b01032e0 2024-04-25T02:09:51.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26af400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26af400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55504/0 (socket says 172.21.15.137:55504) 2024-04-25T02:09:51.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26af400640 1 -- 172.21.15.137:0/3925864105 learned_addr learned my addr 172.21.15.137:0/3925864105 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26aea00640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 0x7f26b0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.226+0000 7f26afe00640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 0x7f26b0101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 -- 172.21.15.137:0/3925864105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 msgr2=0x7f26b0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 0x7f26b0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 -- 172.21.15.137:0/3925864105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 msgr2=0x7f26b0101090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 0x7f26b0101090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 -- 172.21.15.137:0/3925864105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b01a6590 con 0x7f26b01029c0 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26afe00640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 0x7f26b0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26aea00640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 0x7f26b0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26af400640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f26a0004770 tx=0x7f26a0032970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26a7e00640 1 -- 172.21.15.137:0/3925864105 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a003f030 con 0x7f26b01029c0 2024-04-25T02:09:51.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b01a6820 con 0x7f26b01029c0 2024-04-25T02:09:51.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26a7e00640 1 -- 172.21.15.137:0/3925864105 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26a0032d70 con 0x7f26b01029c0 2024-04-25T02:09:51.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26a7e00640 1 -- 172.21.15.137:0/3925864105 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0035070 con 0x7f26b01029c0 2024-04-25T02:09:51.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.227+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b01a6d10 con 0x7f26b01029c0 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.230+0000 7f26b8e0d740 1 Processor -- start 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 -- start start 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26a7e00640 1 -- 172.21.15.137:0/3925864105 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f26a0042030 con 0x7f26b01029c0 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f9454cd50 0x561f9454f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f944a0f40 con 0x561f9454cd50 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x561f944a6190 con 0x561f94541d60 2024-04-25T02:09:51.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561f9444ea10 con 0x561f94542680 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26afe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26afe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51682/0 (socket says 172.21.15.137:51682) 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26afe00640 1 -- 172.21.15.137:0/393088798 learned_addr learned my addr 172.21.15.137:0/393088798 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26aea00640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f9454cd50 0x561f9454f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.231+0000 7f26af400640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 -- 172.21.15.137:0/393088798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 msgr2=0x561f9454c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 -- 172.21.15.137:0/393088798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f9454cd50 msgr2=0x561f9454f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f9454cd50 0x561f9454f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 -- 172.21.15.137:0/393088798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f942827e0 con 0x561f94541d60 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26af400640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26afe00640 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26a8011790 tx=0x7f26a8011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9045482927f63661 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f269be00640 1 -- 172.21.15.137:0/393088798 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8003c30 con 0x561f94541d60 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f269be00640 1 -- 172.21.15.137:0/393088798 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26a8003dd0 con 0x561f94541d60 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f269be00640 1 -- 172.21.15.137:0/393088798 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8019600 con 0x561f94541d60 2024-04-25T02:09:51.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.232+0000 7f26a7e00640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 0x7f26940a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26a7e00640 1 -- 172.21.15.137:0/3925864105 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f26a00ef8c0 con 0x7f26b01029c0 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26af400640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 0x7f26940a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 -- 172.21.15.137:0/393088798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 msgr2=0x561f94542140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26a8011790 tx=0x7f26a8011c50 comp rx=0 tx=0).stop 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 -- 172.21.15.137:0/393088798 shutdown_connections 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f9454cd50 0x561f9454f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/393088798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94541d60 0x561f94542140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 -- 172.21.15.137:0/393088798 >> 172.21.15.137:0/393088798 conn(0x561f9453e080 msgr2=0x561f9453e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26b8e0d740 1 -- 172.21.15.137:0/393088798 shutdown_connections 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.233+0000 7f26af400640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 0x7f26940a52e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f26a00ecec0 tx=0x7f26a002a510 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.234+0000 7f26b8e0d740 1 -- 172.21.15.137:0/393088798 wait complete. 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.234+0000 7f26b8e0d740 1 -- start start 2024-04-25T02:09:51.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.234+0000 7f26b8e0d740 1 Processor -- start 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f9454a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561f94461e70 con 0x561f94541d60 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x561f944a2150 con 0x561f9454cd50 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561f9454fbe0 con 0x561f94542680 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26b8e0d740 10 client.0 _ll_register_callbacks cb 0x561f9449d1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55520/0 (socket says 172.21.15.137:55520) 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 -- 172.21.15.137:0/709563824 learned_addr learned my addr 172.21.15.137:0/709563824 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26aea00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f9454a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 -- 172.21.15.137:0/709563824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 msgr2=0x561f9454a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 -- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 msgr2=0x561f9454a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f9454a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26afe00640 1 -- 172.21.15.137:0/709563824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f942e2f70 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.235+0000 7f26aea00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f26afe00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26a800a010 tx=0x7f26a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90660563f26e77c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f2698c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a802e060 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f26a8004350 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a8003dd0 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f26a801f040 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f26b8e0d740 10 client.15327 fetch_fsmap learned FSMap version 23 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.236+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561f9417a170 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26a8003dd0 con 0x561f94541d60 2024-04-25T02:09:51.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f26a8018070 con 0x561f94541d60 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 10 client.15327 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 10 client.15327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 20 client.15327 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f9455cf90 0x561f9455f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 4 client.15327 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f944b36d0 con 0x561f9455cf90 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.237+0000 7f26aea00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f9455cf90 0x561f9455f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.238+0000 7f26aea00640 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f9455cf90 0x561f9455f380 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa8476cf1332228 server_cookie=1c347db1837e8864 in_seq=0 out_seq=0 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.238+0000 7f2698c00640 10 client.15327 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f2698c00640 1 -- 172.21.15.137:0/709563824 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561f944b36d0 con 0x561f9455cf90 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f2698c00640 10 client.15327 handle_command_reply: tid=0 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 client.15327 shutdown 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 msgr2=0x561f94549ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26a800a010 tx=0x7f26a80046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 shutdown_connections 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f9455cf90 0x561f9455f380 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f9454a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f9454a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/709563824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94549ce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f2698c00640 0 client.15327 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 >> 172.21.15.137:0/709563824 conn(0x561f9453e080 msgr2=0x561f94543e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 shutdown_connections 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 1 -- 172.21.15.137:0/709563824 wait complete. 2024-04-25T02:09:51.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.239+0000 7f26b8e0d740 20 client.15327 trim_cache size 0 max 16384 2024-04-25T02:09:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 Processor -- start 2024-04-25T02:09:51.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 -- start start 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94558920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f94565050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01b2000 con 0x561f94541d60 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01af8d0 con 0x561f9454cd50 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01ad720 con 0x561f94542680 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26aea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26aea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41860/0 (socket says 172.21.15.137:41860) 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26aea00640 1 -- 172.21.15.137:0/2257030983 learned_addr learned my addr 172.21.15.137:0/2257030983 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.259+0000 7f26afe00640 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94558920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 -- 172.21.15.137:0/2257030983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 msgr2=0x561f94565050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f94565050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 -- 172.21.15.137:0/2257030983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 msgr2=0x561f94558920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94558920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 -- 172.21.15.137:0/2257030983 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f945458e0 con 0x561f94542680 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f26aea00640 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x561f9453f210 tx=0x7f269c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19f357eb067e50a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f269b400640 1 -- 172.21.15.137:0/2257030983 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c00fc20 con 0x561f94542680 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f269b400640 1 -- 172.21.15.137:0/2257030983 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f269c00fdc0 con 0x561f94542680 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.260+0000 7f269b400640 1 -- 172.21.15.137:0/2257030983 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c004a00 con 0x561f94542680 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 -- 172.21.15.137:0/2257030983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 msgr2=0x561f94564b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x561f9453f210 tx=0x7f269c005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 -- 172.21.15.137:0/2257030983 shutdown_connections 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f9454cd50 0x561f94565050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f94542680 0x561f94564b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/2257030983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94558920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 -- 172.21.15.137:0/2257030983 >> 172.21.15.137:0/2257030983 conn(0x561f9453e080 msgr2=0x561f9453d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 -- 172.21.15.137:0/2257030983 shutdown_connections 2024-04-25T02:09:51.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.261+0000 7f26b8e0d740 1 -- 172.21.15.137:0/2257030983 wait complete. 2024-04-25T02:09:51.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.262+0000 7f26b8e0d740 1 -- start start 2024-04-25T02:09:51.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.262+0000 7f26b8e0d740 1 Processor -- start 2024-04-25T02:09:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.262+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.262+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94542680 0x561f94555370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.262+0000 7f26b8e0d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f9454cd50 0x561f94551f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01add90 con 0x561f94541d60 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01af200 con 0x561f94542680 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26b8e0d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01ae460 con 0x561f9454cd50 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26b8e0d740 10 client.0 _ll_register_callbacks cb 0x7f269c009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55536/0 (socket says 172.21.15.137:55536) 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 -- 172.21.15.137:0/3393573138 learned_addr learned my addr 172.21.15.137:0/3393573138 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26aea00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94542680 0x561f94555370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f9454cd50 0x561f94551f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 -- 172.21.15.137:0/3393573138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f9454cd50 msgr2=0x561f94551f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f9454cd50 0x561f94551f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 -- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94542680 msgr2=0x561f94555370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94542680 0x561f94555370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.263+0000 7f26afe00640 1 -- 172.21.15.137:0/3393573138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f945527c0 con 0x561f94541d60 2024-04-25T02:09:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f26afe00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26a8004810 tx=0x7f26a80114d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f3245425e24107 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a802e040 con 0x561f94541d60 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269c00fdc0 con 0x561f94541d60 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f26a8004c00 con 0x561f94541d60 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f26a8044050 con 0x561f94541d60 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f26b8e0d740 10 client.15333 fetch_fsmap learned FSMap version 23 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561f945c4030 con 0x561f94541d60 2024-04-25T02:09:51.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f269c00fdc0 con 0x561f94541d60 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.264+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f26a8018020 con 0x561f94541d60 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 10 client.15333 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 10 client.15333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 20 client.15333 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f945c4750 0x561f945c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 4 client.15333 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T02:09:51.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561f944ada20 con 0x561f945c4750 2024-04-25T02:09:51.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26aea00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f945c4750 0x561f945c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f26aea00640 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f945c4750 0x561f945c6b70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82656a5a96bf5ef5 server_cookie=dc7ffb42ba955d09 in_seq=0 out_seq=0 2024-04-25T02:09:51.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.265+0000 7f2698c00640 10 client.15333 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f2698c00640 1 -- 172.21.15.137:0/3393573138 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561f944ada20 con 0x561f945c4750 2024-04-25T02:09:51.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f2698c00640 10 client.15333 handle_command_reply: tid=0 2024-04-25T02:09:51.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 client.15333 shutdown 2024-04-25T02:09:51.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 msgr2=0x561f94554e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f26a8004810 tx=0x7f26a80114d0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 shutdown_connections 2024-04-25T02:09:51.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x561f945c4750 0x561f945c6b70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561f9454cd50 0x561f94551f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561f94542680 0x561f94555370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 --2- 172.21.15.137:0/3393573138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561f94541d60 0x561f94554e30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 >> 172.21.15.137:0/3393573138 conn(0x561f9453e080 msgr2=0x561f945434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f2698c00640 0 client.15333 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 shutdown_connections 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 1 -- 172.21.15.137:0/3393573138 wait complete. 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.267+0000 7f26b8e0d740 20 client.15333 trim_cache size 0 max 16384 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-25T02:09:51.283 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "6fce4711-3dac-45dc-ad6a-6d823ccc0759", 2024-04-25T02:09:51.284 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-25T02:09:51.284 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:51.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 msgr2=0x7f26940a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 0x7f26940a52e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f26a00ecec0 tx=0x7f26a002a510 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 msgr2=0x7f26b0100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f26a0004770 tx=0x7f26a0032970 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 shutdown_connections 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f26940a2e20 0x7f26940a52e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26b010bd00 0x7f26b0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26b01032e0 0x7f26b0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 --2- 172.21.15.137:0/3925864105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b01029c0 0x7f26b0100610 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 >> 172.21.15.137:0/3925864105 conn(0x7f26b0077740 msgr2=0x7f26b00fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 shutdown_connections 2024-04-25T02:09:51.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.268+0000 7f26b6000640 1 -- 172.21.15.137:0/3925864105 wait complete. 2024-04-25T02:09:51.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:09:51.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:09:51.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.467+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f63c00ffb30 con 0x7f63a40a2ec0 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 -- 172.21.15.137:0/540192876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 msgr2=0x7f9dd0106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 --2- 172.21.15.137:0/540192876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd0106990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009900 tx=0x7f9dc002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 -- 172.21.15.137:0/540192876 shutdown_connections 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 --2- 172.21.15.137:0/540192876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd0100eb0 0x7f9dd010d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 --2- 172.21.15.137:0/540192876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd01004f0 0x7f9dd0100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 --2- 172.21.15.137:0/540192876 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd0106990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 -- 172.21.15.137:0/540192876 >> 172.21.15.137:0/540192876 conn(0x7f9dd00fbfc0 msgr2=0x7f9dd00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 -- 172.21.15.137:0/540192876 shutdown_connections 2024-04-25T02:09:51.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.482+0000 7f9dd5600640 1 -- 172.21.15.137:0/540192876 wait complete. 2024-04-25T02:09:51.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.483+0000 7f9dd5600640 1 Processor -- start 2024-04-25T02:09:51.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.483+0000 7f9dd5600640 1 -- start start 2024-04-25T02:09:51.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.483+0000 7f9dd5600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd5600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 0x7f9dd019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd5600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd5600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0110a30 con 0x7f9dd01065b0 2024-04-25T02:09:51.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd5600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01108b0 con 0x7f9dd01004f0 2024-04-25T02:09:51.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd5600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0110bb0 con 0x7f9dd0100eb0 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 0x7f9dd019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd4c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51730/0 (socket says 172.21.15.137:51730) 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dcfe00640 1 -- 172.21.15.137:0/3401205431 learned_addr learned my addr 172.21.15.137:0/3401205431 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 -- 172.21.15.137:0/3401205431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 msgr2=0x7f9dd019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 -- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 msgr2=0x7f9dd019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dc7400640 1 -- 172.21.15.137:0/3401205431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd019f100 con 0x7f9dd0100eb0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.484+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dc7400640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 0x7f9dd019a650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e9f0 tx=0x7f9db800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dcd600640 1 -- 172.21.15.137:0/3401205431 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db800ccc0 con 0x7f9dd0100eb0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd019f3f0 con 0x7f9dd0100eb0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dcd600640 1 -- 172.21.15.137:0/3401205431 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9db8005020 con 0x7f9dd0100eb0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dcd600640 1 -- 172.21.15.137:0/3401205431 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8004b40 con 0x7f9dd0100eb0 2024-04-25T02:09:51.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.485+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01a6c80 con 0x7f9dd0100eb0 2024-04-25T02:09:51.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.488+0000 7f9dd9968740 1 Processor -- start 2024-04-25T02:09:51.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 -- start start 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 0x55debac5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 0x55debac5e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55debabb5560 con 0x55debac5c1d0 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55debab5d930 con 0x55debac51b00 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd9968740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55debabb1520 con 0x55debac511e0 2024-04-25T02:09:51.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dcd600640 1 -- 172.21.15.137:0/3401205431 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f9db8004ce0 con 0x7f9dd0100eb0 2024-04-25T02:09:51.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd4c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 0x55debac5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd4c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41884/0 (socket says 172.21.15.137:41884) 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.489+0000 7f9dd4c00640 1 -- 172.21.15.137:0/1357569683 learned_addr learned my addr 172.21.15.137:0/1357569683 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dc7400640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 0x55debac5e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 -- 172.21.15.137:0/1357569683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 msgr2=0x55debac5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 0x55debac5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 -- 172.21.15.137:0/1357569683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 msgr2=0x55debac5e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 0x55debac5e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 -- 172.21.15.137:0/1357569683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deba9937d0 con 0x55debac511e0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 0x55debac5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dc7400640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 0x55debac5e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.490+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80117e0 tx=0x7f9dc8011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9184ded88e7394e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dc5200640 1 -- 172.21.15.137:0/1357569683 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8011310 con 0x55debac511e0 2024-04-25T02:09:51.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dc5200640 1 -- 172.21.15.137:0/1357569683 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dc800f9a0 con 0x55debac511e0 2024-04-25T02:09:51.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dc5200640 1 -- 172.21.15.137:0/1357569683 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004690 con 0x55debac511e0 2024-04-25T02:09:51.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dcd600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 0x7f9db40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dd9968740 1 -- 172.21.15.137:0/1357569683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 msgr2=0x55debac515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.491+0000 7f9dd9968740 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80117e0 tx=0x7f9dc8011ca0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dcd600640 1 -- 172.21.15.137:0/3401205431 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9db80cf6c0 con 0x7f9dd0100eb0 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 0x7f9db40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dd9968740 1 -- 172.21.15.137:0/1357569683 shutdown_connections 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dd9968740 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac5c1d0 0x55debac5e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dd9968740 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac51b00 0x55debac5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dd9968740 1 --2- 172.21.15.137:0/1357569683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac515c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.492+0000 7f9dd9968740 1 -- 172.21.15.137:0/1357569683 >> 172.21.15.137:0/1357569683 conn(0x55debac4d500 msgr2=0x55debac4d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.493+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 0x7f9db40a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0031580 tx=0x7f9dc00046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.493+0000 7f9dd9968740 1 -- 172.21.15.137:0/1357569683 shutdown_connections 2024-04-25T02:09:51.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.493+0000 7f9dd9968740 1 -- 172.21.15.137:0/1357569683 wait complete. 2024-04-25T02:09:51.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.494+0000 7f9dd9968740 1 -- start start 2024-04-25T02:09:51.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.494+0000 7f9dd9968740 1 Processor -- start 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.494+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac59670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55debac5efc0 con 0x55debac51b00 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55debab70d90 con 0x55debac5c1d0 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55debac5f140 con 0x55debac511e0 2024-04-25T02:09:51.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd9968740 10 client.0 _ll_register_callbacks cb 0x55debab70780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:51.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:41896/0 (socket says 172.21.15.137:41896) 2024-04-25T02:09:51.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dcfe00640 1 -- 172.21.15.137:0/411870603 learned_addr learned my addr 172.21.15.137:0/411870603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dc7400640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac59670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.495+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 -- 172.21.15.137:0/411870603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 msgr2=0x55debac59130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 -- 172.21.15.137:0/411870603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 msgr2=0x55debac59670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac59670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 -- 172.21.15.137:0/411870603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deba8c93f0 con 0x55debac5c1d0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dc7400640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac59670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000f80 tx=0x7f9dc80113c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33408315d3bade3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.496+0000 7f9dbd600640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc802a060 con 0x55debac5c1d0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc800f9a0 con 0x55debac5c1d0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9dc8004410 con 0x55debac5c1d0 2024-04-25T02:09:51.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9dc8004e50 con 0x55debac5c1d0 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dd9968740 10 client.25427 fetch_fsmap learned FSMap version 23 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55deba8890f0 con 0x55debac5c1d0 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dc800f9a0 con 0x55debac5c1d0 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f9dc8018020 con 0x55debac5c1d0 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dd9968740 10 client.25427 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.497+0000 7f9dd9968740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dd9968740 20 client.25427 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debac6c3a0 0x55debac6e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dd9968740 4 client.25427 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55debabc8d90 con 0x55debac6c3a0 2024-04-25T02:09:51.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debac6c3a0 0x55debac6e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debac6c3a0 0x55debac6e790 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd7dbaba5ce8dd18 server_cookie=23dfb52b58600786 in_seq=0 out_seq=0 2024-04-25T02:09:51.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.498+0000 7f9dbd600640 10 client.25427 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.499+0000 7f9dbd600640 1 -- 172.21.15.137:0/411870603 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55debabc8d90 con 0x55debac6c3a0 2024-04-25T02:09:51.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.499+0000 7f9dbd600640 10 client.25427 handle_command_reply: tid=0 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.499+0000 7f9dd9968740 1 client.25427 shutdown 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 msgr2=0x55debac59bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000f80 tx=0x7f9dc80113c0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 shutdown_connections 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debac6c3a0 0x55debac6e790 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59bb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac59670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 --2- 172.21.15.137:0/411870603 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac59130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dbd600640 0 client.25427 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 >> 172.21.15.137:0/411870603 conn(0x55debac4d500 msgr2=0x55debac4c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 shutdown_connections 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 1 -- 172.21.15.137:0/411870603 wait complete. 2024-04-25T02:09:51.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.500+0000 7f9dd9968740 20 client.25427 trim_cache size 0 max 16384 2024-04-25T02:09:51.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 Processor -- start 2024-04-25T02:09:51.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 -- start start 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac51b00 0x55debac67e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01b1cb0 con 0x55debac511e0 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01af580 con 0x55debac5c1d0 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dd9968740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01ad3d0 con 0x55debac51b00 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55580/0 (socket says 172.21.15.137:55580) 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dcfe00640 1 -- 172.21.15.137:0/3993478705 learned_addr learned my addr 172.21.15.137:0/3993478705 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.522+0000 7f9dc7400640 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac51b00 0x55debac67e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 -- 172.21.15.137:0/3993478705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac51b00 msgr2=0x55debac67e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac51b00 0x55debac67e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 -- 172.21.15.137:0/3993478705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 msgr2=0x55debac59800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 -- 172.21.15.137:0/3993478705 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debac51930 con 0x55debac511e0 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0004770 tx=0x7f9dc0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3d55e820b44329 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dbfe00640 1 -- 172.21.15.137:0/3993478705 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0059070 con 0x55debac511e0 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dbfe00640 1 -- 172.21.15.137:0/3993478705 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dc0031db0 con 0x55debac511e0 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.523+0000 7f9dbfe00640 1 -- 172.21.15.137:0/3993478705 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0035040 con 0x55debac511e0 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 -- 172.21.15.137:0/3993478705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 msgr2=0x55debac4cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0004770 tx=0x7f9dc0040000 comp rx=0 tx=0).stop 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 -- 172.21.15.137:0/3993478705 shutdown_connections 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac59800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac51b00 0x55debac67e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 --2- 172.21.15.137:0/3993478705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac511e0 0x55debac4cf80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 -- 172.21.15.137:0/3993478705 >> 172.21.15.137:0/3993478705 conn(0x55debac4d500 msgr2=0x55debac590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 -- 172.21.15.137:0/3993478705 shutdown_connections 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.524+0000 7f9dd9968740 1 -- 172.21.15.137:0/3993478705 wait complete. 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.525+0000 7f9dd9968740 1 -- start start 2024-04-25T02:09:51.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.525+0000 7f9dd9968740 1 Processor -- start 2024-04-25T02:09:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac64030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac5f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01ada40 con 0x55debac51b00 2024-04-25T02:09:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01aeeb0 con 0x55debac5c1d0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01ae110 con 0x55debac511e0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd9968740 10 client.0 _ll_register_callbacks cb 0x7f9dc800fea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55586/0 (socket says 172.21.15.137:55586) 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 -- 172.21.15.137:0/2703403835 learned_addr learned my addr 172.21.15.137:0/2703403835 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dd4c00640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac5f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac64030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 -- 172.21.15.137:0/2703403835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 msgr2=0x55debac64030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac64030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 -- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 msgr2=0x55debac5f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac5f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.526+0000 7f9dc7400640 1 -- 172.21.15.137:0/2703403835 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55debac5fbe0 con 0x55debac51b00 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dc7400640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e9c0 tx=0x7f9db80096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c3d41f2c28ecf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dbd600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db801c040 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9db80860b0 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc0031db0 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9db809b960 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dd9968740 10 client.15351 fetch_fsmap learned FSMap version 23 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.527+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55debacd2180 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9dc0031db0 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f9db80ccfd0 con 0x55debac51b00 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 10 client.15351 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 10 client.15351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 20 client.15351 populate_metadata read hostname 'smithi137' 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debacd2860 0x55debacd4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 4 client.15351 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:09:51.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55debabc2aa0 con 0x55debacd2860 2024-04-25T02:09:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.528+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debacd2860 0x55debacd4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dcfe00640 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debacd2860 0x55debacd4c80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c951b20d7fbdbf65 server_cookie=d3e9646d2fde385d in_seq=0 out_seq=0 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dbd600640 10 client.15351 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dbd600640 1 -- 172.21.15.137:0/2703403835 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55debabc2aa0 con 0x55debacd2860 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dbd600640 10 client.15351 handle_command_reply: tid=0 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 client.15351 shutdown 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 msgr2=0x55debac64570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e9c0 tx=0x7f9db80096e0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 shutdown_connections 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55debacd2860 0x55debacd4c80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55debac5c1d0 0x55debac5f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55debac51b00 0x55debac64570 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dbd600640 0 client.15351 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 --2- 172.21.15.137:0/2703403835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55debac511e0 0x55debac64030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.529+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 >> 172.21.15.137:0/2703403835 conn(0x55debac4d500 msgr2=0x55debac59980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 shutdown_connections 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd9968740 1 -- 172.21.15.137:0/2703403835 wait complete. 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd9968740 20 client.15351 trim_cache size 0 max 16384 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "6fce4711-3dac-45dc-ad6a-6d823ccc0759": { 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "6fce4711-3dac-45dc-ad6a-6d823ccc0759", 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,force" 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:09:51.541 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:09:51.542 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:09:51.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 msgr2=0x7f9db40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 0x7f9db40a52e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0031580 tx=0x7f9dc00046c0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 msgr2=0x7f9dd019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.530+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 0x7f9dd019a650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e9f0 tx=0x7f9db800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 shutdown_connections 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9db40a2e20 0x7f9db40a52e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dd01065b0 0x7f9dd019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9dd0100eb0 0x7f9dd019a650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 --2- 172.21.15.137:0/3401205431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9dd01004f0 0x7f9dd019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 >> 172.21.15.137:0/3401205431 conn(0x7f9dd00fbfc0 msgr2=0x7f9dd00fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 shutdown_connections 2024-04-25T02:09:51.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.531+0000 7f9dd5600640 1 -- 172.21.15.137:0/3401205431 wait complete. 2024-04-25T02:09:51.557 INFO:tasks.cephfs.filesystem:scrub status for tag:6fce4711-3dac-45dc-ad6a-6d823ccc0759 - {'path': '/', 'tag': '6fce4711-3dac-45dc-ad6a-6d823ccc0759', 'options': 'recursive,force'} 2024-04-25T02:09:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.550+0000 7f63b7400640 1 -- 172.21.15.137:0/2690244713 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f63c00ffb30 con 0x7f63a40a2ec0 2024-04-25T02:09:51.558 INFO:teuthology.orchestra.run.smithi137.stdout:Schedule set for path / 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.552+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 msgr2=0x7f63a40a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.552+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 0x7f63a40a5380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63c0106da0 tx=0x7f63a8005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.552+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 msgr2=0x7f63c0198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.552+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63b002a9f0 tx=0x7f63b0032910 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 shutdown_connections 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f63a40a2ec0 0x7f63a40a5380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0107940 0x7f63c019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63c006a930 0x7f63c0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 --2- 172.21.15.137:0/2690244713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63c0069f70 0x7f63c0198010 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 >> 172.21.15.137:0/2690244713 conn(0x7f63c0076440 msgr2=0x7f63c00ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 shutdown_connections 2024-04-25T02:09:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.553+0000 7f63c5a00640 1 -- 172.21.15.137:0/2690244713 wait complete. 2024-04-25T02:09:51.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 -- 172.21.15.137:0/356948415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 msgr2=0x7fda30103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 --2- 172.21.15.137:0/356948415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda30103c00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009930 tx=0x7fda1c02a420 comp rx=0 tx=0).stop 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 -- 172.21.15.137:0/356948415 shutdown_connections 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 --2- 172.21.15.137:0/356948415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 0x7fda30110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 --2- 172.21.15.137:0/356948415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda30103c00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 --2- 172.21.15.137:0/356948415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 0x7fda30109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 -- 172.21.15.137:0/356948415 >> 172.21.15.137:0/356948415 conn(0x7fda300ff250 msgr2=0x7fda30101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 -- 172.21.15.137:0/356948415 shutdown_connections 2024-04-25T02:09:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.799+0000 7fda36a00640 1 -- 172.21.15.137:0/356948415 wait complete. 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 Processor -- start 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 -- start start 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 0x7fda3019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 0x7fda3019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda30113cc0 con 0x7fda30103780 2024-04-25T02:09:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fda30113b40 con 0x7fda30109790 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda30113e40 con 0x7fda30104140 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda35600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda35600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55594/0 (socket says 172.21.15.137:55594) 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda35600640 1 -- 172.21.15.137:0/3365167465 learned_addr learned my addr 172.21.15.137:0/3365167465 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda34c00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 0x7fda3019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.800+0000 7fda36000640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 0x7fda3019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 -- 172.21.15.137:0/3365167465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 msgr2=0x7fda3019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 0x7fda3019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 -- 172.21.15.137:0/3365167465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 msgr2=0x7fda3019e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 0x7fda3019e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 -- 172.21.15.137:0/3365167465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3019f120 con 0x7fda30103780 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda35600640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda2400d950 tx=0x7fda2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24017030 con 0x7fda30103780 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3019f410 con 0x7fda30103780 2024-04-25T02:09:51.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda24004020 con 0x7fda30103780 2024-04-25T02:09:51.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240049a0 con 0x7fda30103780 2024-04-25T02:09:51.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.801+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda301a6ca0 con 0x7fda30103780 2024-04-25T02:09:51.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.803+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3004fd50 con 0x7fda30103780 2024-04-25T02:09:51.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.804+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7fda240041d0 con 0x7fda30103780 2024-04-25T02:09:51.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.806+0000 7fda2e000640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 0x7fda180a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:51.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.806+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fda240ceee0 con 0x7fda30103780 2024-04-25T02:09:51.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.806+0000 7fda34c00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 0x7fda180a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:51.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.807+0000 7fda34c00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 0x7fda180a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c0058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:51.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:51.810+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fda24021020 con 0x7fda30103780 2024-04-25T02:09:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.017+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fda30061b80 con 0x7fda180a2e10 2024-04-25T02:09:52.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:51 smithi137 ceph-mon[28303]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 734 B/s wr, 22 op/s 2024-04-25T02:09:52.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:51 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1326464549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:52.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:51 smithi137 ceph-mon[28303]: from='client.25400 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:52.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:51 smithi163 ceph-mon[32577]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 734 B/s wr, 22 op/s 2024-04-25T02:09:52.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:51 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1326464549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:52.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:51 smithi163 ceph-mon[32577]: from='client.25400 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.154+0000 7fda2e000640 1 -- 172.21.15.137:0/3365167465 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fda30061b80 con 0x7fda180a2e10 2024-04-25T02:09:52.162 INFO:teuthology.orchestra.run.smithi137.stdout:Retention added to path / 2024-04-25T02:09:52.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 msgr2=0x7fda180a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 0x7fda180a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c0058d0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 msgr2=0x7fda3019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fda2400d950 tx=0x7fda2400de10 comp rx=0 tx=0).stop 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 shutdown_connections 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fda180a2e10 0x7fda180a52d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda30109790 0x7fda3019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda30104140 0x7fda3019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 --2- 172.21.15.137:0/3365167465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda30103780 0x7fda3019a180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.157+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 >> 172.21.15.137:0/3365167465 conn(0x7fda300ff250 msgr2=0x7fda300ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.158+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 shutdown_connections 2024-04-25T02:09:52.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.158+0000 7fda36a00640 1 -- 172.21.15.137:0/3365167465 wait complete. 2024-04-25T02:09:52.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:51 smithi174 ceph-mon[33171]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 734 B/s wr, 22 op/s 2024-04-25T02:09:52.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:51 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1326464549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:09:52.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:51 smithi174 ceph-mon[33171]: from='client.25400 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:52.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 -- 172.21.15.137:0/2428660208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8107c80 msgr2=0x7fccf81080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 --2- 172.21.15.137:0/2428660208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8107c80 0x7fccf81080c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009890 tx=0x7fcce002a370 comp rx=0 tx=0).stop 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 -- 172.21.15.137:0/2428660208 shutdown_connections 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 --2- 172.21.15.137:0/2428660208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8108600 0x7fccf8114a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 --2- 172.21.15.137:0/2428660208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8107c80 0x7fccf81080c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 --2- 172.21.15.137:0/2428660208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 0x7fccf810dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 -- 172.21.15.137:0/2428660208 >> 172.21.15.137:0/2428660208 conn(0x7fccf8077520 msgr2=0x7fccf8106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 -- 172.21.15.137:0/2428660208 shutdown_connections 2024-04-25T02:09:52.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.366+0000 7fccfd600640 1 -- 172.21.15.137:0/2428660208 wait complete. 2024-04-25T02:09:52.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.367+0000 7fccfd600640 1 Processor -- start 2024-04-25T02:09:52.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.367+0000 7fccfd600640 1 -- start start 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 0x7fccf819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 0x7fccf81a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81180a0 con 0x7fccf8107c80 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8117f20 con 0x7fccf810dc10 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfd600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8118220 con 0x7fccf8108600 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55608/0 (socket says 172.21.15.137:55608) 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 -- 172.21.15.137:0/3032339675 learned_addr learned my addr 172.21.15.137:0/3032339675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccef400640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 0x7fccf819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccfcc00640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 0x7fccf81a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 -- 172.21.15.137:0/3032339675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 msgr2=0x7fccf819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 0x7fccf819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 -- 172.21.15.137:0/3032339675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 msgr2=0x7fccf81a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 0x7fccf81a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccf7e00640 1 -- 172.21.15.137:0/3032339675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf81a3500 con 0x7fccf8107c80 2024-04-25T02:09:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.368+0000 7fccef400640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 0x7fccf819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccf7e00640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9f0 tx=0x7fcce800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce800cd80 con 0x7fccf8107c80 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcce8005520 con 0x7fccf8107c80 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf81a37f0 con 0x7fccf8107c80 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8010690 con 0x7fccf8107c80 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.369+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81ab080 con 0x7fccf8107c80 2024-04-25T02:09:52.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.370+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf804fd50 con 0x7fccf8107c80 2024-04-25T02:09:52.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.372+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7fcce80046c0 con 0x7fccf8107c80 2024-04-25T02:09:52.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.373+0000 7fccf5600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 0x7fccdc0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.374+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcce80cfa30 con 0x7fccf8107c80 2024-04-25T02:09:52.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.374+0000 7fccef400640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 0x7fccdc0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.375+0000 7fccef400640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 0x7fccdc0a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcce002a960 tx=0x7fcce00056d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:52.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.378+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fcce809c3d0 con 0x7fccf8107c80 2024-04-25T02:09:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.600+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fccf8061b80 con 0x7fccdc0a2e90 2024-04-25T02:09:52.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.617+0000 7fccf5600640 1 -- 172.21.15.137:0/3032339675 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fccf8061b80 con 0x7fccdc0a2e90 2024-04-25T02:09:52.625 INFO:teuthology.orchestra.run.smithi137.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T02:09:51", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.619+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 msgr2=0x7fccdc0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.619+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 0x7fccdc0a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcce002a960 tx=0x7fcce00056d0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.619+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 msgr2=0x7fccf819e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.619+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9f0 tx=0x7fcce800edf0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 shutdown_connections 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fccdc0a2e90 0x7fccdc0a5350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccf810dc10 0x7fccf81a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccf8108600 0x7fccf819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 --2- 172.21.15.137:0/3032339675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fccf8107c80 0x7fccf819e560 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 >> 172.21.15.137:0/3032339675 conn(0x7fccf8077520 msgr2=0x7fccf8078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:52.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 shutdown_connections 2024-04-25T02:09:52.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.620+0000 7fccfd600640 1 -- 172.21.15.137:0/3032339675 wait complete. 2024-04-25T02:09:52.647 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T02:09:52.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 -- 172.21.15.137:0/1017278187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 msgr2=0x7f52c4076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 --2- 172.21.15.137:0/1017278187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c4076050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009ca0 tx=0x7f52bc02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 -- 172.21.15.137:0/1017278187 shutdown_connections 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 --2- 172.21.15.137:0/1017278187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 0x7f52c41149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 --2- 172.21.15.137:0/1017278187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c4112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 --2- 172.21.15.137:0/1017278187 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c4076050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 -- 172.21.15.137:0/1017278187 >> 172.21.15.137:0/1017278187 conn(0x7f52c40ff430 msgr2=0x7f52c4101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 -- 172.21.15.137:0/1017278187 shutdown_connections 2024-04-25T02:09:52.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.838+0000 7f52c8a00640 1 -- 172.21.15.137:0/1017278187 wait complete. 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.839+0000 7f52c8a00640 1 Processor -- start 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.839+0000 7f52c8a00640 1 -- start start 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 0x7f52c41a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4118290 con 0x7f52c4075c70 2024-04-25T02:09:52.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4118110 con 0x7f52c41125c0 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c8a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4118410 con 0x7f52c4076590 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55616/0 (socket says 172.21.15.137:55616) 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 -- 172.21.15.137:0/3734267098 learned_addr learned my addr 172.21.15.137:0/3734267098 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1400640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c2800640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 0x7f52c41a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 -- 172.21.15.137:0/3734267098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 msgr2=0x7f52c419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 -- 172.21.15.137:0/3734267098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 msgr2=0x7f52c41a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 0x7f52c41a2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1e00640 1 -- 172.21.15.137:0/3734267098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c41a35f0 con 0x7f52c4075c70 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.840+0000 7f52c1400640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52c1e00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f52bc005e30 tx=0x7f52bc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:52.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc031650 con 0x7f52c4075c70 2024-04-25T02:09:52.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52bc0317f0 con 0x7f52c4075c70 2024-04-25T02:09:52.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41a3880 con 0x7f52c4075c70 2024-04-25T02:09:52.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02fb50 con 0x7f52c4075c70 2024-04-25T02:09:52.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.841+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c41ab170 con 0x7f52c4075c70 2024-04-25T02:09:52.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.842+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c404f500 con 0x7f52c4075c70 2024-04-25T02:09:52.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.844+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 24) ==== 138061+0+0 (secure 0 0 0) 0x7f52bc02fcf0 con 0x7f52c4075c70 2024-04-25T02:09:52.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.846+0000 7f52baa00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 0x7f52a80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:09:52.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.846+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f52bc0f0950 con 0x7f52c4075c70 2024-04-25T02:09:52.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.846+0000 7f52c1400640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 0x7f52a80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:09:52.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.847+0000 7f52c1400640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 0x7f52a80a5380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c4102e30 tx=0x7f52ac005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:09:52.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:52.850+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f52bc0bd400 con 0x7f52c4075c70 2024-04-25T02:09:53.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: scrub queued for path: / 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 570 B/s wr, 17 op/s 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:52 smithi137 ceph-mon[28303]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.073+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f52c41146c0 con 0x7f52a80a2ec0 2024-04-25T02:09:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.085+0000 7f52baa00640 1 -- 172.21.15.137:0/3734267098 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f52c41146c0 con 0x7f52a80a2ec0 2024-04-25T02:09:53.093 INFO:teuthology.orchestra.run.smithi137.stdout:/ 1m 6m3h 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.087+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 msgr2=0x7f52a80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.087+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 0x7f52a80a5380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c4102e30 tx=0x7f52ac005f90 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.087+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 msgr2=0x7f52c419e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.087+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f52bc005e30 tx=0x7f52bc003f90 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 shutdown_connections 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f52a80a2ec0 0x7f52a80a5380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c41125c0 0x7f52c41a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52c4076590 0x7f52c419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 --2- 172.21.15.137:0/3734267098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52c4075c70 0x7f52c419e650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 >> 172.21.15.137:0/3734267098 conn(0x7f52c40ff430 msgr2=0x7f52c4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:09:53.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 shutdown_connections 2024-04-25T02:09:53.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:09:53.088+0000 7f52c8a00640 1 -- 172.21.15.137:0/3734267098 wait complete. 2024-04-25T02:09:53.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: scrub queued for path: / 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 570 B/s wr, 17 op/s 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:52 smithi163 ceph-mon[32577]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: scrub queued for path: / 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 570 B/s wr, 17 op/s 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:52 smithi174 ceph-mon[33171]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:53.194 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-25T02:09:53.204 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-25T02:09:53.213 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:09:53.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-25T02:09:53.218 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T02:09:53.229 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:09:53.229 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T02:09:53.229 INFO:tasks.workunit:timeout=3h 2024-04-25T02:09:53.229 INFO:tasks.workunit:cleanup=True 2024-04-25T02:09:53.229 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-25 02:07:26.317685905 +0000 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-25 02:07:26.317685905 +0000 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-25 02:09:40.315997923 +0000 2024-04-25T02:09:53.277 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-25 02:07:26.317685905 +0000 2024-04-25T02:09:53.277 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T02:09:53.277 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T02:09:53.398 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:09:53.451 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T02:09:54.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:53 smithi137 ceph-mon[28303]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:54.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:53 smithi163 ceph-mon[32577]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:54.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:53 smithi174 ceph-mon[33171]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:09:55.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:54 smithi137 ceph-mon[28303]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 50 op/s 2024-04-25T02:09:55.143 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:54 smithi163 ceph-mon[32577]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 50 op/s 2024-04-25T02:09:55.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:54 smithi174 ceph-mon[33171]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 50 op/s 2024-04-25T02:09:57.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:57 smithi163 ceph-mon[32577]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:09:57.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:57 smithi174 ceph-mon[33171]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:09:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:57 smithi137 ceph-mon[28303]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:09:59.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:09:59 smithi163 ceph-mon[32577]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:09:59.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:09:59 smithi174 ceph-mon[33171]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:09:59.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:09:59 smithi137 ceph-mon[28303]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-04-25T02:10:00.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:00 smithi163 ceph-mon[32577]: overall HEALTH_OK 2024-04-25T02:10:00.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:00 smithi174 ceph-mon[33171]: overall HEALTH_OK 2024-04-25T02:10:00.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-mon[28303]: overall HEALTH_OK 2024-04-25T02:10:00.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:10:00.180+0000 7f5b2f400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:10:00.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:10:00.180+0000 7f5b2f400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:10:00.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:10:00.180+0000 7f5b2f400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:10:00.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:10:00.180+0000 7f5b2f400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:10:00.534 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:10:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:10:00.180+0000 7f5b2f400700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:10:01.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:01 smithi163 ceph-mon[32577]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-25T02:10:01.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:01 smithi174 ceph-mon[33171]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-25T02:10:01.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:01 smithi137 ceph-mon[28303]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-04-25T02:10:02.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:02 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:10:02.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:02 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:10:02.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:02 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:10:03.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:03 smithi163 ceph-mon[32577]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-04-25T02:10:03.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:03 smithi163 ceph-mon[32577]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-04-25T02:10:03.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:03 smithi174 ceph-mon[33171]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-04-25T02:10:03.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:03 smithi174 ceph-mon[33171]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-04-25T02:10:03.436 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:03 smithi137 ceph-mon[28303]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-04-25T02:10:03.436 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:03 smithi137 ceph-mon[28303]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-04-25T02:10:05.392 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:05 smithi163 ceph-mon[32577]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-04-25T02:10:05.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:05 smithi174 ceph-mon[33171]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-04-25T02:10:05.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:05 smithi137 ceph-mon[28303]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-04-25T02:10:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 -- 172.21.15.137:0/1431382761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c109760 msgr2=0x7fee5c109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 --2- 172.21.15.137:0/1431382761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c109760 0x7fee5c109b40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009890 tx=0x7fee4c02a360 comp rx=0 tx=0).stop 2024-04-25T02:10:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 -- 172.21.15.137:0/1431382761 shutdown_connections 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 --2- 172.21.15.137:0/1431382761 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c104110 0x7fee5c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 --2- 172.21.15.137:0/1431382761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 --2- 172.21.15.137:0/1431382761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c109760 0x7fee5c109b40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 -- 172.21.15.137:0/1431382761 >> 172.21.15.137:0/1431382761 conn(0x7fee5c0ff260 msgr2=0x7fee5c101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 -- 172.21.15.137:0/1431382761 shutdown_connections 2024-04-25T02:10:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.451+0000 7fee60a00640 1 -- 172.21.15.137:0/1431382761 wait complete. 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.452+0000 7fee60a00640 1 Processor -- start 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.452+0000 7fee60a00640 1 -- start start 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c109760 0x7fee5c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c113c50 con 0x7fee5c104110 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c113ad0 con 0x7fee5c109760 2024-04-25T02:10:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee60a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c113dd0 con 0x7fee5c103750 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35208/0 (socket says 172.21.15.137:35208) 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 -- 172.21.15.137:0/3862486847 learned_addr learned my addr 172.21.15.137:0/3862486847 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5be00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c109760 0x7fee5c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 -- 172.21.15.137:0/3862486847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 msgr2=0x7fee5c19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 -- 172.21.15.137:0/3862486847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c109760 msgr2=0x7fee5c19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c109760 0x7fee5c19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5aa00640 1 -- 172.21.15.137:0/3862486847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c19f120 con 0x7fee5c104110 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.453+0000 7fee5b400640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e9c0 tx=0x7fee4800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee53e00640 1 -- 172.21.15.137:0/3862486847 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4800cd80 con 0x7fee5c104110 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c19f410 con 0x7fee5c104110 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee53e00640 1 -- 172.21.15.137:0/3862486847 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee480035f0 con 0x7fee5c104110 2024-04-25T02:10:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee53e00640 1 -- 172.21.15.137:0/3862486847 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48010690 con 0x7fee5c104110 2024-04-25T02:10:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.454+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c1a6ca0 con 0x7fee5c104110 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.457+0000 7fee64e14740 1 Processor -- start 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 -- start start 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0af3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 0x5577d0afdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0afe190 0x5577d0b00580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577d0a56ab0 con 0x5577d0af2fb0 2024-04-25T02:10:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee53e00640 1 -- 172.21.15.137:0/3862486847 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fee480037a0 con 0x7fee5c104110 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5577d09ff640 con 0x5577d0afe190 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee64e14740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5577d0a52a70 con 0x5577d0af38d0 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0af3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee5b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 0x5577d0afdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0afe190 0x5577d0b00580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0af3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35210/0 (socket says 172.21.15.137:35210) 2024-04-25T02:10:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.458+0000 7fee5be00640 1 -- 172.21.15.137:0/3340655689 learned_addr learned my addr 172.21.15.137:0/3340655689 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 -- 172.21.15.137:0/3340655689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0afe190 msgr2=0x5577d0b00580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0afe190 0x5577d0b00580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 -- 172.21.15.137:0/3340655689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 msgr2=0x5577d0af3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0af3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 -- 172.21.15.137:0/3340655689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d076b210 con 0x5577d0af38d0 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee5b400640 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 0x5577d0afdc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02a950 tx=0x7fee4c009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69499b7a19d81382 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.459+0000 7fee47e00640 1 -- 172.21.15.137:0/3340655689 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c037040 con 0x5577d0af38d0 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee47e00640 1 -- 172.21.15.137:0/3340655689 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee4c038040 con 0x5577d0af38d0 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee47e00640 1 -- 172.21.15.137:0/3340655689 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0326a0 con 0x5577d0af38d0 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee53e00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 0x7fee400a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee53e00640 1 -- 172.21.15.137:0/3862486847 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fee480cf980 con 0x7fee5c104110 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee5be00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 0x7fee400a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee64e14740 1 -- 172.21.15.137:0/3340655689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 msgr2=0x5577d0afdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.460+0000 7fee64e14740 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 0x5577d0afdc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02a950 tx=0x7fee4c009510 comp rx=0 tx=0).stop 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 -- 172.21.15.137:0/3340655689 shutdown_connections 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0afe190 0x5577d0b00580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af38d0 0x5577d0afdc50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 --2- 172.21.15.137:0/3340655689 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0af3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 -- 172.21.15.137:0/3340655689 >> 172.21.15.137:0/3340655689 conn(0x5577d0aef4c0 msgr2=0x5577d0aef8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 -- 172.21.15.137:0/3340655689 shutdown_connections 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee5be00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 0x7fee400a5360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee540125f0 tx=0x7fee54009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 -- 172.21.15.137:0/3340655689 wait complete. 2024-04-25T02:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 -- start start 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.461+0000 7fee64e14740 1 Processor -- start 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0afb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0afbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5577d0b00d60 con 0x5577d0af2fb0 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5577d0a12990 con 0x5577d0af38d0 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5577d0b00ee0 con 0x5577d0afe190 2024-04-25T02:10:06.473 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee64e14740 10 client.0 _ll_register_callbacks cb 0x5577d0a14950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35212/0 (socket says 172.21.15.137:35212) 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0afbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 -- 172.21.15.137:0/4070417578 learned_addr learned my addr 172.21.15.137:0/4070417578 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5aa00640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0afb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 -- 172.21.15.137:0/4070417578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 msgr2=0x5577d0afbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0afbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 -- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 msgr2=0x5577d0afb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0afb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.462+0000 7fee5b400640 1 -- 172.21.15.137:0/4070417578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d0837620 con 0x5577d0af2fb0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee5b400640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009890 tx=0x7fee4c030fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e23bac1ff09cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee44c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c04d030 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fee4c004040 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee4c038040 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fee4c057050 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee64e14740 10 client.15387 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.463+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5577d0b0cc10 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee4c038040 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fee4c0039f0 con 0x5577d0af2fb0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 10 client.15387 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 20 client.15387 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b0df60 0x5577d0b10350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 4 client.15387 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577d0a63ff0 con 0x5577d0b0df60 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.464+0000 7fee5aa00640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b0df60 0x5577d0b10350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.465+0000 7fee5aa00640 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b0df60 0x5577d0b10350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3200bd505517a15c server_cookie=332e379871cfd361 in_seq=0 out_seq=0 2024-04-25T02:10:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.465+0000 7fee44c00640 10 client.15387 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee44c00640 1 -- 172.21.15.137:0/4070417578 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577d0a63ff0 con 0x5577d0b0df60 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee44c00640 10 client.15387 handle_command_reply: tid=0 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 client.15387 shutdown 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 msgr2=0x5577d0afb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009890 tx=0x7fee4c030fa0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 shutdown_connections 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b0df60 0x5577d0b10350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0afbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0afb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 --2- 172.21.15.137:0/4070417578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af2fb0 0x5577d0afb110 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee44c00640 0 client.15387 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 >> 172.21.15.137:0/4070417578 conn(0x5577d0aef4c0 msgr2=0x5577d0af5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 shutdown_connections 2024-04-25T02:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 1 -- 172.21.15.137:0/4070417578 wait complete. 2024-04-25T02:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.466+0000 7fee64e14740 20 client.15387 trim_cache size 0 max 16384 2024-04-25T02:10:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.482+0000 7fee64e14740 1 Processor -- start 2024-04-25T02:10:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.482+0000 7fee64e14740 1 -- start start 2024-04-25T02:10:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 0x5577d0b09c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0aea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1b1d10 con 0x5577d0afe190 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1af5e0 con 0x5577d0af38d0 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee64e14740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1ad430 con 0x5577d0af2fb0 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 0x5577d0b09c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35216/0 (socket says 172.21.15.137:35216) 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 -- 172.21.15.137:0/389463877 learned_addr learned my addr 172.21.15.137:0/389463877 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5aa00640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0aea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 -- 172.21.15.137:0/389463877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 msgr2=0x5577d0b09c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 0x5577d0b09c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 -- 172.21.15.137:0/389463877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 msgr2=0x5577d0aea110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0aea110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5be00640 1 -- 172.21.15.137:0/389463877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d0afa0c0 con 0x5577d0afe190 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5aa00640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0aea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.483+0000 7fee5b400640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 0x5577d0b09c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.484+0000 7fee5be00640 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee54003d00 tx=0x7fee5401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148c4e203c898da0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.484+0000 7fee47400640 1 -- 172.21.15.137:0/389463877 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5400f540 con 0x5577d0afe190 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.484+0000 7fee47400640 1 -- 172.21.15.137:0/389463877 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee5400fbe0 con 0x5577d0afe190 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.484+0000 7fee47400640 1 -- 172.21.15.137:0/389463877 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5402acc0 con 0x5577d0afe190 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- 172.21.15.137:0/389463877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 msgr2=0x5577d0b15950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee54003d00 tx=0x7fee5401b000 comp rx=0 tx=0).stop 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- 172.21.15.137:0/389463877 shutdown_connections 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0afe190 0x5577d0b15950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af38d0 0x5577d0aea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 --2- 172.21.15.137:0/389463877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0af2fb0 0x5577d0b09c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- 172.21.15.137:0/389463877 >> 172.21.15.137:0/389463877 conn(0x5577d0aef4c0 msgr2=0x5577d0aee620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- 172.21.15.137:0/389463877 shutdown_connections 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- 172.21.15.137:0/389463877 wait complete. 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 -- start start 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.485+0000 7fee64e14740 1 Processor -- start 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 0x5577d0b022c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0b731c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1adaa0 con 0x5577d0af38d0 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1aef10 con 0x5577d0af2fb0 2024-04-25T02:10:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c1ae170 con 0x5577d0afe190 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee64e14740 10 client.0 _ll_register_callbacks cb 0x7fee54009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 0x5577d0b022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:35222/0 (socket says 172.21.15.137:35222) 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 -- 172.21.15.137:0/3190914136 learned_addr learned my addr 172.21.15.137:0/3190914136 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5be00640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0b731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 -- 172.21.15.137:0/3190914136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 msgr2=0x5577d0b731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0b731c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 -- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 msgr2=0x5577d0b022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 0x5577d0b022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5aa00640 1 -- 172.21.15.137:0/3190914136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d0b73700 con 0x5577d0af38d0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.486+0000 7fee5b400640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 0x5577d0b022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee5aa00640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee480ccf20 tx=0x7fee48098050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304781e40c23ecba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4809bc90 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fee48003ba0 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5400fbe0 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fee480a0040 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee64e14740 10 client.15393 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5577d0b74aa0 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee5400fbe0 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.487+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fee480a4500 con 0x5577d0af38d0 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 10 client.15393 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 20 client.15393 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b75270 0x5577d0b77690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 4 client.15393 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577d0a5e340 con 0x5577d0b75270 2024-04-25T02:10:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee5b400640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b75270 0x5577d0b77690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee5b400640 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b75270 0x5577d0b77690 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f39964d7e90832d server_cookie=24eede0068a6d52e in_seq=0 out_seq=0 2024-04-25T02:10:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.488+0000 7fee44c00640 10 client.15393 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.499+0000 7fee44c00640 1 -- 172.21.15.137:0/3190914136 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577d0a5e340 con 0x5577d0b75270 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.499+0000 7fee44c00640 10 client.15393 handle_command_reply: tid=0 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 client.15393 shutdown 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 msgr2=0x5577d0b02800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee480ccf20 tx=0x7fee48098050 comp rx=0 tx=0).stop 2024-04-25T02:10:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 shutdown_connections 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5577d0b75270 0x5577d0b77690 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577d0afe190 0x5577d0b731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee44c00640 0 client.15393 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5577d0af38d0 0x5577d0b02800 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 --2- 172.21.15.137:0/3190914136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5577d0af2fb0 0x5577d0b022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 >> 172.21.15.137:0/3190914136 conn(0x5577d0aef4c0 msgr2=0x5577d0af4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 shutdown_connections 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 1 -- 172.21.15.137:0/3190914136 wait complete. 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.500+0000 7fee64e14740 20 client.15393 trim_cache size 0 max 16384 2024-04-25T02:10:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:10:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:10:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:10:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:10:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 msgr2=0x7fee400a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 0x7fee400a5360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee540125f0 tx=0x7fee54009500 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 msgr2=0x7fee5c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee4800e9c0 tx=0x7fee4800edc0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 shutdown_connections 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fee400a2ea0 0x7fee400a5360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee5c109760 0x7fee5c19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee5c104110 0x7fee5c19a670 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 --2- 172.21.15.137:0/3862486847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee5c103750 0x7fee5c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 >> 172.21.15.137:0/3862486847 conn(0x7fee5c0ff260 msgr2=0x7fee5c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 shutdown_connections 2024-04-25T02:10:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:06.501+0000 7fee60a00640 1 -- 172.21.15.137:0/3862486847 wait complete. 2024-04-25T02:10:07.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:07 smithi163 ceph-mon[32577]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:07.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:07 smithi174 ceph-mon[33171]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:07.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:07 smithi137 ceph-mon[28303]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:09.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:09 smithi163 ceph-mon[32577]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:09.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:09 smithi174 ceph-mon[33171]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:09.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:09 smithi137 ceph-mon[28303]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-04-25T02:10:11.393 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:11 smithi163 ceph-mon[32577]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T02:10:11.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:11 smithi174 ceph-mon[33171]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T02:10:11.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:11 smithi137 ceph-mon[28303]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-04-25T02:10:13.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:13 smithi174 ceph-mon[33171]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-25T02:10:13.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:13 smithi137 ceph-mon[28303]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-25T02:10:13.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:13 smithi163 ceph-mon[32577]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-25T02:10:15.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:15 smithi174 ceph-mon[33171]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-25T02:10:15.500 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:15 smithi137 ceph-mon[28303]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-25T02:10:15.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:15 smithi163 ceph-mon[32577]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-25T02:10:17.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:17 smithi174 ceph-mon[33171]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:17 smithi163 ceph-mon[32577]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:17.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:17 smithi137 ceph-mon[28303]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:19.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:19 smithi174 ceph-mon[33171]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:19.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:19 smithi137 ceph-mon[28303]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:19 smithi163 ceph-mon[32577]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-25T02:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 -- 172.21.15.137:0/2954663188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 msgr2=0x7fb704108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 --2- 172.21.15.137:0/2954663188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb704108380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009900 tx=0x7fb6f802a410 comp rx=0 tx=0).stop 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 -- 172.21.15.137:0/2954663188 shutdown_connections 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 --2- 172.21.15.137:0/2954663188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb704114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 --2- 172.21.15.137:0/2954663188 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb704108950 0x7fb70410c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 --2- 172.21.15.137:0/2954663188 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb704108380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 -- 172.21.15.137:0/2954663188 >> 172.21.15.137:0/2954663188 conn(0x7fb704075cd0 msgr2=0x7fb7040780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 -- 172.21.15.137:0/2954663188 shutdown_connections 2024-04-25T02:10:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.641+0000 7fb70c400640 1 -- 172.21.15.137:0/2954663188 wait complete. 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.642+0000 7fb70c400640 1 Processor -- start 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.642+0000 7fb70c400640 1 -- start start 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb70419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7041a2ee0 0x7fb7041a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb704118240 con 0x7fb70410d070 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041180c0 con 0x7fb704107fa0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70c400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041183c0 con 0x7fb7041a2ee0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45554/0 (socket says 172.21.15.137:45554) 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb70419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 -- 172.21.15.137:0/266551569 learned_addr learned my addr 172.21.15.137:0/266551569 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb70a400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7041a2ee0 0x7fb7041a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 -- 172.21.15.137:0/266551569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7041a2ee0 msgr2=0x7fb7041a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7041a2ee0 0x7fb7041a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 -- 172.21.15.137:0/266551569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 msgr2=0x7fb70419e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb70419e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709000640 1 -- 172.21.15.137:0/266551569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7041a39d0 con 0x7fb70410d070 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.643+0000 7fb709a00640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb70419e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb709000640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000e9c0 tx=0x7fb6f000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb702000640 1 -- 172.21.15.137:0/266551569 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000cd80 con 0x7fb70410d070 2024-04-25T02:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb702000640 1 -- 172.21.15.137:0/266551569 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6f0005520 con 0x7fb70410d070 2024-04-25T02:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7041a3cc0 con 0x7fb70410d070 2024-04-25T02:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb702000640 1 -- 172.21.15.137:0/266551569 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0010690 con 0x7fb70410d070 2024-04-25T02:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.644+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7041ab4b0 con 0x7fb70410d070 2024-04-25T02:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.647+0000 7fb70f1f9740 1 Processor -- start 2024-04-25T02:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.647+0000 7fb702000640 1 -- 172.21.15.137:0/266551569 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fb6f00046c0 con 0x7fb70410d070 2024-04-25T02:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.647+0000 7fb70f1f9740 1 -- start start 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd178aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd178fe0 0x5632cd17b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632cd0d1ab0 con 0x5632cd178fe0 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5632cd07a640 con 0x5632cd16de00 2024-04-25T02:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5632cd0cda70 con 0x5632cd16e720 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:56410/0 (socket says 172.21.15.137:56410) 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb709a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd178aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb70a400640 1 -- 172.21.15.137:0/1784678162 learned_addr learned my addr 172.21.15.137:0/1784678162 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.648+0000 7fb709000640 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd178fe0 0x5632cd17b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 -- 172.21.15.137:0/1784678162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 msgr2=0x5632cd178aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd178aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 -- 172.21.15.137:0/1784678162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd178fe0 msgr2=0x5632cd17b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd178fe0 0x5632cd17b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 -- 172.21.15.137:0/1784678162 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ccde6210 con 0x5632cd16de00 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb70a400640 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009f50 tx=0x7fb6fc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d07a6dc2e9a2534 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb702000640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 0x7fb6ec0a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb6f6a00640 1 -- 172.21.15.137:0/1784678162 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc004d20 con 0x5632cd16de00 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb6f6a00640 1 -- 172.21.15.137:0/1784678162 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6fc004050 con 0x5632cd16de00 2024-04-25T02:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb6f6a00640 1 -- 172.21.15.137:0/1784678162 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc005260 con 0x5632cd16de00 2024-04-25T02:10:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb702000640 1 -- 172.21.15.137:0/266551569 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb6f00cfab0 con 0x7fb70410d070 2024-04-25T02:10:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.649+0000 7fb709a00640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 0x7fb6ec0a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 -- 172.21.15.137:0/1784678162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 msgr2=0x5632cd16e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009f50 tx=0x7fb6fc0118d0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 -- 172.21.15.137:0/1784678162 shutdown_connections 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd178fe0 0x5632cd17b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd178aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/1784678162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd16e1e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 -- 172.21.15.137:0/1784678162 >> 172.21.15.137:0/1784678162 conn(0x5632cd16a310 msgr2=0x5632cd16a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb709a00640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 0x7fb6ec0a5410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009230 tx=0x7fb6f80058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 -- 172.21.15.137:0/1784678162 shutdown_connections 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.650+0000 7fb70f1f9740 1 -- 172.21.15.137:0/1784678162 wait complete. 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 -- start start 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 Processor -- start 2024-04-25T02:10:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd178fe0 0x5632cd176a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632cd17bc10 con 0x5632cd16e720 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x5632cd08d990 con 0x5632cd16de00 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5632cd17bd90 con 0x5632cd178fe0 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.651+0000 7fb70f1f9740 10 client.0 _ll_register_callbacks cb 0x5632cd08f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45578/0 (socket says 172.21.15.137:45578) 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709000640 1 -- 172.21.15.137:0/2248542598 learned_addr learned my addr 172.21.15.137:0/2248542598 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:56418/0 (socket says 172.21.15.137:56418) 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb70a400640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd178fe0 0x5632cd176a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 -- 172.21.15.137:0/2248542598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd178fe0 msgr2=0x5632cd176a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.663 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd178fe0 0x5632cd176a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 -- 172.21.15.137:0/2248542598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 msgr2=0x5632cd176540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 -- 172.21.15.137:0/2248542598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632cceb2620 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709000640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb709a00640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005940 tx=0x7fb6f8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8298f03204bcec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.652+0000 7fb6eb400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f804e070 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6fc004050 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb6f8003a00 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb6f805a050 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb70f1f9740 10 client.25487 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5632cd187bc0 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.653+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6fc004050 con 0x5632cd16de00 2024-04-25T02:10:19.664 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fb6f803d450 con 0x5632cd16de00 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 10 client.25487 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 10 client.25487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 20 client.25487 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd189030 0x5632cd18b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 4 client.25487 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632cd0deff0 con 0x5632cd189030 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.654+0000 7fb709000640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd189030 0x5632cd18b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.655+0000 7fb709000640 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd189030 0x5632cd18b420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52498f586d9f1416 server_cookie=7a4200b71d73e132 in_seq=0 out_seq=0 2024-04-25T02:10:19.665 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.655+0000 7fb6eb400640 10 client.25487 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.655+0000 7fb6eb400640 1 -- 172.21.15.137:0/2248542598 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5632cd0deff0 con 0x5632cd189030 2024-04-25T02:10:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.655+0000 7fb6eb400640 10 client.25487 handle_command_reply: tid=0 2024-04-25T02:10:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.655+0000 7fb70f1f9740 1 client.25487 shutdown 2024-04-25T02:10:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 msgr2=0x5632cd176000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.666 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005940 tx=0x7fb6f8009260 comp rx=0 tx=0).stop 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 shutdown_connections 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd189030 0x5632cd18b420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd178fe0 0x5632cd176a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd176540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb6eb400640 0 client.25487 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2248542598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd16de00 0x5632cd176000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 >> 172.21.15.137:0/2248542598 conn(0x5632cd16a310 msgr2=0x5632cd170040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 shutdown_connections 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2248542598 wait complete. 2024-04-25T02:10:19.667 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.656+0000 7fb70f1f9740 20 client.25487 trim_cache size 0 max 16384 2024-04-25T02:10:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 Processor -- start 2024-04-25T02:10:19.679 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 -- start start 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 0x5632cd1707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd191220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b6280 con 0x5632cd16de00 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b3b50 con 0x5632cd178fe0 2024-04-25T02:10:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.672+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b19a0 con 0x5632cd16e720 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb70a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd191220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:43808/0 (socket says 172.21.15.137:43808) 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 -- 172.21.15.137:0/4218154192 learned_addr learned my addr 172.21.15.137:0/4218154192 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709a00640 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 0x5632cd1707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 -- 172.21.15.137:0/4218154192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 msgr2=0x5632cd191220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd191220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 -- 172.21.15.137:0/4218154192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 msgr2=0x5632cd1707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 0x5632cd1707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709000640 1 -- 172.21.15.137:0/4218154192 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632cd16e550 con 0x5632cd16e720 2024-04-25T02:10:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.673+0000 7fb709a00640 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 0x5632cd1707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.674+0000 7fb709000640 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0098740 tx=0x7fb6f0004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ae8f284fb71cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.674+0000 7fb6f6000640 1 -- 172.21.15.137:0/4218154192 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f009b720 con 0x5632cd16e720 2024-04-25T02:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.674+0000 7fb6f6000640 1 -- 172.21.15.137:0/4218154192 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6f009c4c0 con 0x5632cd16e720 2024-04-25T02:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.674+0000 7fb6f6000640 1 -- 172.21.15.137:0/4218154192 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f009b210 con 0x5632cd16e720 2024-04-25T02:10:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- 172.21.15.137:0/4218154192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 msgr2=0x5632cd190ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0098740 tx=0x7fb6f0004ba0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- 172.21.15.137:0/4218154192 shutdown_connections 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd191220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16e720 0x5632cd190ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/4218154192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16de00 0x5632cd1707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- 172.21.15.137:0/4218154192 >> 172.21.15.137:0/4218154192 conn(0x5632cd16a310 msgr2=0x5632cd169480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- 172.21.15.137:0/4218154192 shutdown_connections 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- 172.21.15.137:0/4218154192 wait complete. 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 -- start start 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.675+0000 7fb70f1f9740 1 Processor -- start 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd172b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd173230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b2010 con 0x5632cd16e720 2024-04-25T02:10:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b3480 con 0x5632cd178fe0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041b26e0 con 0x5632cd16de00 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70f1f9740 10 client.0 _ll_register_callbacks cb 0x7fb6f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:43824/0 (socket says 172.21.15.137:43824) 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 -- 172.21.15.137:0/2201713623 learned_addr learned my addr 172.21.15.137:0/2201713623 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd172b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb70a400640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd173230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 -- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 msgr2=0x5632cd173230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd173230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 -- 172.21.15.137:0/2201713623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 msgr2=0x5632cd172b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd172b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.676+0000 7fb709a00640 1 -- 172.21.15.137:0/2201713623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632cd1ee550 con 0x5632cd16de00 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb709a00640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6f802a450 tx=0x7fb6f8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb75f7b20e04bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb6eb400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8063020 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f009c4c0 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fb6f8003800 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb6f806e050 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb70f1f9740 10 client.25537 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.677+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5632cd1ef680 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6f009c4c0 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fb6f804a6f0 con 0x5632cd16de00 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 10 client.25537 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 10 client.25537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 20 client.25537 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd1efdf0 0x5632cd1f2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 4 client.25537 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632cd0d9340 con 0x5632cd1efdf0 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.678+0000 7fb709000640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd1efdf0 0x5632cd1f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.679+0000 7fb709000640 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd1efdf0 0x5632cd1f2210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f999b01fcb9991d server_cookie=5bc685a81dc940f2 in_seq=0 out_seq=0 2024-04-25T02:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.679+0000 7fb6eb400640 10 client.25537 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb6eb400640 1 -- 172.21.15.137:0/2201713623 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632cd0d9340 con 0x5632cd1efdf0 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb6eb400640 10 client.25537 handle_command_reply: tid=0 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 client.25537 shutdown 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 msgr2=0x5632cd181530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6f802a450 tx=0x7fb6f8004390 comp rx=0 tx=0).stop 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 shutdown_connections 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5632cd1efdf0 0x5632cd1f2210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5632cd178fe0 0x5632cd173230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632cd16e720 0x5632cd172b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 --2- 172.21.15.137:0/2201713623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632cd16de00 0x5632cd181530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.682+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 >> 172.21.15.137:0/2201713623 conn(0x5632cd16a310 msgr2=0x5632cd177830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb6eb400640 0 client.25537 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 shutdown_connections 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70f1f9740 1 -- 172.21.15.137:0/2201713623 wait complete. 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70f1f9740 20 client.25537 trim_cache size 0 max 16384 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 msgr2=0x7fb6ec0a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 0x7fb6ec0a5410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009230 tx=0x7fb6f80058d0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 msgr2=0x7fb70419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.683+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000e9c0 tx=0x7fb6f000ee80 comp rx=0 tx=0).stop 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 shutdown_connections 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb6ec0a2f50 0x7fb6ec0a5410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7041a2ee0 0x7fb7041a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb70410d070 0x7fb70419eb60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 --2- 172.21.15.137:0/266551569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb704107fa0 0x7fb70419e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 >> 172.21.15.137:0/266551569 conn(0x7fb704075cd0 msgr2=0x7fb704076740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 shutdown_connections 2024-04-25T02:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:19.684+0000 7fb70c400640 1 -- 172.21.15.137:0/266551569 wait complete. 2024-04-25T02:10:21.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:21 smithi174 ceph-mon[33171]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T02:10:21.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:21 smithi137 ceph-mon[28303]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T02:10:21.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:10:21.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:10:21.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:21 smithi163 ceph-mon[32577]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-25T02:10:21.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 -- 172.21.15.137:0/2240328556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc10dd00 msgr2=0x7fd1cc10e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/2240328556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc10e0e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009860 tx=0x7fd1bc02a3d0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 -- 172.21.15.137:0/2240328556 shutdown_connections 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/2240328556 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc108680 0x7fd1cc114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/2240328556 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc107ce0 0x7fd1cc108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/2240328556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc10e0e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 -- 172.21.15.137:0/2240328556 >> 172.21.15.137:0/2240328556 conn(0x7fd1cc077560 msgr2=0x7fd1cc106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 -- 172.21.15.137:0/2240328556 shutdown_connections 2024-04-25T02:10:21.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.771+0000 7fd1cbe00640 1 -- 172.21.15.137:0/2240328556 wait complete. 2024-04-25T02:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.772+0000 7fd1cbe00640 1 Processor -- start 2024-04-25T02:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 -- start start 2024-04-25T02:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc107ce0 0x7fd1cc19e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc1a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc118140 con 0x7fd1cc10dd00 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc117fc0 con 0x7fd1cc107ce0 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1182c0 con 0x7fd1cc108680 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc1a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc107ce0 0x7fd1cc19e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35850/0 (socket says 172.21.15.137:35850) 2024-04-25T02:10:21.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.773+0000 7fd1c2000640 1 -- 172.21.15.137:0/193007866 learned_addr learned my addr 172.21.15.137:0/193007866 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 -- 172.21.15.137:0/193007866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc107ce0 msgr2=0x7fd1cc19e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc107ce0 0x7fd1cc19e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 -- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc10dd00 msgr2=0x7fd1cc1a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc1a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 -- 172.21.15.137:0/193007866 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc1a3510 con 0x7fd1cc108680 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c2000640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400e9c0 tx=0x7fd1b400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c3e00640 1 -- 172.21.15.137:0/193007866 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400cde0 con 0x7fd1cc108680 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc1a3800 con 0x7fd1cc108680 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c3e00640 1 -- 172.21.15.137:0/193007866 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1b40035f0 con 0x7fd1cc108680 2024-04-25T02:10:21.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1c3e00640 1 -- 172.21.15.137:0/193007866 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4010670 con 0x7fd1cc108680 2024-04-25T02:10:21.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.774+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc1ab090 con 0x7fd1cc108680 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 Processor -- start 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1c3e00640 1 -- 172.21.15.137:0/193007866 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fd1b40037a0 con 0x7fd1cc108680 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 -- start start 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36b51d0 0x55deb36b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55deb360e560 con 0x55deb36aab00 2024-04-25T02:10:21.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55deb35b6930 con 0x55deb36aa1e0 2024-04-25T02:10:21.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1d4987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55deb360a520 con 0x55deb36b51d0 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.778+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36250/0 (socket says 172.21.15.137:36250) 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 -- 172.21.15.137:0/2896819481 learned_addr learned my addr 172.21.15.137:0/2896819481 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1c2000640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36b51d0 0x55deb36b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1cb400640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 -- 172.21.15.137:0/2896819481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36b51d0 msgr2=0x55deb36b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36b51d0 0x55deb36b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 -- 172.21.15.137:0/2896819481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 msgr2=0x55deb36aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 -- 172.21.15.137:0/2896819481 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb33ec7d0 con 0x55deb36aab00 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1cb400640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.779+0000 7fd1caa00640 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc034000 tx=0x7fd1bc032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347ab231f4aa622 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1bbe00640 1 -- 172.21.15.137:0/2896819481 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc030d40 con 0x55deb36aab00 2024-04-25T02:10:21.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1c3e00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 0x7fd1b00a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1bbe00640 1 -- 172.21.15.137:0/2896819481 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1bc0308a0 con 0x55deb36aab00 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1bbe00640 1 -- 172.21.15.137:0/2896819481 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc004920 con 0x55deb36aab00 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1c3e00640 1 -- 172.21.15.137:0/193007866 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd1b40cf970 con 0x7fd1cc108680 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1cb400640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 0x7fd1b00a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.780+0000 7fd1d4987740 1 -- 172.21.15.137:0/2896819481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 msgr2=0x55deb36b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc034000 tx=0x7fd1bc032f80 comp rx=0 tx=0).stop 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 -- 172.21.15.137:0/2896819481 shutdown_connections 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36b51d0 0x55deb36b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aab00 0x55deb36b4c90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 --2- 172.21.15.137:0/2896819481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 -- 172.21.15.137:0/2896819481 >> 172.21.15.137:0/2896819481 conn(0x55deb36a6500 msgr2=0x55deb36a68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1cb400640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 0x7fd1b00a53f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4005fd0 tx=0x7fd1c4009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 -- 172.21.15.137:0/2896819481 shutdown_connections 2024-04-25T02:10:21.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 -- 172.21.15.137:0/2896819481 wait complete. 2024-04-25T02:10:21.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 -- start start 2024-04-25T02:10:21.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.781+0000 7fd1d4987740 1 Processor -- start 2024-04-25T02:10:21.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aa1e0 0x55deb36b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55deb36b7f60 con 0x55deb36b51d0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55deb35c9d90 con 0x55deb36aab00 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55deb36b80e0 con 0x55deb36aa1e0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1d4987740 10 client.0 _ll_register_callbacks cb 0x55deb35c9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aa1e0 0x55deb36b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:54730/0 (socket says 172.21.15.137:54730) 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1cb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36260/0 (socket says 172.21.15.137:36260) 2024-04-25T02:10:21.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.782+0000 7fd1c2000640 1 -- 172.21.15.137:0/3543021658 learned_addr learned my addr 172.21.15.137:0/3543021658 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 -- 172.21.15.137:0/3543021658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aa1e0 msgr2=0x55deb36b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aa1e0 0x55deb36b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 -- 172.21.15.137:0/3543021658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 msgr2=0x55deb36b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 -- 172.21.15.137:0/3543021658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb33223f0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1cb400640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1c2000640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1b409bc10 tx=0x7fd1b4097800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7ea821f0a623364 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b409b7c0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd1b409b2d0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1bc0308a0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd1b409b5e0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1d4987740 10 client.25505 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.783+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55deb32e20f0 con 0x55deb36aab00 2024-04-25T02:10:21.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1bc0308a0 con 0x55deb36aab00 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd1b409ab40 con 0x55deb36aab00 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 10 client.25505 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 10 client.25505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 20 client.25505 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36c54a0 0x55deb36c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 4 client.25505 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deb3621d90 con 0x55deb36c54a0 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.784+0000 7fd1caa00640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36c54a0 0x55deb36c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.785+0000 7fd1caa00640 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36c54a0 0x55deb36c7890 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d46c91f6f630a5a server_cookie=6f4ff18515b499de in_seq=0 out_seq=0 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.785+0000 7fd1b8c00640 10 client.25505 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1b8c00640 1 -- 172.21.15.137:0/3543021658 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55deb3621d90 con 0x55deb36c54a0 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1b8c00640 10 client.25505 handle_command_reply: tid=0 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 client.25505 shutdown 2024-04-25T02:10:21.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 msgr2=0x55deb36b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1b409bc10 tx=0x7fd1b4097800 comp rx=0 tx=0).stop 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 shutdown_connections 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36c54a0 0x55deb36c7890 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36b51d0 0x55deb36b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aab00 0x55deb36b2600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1b8c00640 0 client.25505 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 --2- 172.21.15.137:0/3543021658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aa1e0 0x55deb36b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 >> 172.21.15.137:0/3543021658 conn(0x55deb36a6500 msgr2=0x55deb36a5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 shutdown_connections 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 1 -- 172.21.15.137:0/3543021658 wait complete. 2024-04-25T02:10:21.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.786+0000 7fd1d4987740 20 client.25505 trim_cache size 0 max 16384 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.805+0000 7fd1d4987740 1 Processor -- start 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.805+0000 7fd1d4987740 1 -- start start 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36a6500 0x55deb36c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b6070 con 0x55deb36aa1e0 2024-04-25T02:10:21.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b3940 con 0x55deb36a6500 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1d4987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b1790 con 0x55deb36aab00 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36272/0 (socket says 172.21.15.137:36272) 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 -- 172.21.15.137:0/4135753250 learned_addr learned my addr 172.21.15.137:0/4135753250 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1cb400640 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1caa00640 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36a6500 0x55deb36c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 -- 172.21.15.137:0/4135753250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 msgr2=0x55deb36cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 -- 172.21.15.137:0/4135753250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36a6500 msgr2=0x55deb36c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36a6500 0x55deb36c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.806+0000 7fd1c2000640 1 -- 172.21.15.137:0/4135753250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb36aa930 con 0x55deb36aa1e0 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40d52d0 tx=0x7fd1b4003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68d5fcb9ce6a25c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1bb400640 1 -- 172.21.15.137:0/4135753250 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b409b7c0 con 0x55deb36aa1e0 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1bb400640 1 -- 172.21.15.137:0/4135753250 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1b40d5030 con 0x55deb36aa1e0 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1bb400640 1 -- 172.21.15.137:0/4135753250 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4097f20 con 0x55deb36aa1e0 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1d4987740 1 -- 172.21.15.137:0/4135753250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 msgr2=0x55deb36ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40d52d0 tx=0x7fd1b4003db0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1d4987740 1 -- 172.21.15.137:0/4135753250 shutdown_connections 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.807+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36aa1e0 0x55deb36ac080 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4135753250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36a6500 0x55deb36c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 -- 172.21.15.137:0/4135753250 >> 172.21.15.137:0/4135753250 conn(0x55deb36b0d20 msgr2=0x55deb36ab970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 -- 172.21.15.137:0/4135753250 shutdown_connections 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 -- 172.21.15.137:0/4135753250 wait complete. 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 -- start start 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.808+0000 7fd1d4987740 1 Processor -- start 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36bd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b1e00 con 0x55deb36a6500 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b3270 con 0x55deb36aa1e0 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1b24d0 con 0x55deb36aab00 2024-04-25T02:10:21.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1d4987740 10 client.0 _ll_register_callbacks cb 0x7fd1b40d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36286/0 (socket says 172.21.15.137:36286) 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 -- 172.21.15.137:0/4167327808 learned_addr learned my addr 172.21.15.137:0/4167327808 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1cb400640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 -- 172.21.15.137:0/4167327808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 msgr2=0x55deb36ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 -- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 msgr2=0x55deb36bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.809+0000 7fd1caa00640 1 -- 172.21.15.137:0/4167327808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb36ba940 con 0x55deb36a6500 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1caa00640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005530 tx=0x7fd1bc0054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ce48002a79855c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc057060 con 0x55deb36a6500 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd1bc030d40 con 0x55deb36a6500 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1b40d5030 con 0x55deb36a6500 2024-04-25T02:10:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd1bc0303a0 con 0x55deb36a6500 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1d4987740 10 client.15429 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55deb372c390 con 0x55deb36a6500 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1b40d5030 con 0x55deb36a6500 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.810+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd1bc050070 con 0x55deb36a6500 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 10 client.15429 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 20 client.15429 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36b51d0 0x55deb372e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 4 client.15429 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55deb361baa0 con 0x55deb36b51d0 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36b51d0 0x55deb372e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1c2000640 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36b51d0 0x55deb372e730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ecf643ba865de9 server_cookie=5d02f59a668a742a in_seq=0 out_seq=0 2024-04-25T02:10:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.811+0000 7fd1b8c00640 10 client.15429 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1b8c00640 1 -- 172.21.15.137:0/4167327808 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55deb361baa0 con 0x55deb36b51d0 2024-04-25T02:10:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1b8c00640 10 client.15429 handle_command_reply: tid=0 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 client.15429 shutdown 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 msgr2=0x55deb36bd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc005530 tx=0x7fd1bc0054c0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 shutdown_connections 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55deb36b51d0 0x55deb372e730 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55deb36aab00 0x55deb36ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55deb36aa1e0 0x55deb36bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1b8c00640 0 client.15429 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 --2- 172.21.15.137:0/4167327808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55deb36a6500 0x55deb36bd330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 >> 172.21.15.137:0/4167327808 conn(0x55deb36b0d20 msgr2=0x55deb36b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 shutdown_connections 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 1 -- 172.21.15.137:0/4167327808 wait complete. 2024-04-25T02:10:21.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.812+0000 7fd1d4987740 20 client.15429 trim_cache size 0 max 16384 2024-04-25T02:10:21.824 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:21.824 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-25T02:10:21.824 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-25T02:10:21.824 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:21.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 msgr2=0x7fd1b00a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 0x7fd1b00a53f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4005fd0 tx=0x7fd1c4009500 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 msgr2=0x7fd1cc19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400e9c0 tx=0x7fd1b400ee80 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 shutdown_connections 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd1b00a2f30 0x7fd1b00a53f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1cc10dd00 0x7fd1cc1a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1cc108680 0x7fd1cc19ea60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 --2- 172.21.15.137:0/193007866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1cc107ce0 0x7fd1cc19e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 >> 172.21.15.137:0/193007866 conn(0x7fd1cc077560 msgr2=0x7fd1cc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 shutdown_connections 2024-04-25T02:10:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:21.813+0000 7fd1cbe00640 1 -- 172.21.15.137:0/193007866 wait complete. 2024-04-25T02:10:21.836 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:10:21.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 -- 172.21.15.137:0/3723248116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6150068e10 msgr2=0x7f6150069270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 --2- 172.21.15.137:0/3723248116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6150068e10 0x7f6150069270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6138009900 tx=0x7f613802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 -- 172.21.15.137:0/3723248116 shutdown_connections 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 --2- 172.21.15.137:0/3723248116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f615010dda0 0x7f61501101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 --2- 172.21.15.137:0/3723248116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6150068e10 0x7f6150069270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 --2- 172.21.15.137:0/3723248116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 0x7f61500688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 -- 172.21.15.137:0/3723248116 >> 172.21.15.137:0/3723248116 conn(0x7f6150075f80 msgr2=0x7f6150076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 -- 172.21.15.137:0/3723248116 shutdown_connections 2024-04-25T02:10:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.035+0000 7f6155a00640 1 -- 172.21.15.137:0/3723248116 wait complete. 2024-04-25T02:10:22.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.036+0000 7f6155a00640 1 Processor -- start 2024-04-25T02:10:22.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 -- start start 2024-04-25T02:10:22.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 0x7f615019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 0x7f615019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6150113c80 con 0x7f6150068e10 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6150113b00 con 0x7f6150102440 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6150113e00 con 0x7f615010dda0 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f614fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 0x7f615019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f614fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 0x7f615019a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36316/0 (socket says 172.21.15.137:36316) 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6147400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 0x7f615019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f614fe00640 1 -- 172.21.15.137:0/2127236967 learned_addr learned my addr 172.21.15.137:0/2127236967 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.037+0000 7f6155000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35908/0 (socket says 172.21.15.137:35908) 2024-04-25T02:10:22.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 -- 172.21.15.137:0/2127236967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 msgr2=0x7f615019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 0x7f615019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 -- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 msgr2=0x7f615019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 0x7f615019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 -- 172.21.15.137:0/2127236967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615019f150 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155000640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f614800e970 tx=0x7f614800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800ccc0 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6148005020 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148004a20 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615019f440 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.038+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61501a6cd0 con 0x7f615010dda0 2024-04-25T02:10:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.039+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6150068480 con 0x7f615010dda0 2024-04-25T02:10:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.042+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f6148004c40 con 0x7f615010dda0 2024-04-25T02:10:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.043+0000 7f614d600640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 0x7f61340a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.043+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f61480cf9a0 con 0x7f615010dda0 2024-04-25T02:10:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.043+0000 7f614fe00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 0x7f61340a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.044+0000 7f614fe00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 0x7f61340a53f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61400049d0 tx=0x7f6140009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.045+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f614809c3b0 con 0x7f615010dda0 2024-04-25T02:10:22.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.290+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61501a6f70 con 0x7f615010dda0 2024-04-25T02:10:22.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.291+0000 7f614d600640 1 -- 172.21.15.137:0/2127236967 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11884 (secure 0 0 0) 0x7f614809bcb0 con 0x7f615010dda0 2024-04-25T02:10:22.299 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:10:22.299 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:09:41.384129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24559,24538]},"id":1}]} 2024-04-25T02:10:22.299 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 23 2024-04-25T02:10:22.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.294+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 msgr2=0x7f61340a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.294+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 0x7f61340a53f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61400049d0 tx=0x7f6140009500 comp rx=0 tx=0).stop 2024-04-25T02:10:22.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 msgr2=0x7f615019ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f614800e970 tx=0x7f614800ee30 comp rx=0 tx=0).stop 2024-04-25T02:10:22.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 shutdown_connections 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f61340a2f30 0x7f61340a53f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f615010dda0 0x7f615019ea20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6150102440 0x7f615019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 --2- 172.21.15.137:0/2127236967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6150068e10 0x7f615019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 >> 172.21.15.137:0/2127236967 conn(0x7f6150075f80 msgr2=0x7f61500ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 shutdown_connections 2024-04-25T02:10:22.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.295+0000 7f6155a00640 1 -- 172.21.15.137:0/2127236967 wait complete. 2024-04-25T02:10:22.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T02:10:22.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 -- 172.21.15.137:0/1322187882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8370109800 msgr2=0x7f8370109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 --2- 172.21.15.137:0/1322187882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8370109800 0x7f8370109be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8360009930 tx=0x7f836002a440 comp rx=0 tx=0).stop 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 -- 172.21.15.137:0/1322187882 shutdown_connections 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 --2- 172.21.15.137:0/1322187882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83701041b0 0x7f83701106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 --2- 172.21.15.137:0/1322187882 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f8370103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 --2- 172.21.15.137:0/1322187882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8370109800 0x7f8370109be0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 -- 172.21.15.137:0/1322187882 >> 172.21.15.137:0/1322187882 conn(0x7f83700ff280 msgr2=0x7f83701016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 -- 172.21.15.137:0/1322187882 shutdown_connections 2024-04-25T02:10:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.527+0000 7f836fe00640 1 -- 172.21.15.137:0/1322187882 wait complete. 2024-04-25T02:10:22.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 Processor -- start 2024-04-25T02:10:22.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 -- start start 2024-04-25T02:10:22.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 0x7f837019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8370109800 0x7f837019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8370113d80 con 0x7f83701041b0 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8370113c00 con 0x7f8370109800 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.528+0000 7f836fe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8370113f00 con 0x7f83701037f0 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f8366000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 0x7f837019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35936/0 (socket says 172.21.15.137:35936) 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 -- 172.21.15.137:0/2297309144 learned_addr learned my addr 172.21.15.137:0/2297309144 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f8366000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 0x7f837019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36342/0 (socket says 172.21.15.137:36342) 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836f400640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8370109800 0x7f837019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 -- 172.21.15.137:0/2297309144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8370109800 msgr2=0x7f837019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8370109800 0x7f837019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 -- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 msgr2=0x7f837019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 0x7f837019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.529+0000 7f836ea00640 1 -- 172.21.15.137:0/2297309144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837019f280 con 0x7f83701037f0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f836ea00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f836002a960 tx=0x7f83600329c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f8367e00640 1 -- 172.21.15.137:0/2297309144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836003f030 con 0x7f83701037f0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837019f510 con 0x7f83701037f0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f8367e00640 1 -- 172.21.15.137:0/2297309144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8360032df0 con 0x7f83701037f0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f8367e00640 1 -- 172.21.15.137:0/2297309144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360035070 con 0x7f83701037f0 2024-04-25T02:10:22.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.530+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83701a6e00 con 0x7f83701037f0 2024-04-25T02:10:22.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.533+0000 7f8378615740 1 Processor -- start 2024-04-25T02:10:22.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.533+0000 7f8367e00640 1 -- 172.21.15.137:0/2297309144 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f8360042030 con 0x7f83701037f0 2024-04-25T02:10:22.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.533+0000 7f8378615740 1 -- start start 2024-04-25T02:10:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb67882250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb67884b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb677dc4e0 con 0x55eb67882790 2024-04-25T02:10:22.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55eb67784a70 con 0x55eb678777a0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8378615740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb677d84a0 con 0x55eb678780c0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8366000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb67884b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8366000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb67884b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36348/0 (socket says 172.21.15.137:36348) 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:54808/0 (socket says 172.21.15.137:54808) 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f8366000640 1 -- 172.21.15.137:0/2563641605 learned_addr learned my addr 172.21.15.137:0/2563641605 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836ea00640 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb67882250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 -- 172.21.15.137:0/2563641605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 msgr2=0x55eb67882250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb67882250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 -- 172.21.15.137:0/2563641605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 msgr2=0x55eb67884b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb67884b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836f400640 1 -- 172.21.15.137:0/2563641605 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb674f03f0 con 0x55eb678777a0 2024-04-25T02:10:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.534+0000 7f836ea00640 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb67882250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f836f400640 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8368009eb0 tx=0x7f8368010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=233bd232cbdb4189 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f835fe00640 1 -- 172.21.15.137:0/2563641605 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368016070 con 0x55eb678777a0 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f8367e00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 0x7f83540a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f835fe00640 1 -- 172.21.15.137:0/2563641605 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8368004d20 con 0x55eb678777a0 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f835fe00640 1 -- 172.21.15.137:0/2563641605 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368012890 con 0x55eb678777a0 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f8367e00640 1 -- 172.21.15.137:0/2297309144 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f83600efa20 con 0x7f83701037f0 2024-04-25T02:10:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.535+0000 7f836ea00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 0x7f83540a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- 172.21.15.137:0/2563641605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 msgr2=0x55eb67877b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8368009eb0 tx=0x7f8368010740 comp rx=0 tx=0).stop 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- 172.21.15.137:0/2563641605 shutdown_connections 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb67884b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb67882250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 --2- 172.21.15.137:0/2563641605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb67877b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- 172.21.15.137:0/2563641605 >> 172.21.15.137:0/2563641605 conn(0x55eb67873ac0 msgr2=0x55eb67873ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f836ea00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 0x7f83540a5370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83600ecfc0 tx=0x7f8360009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- 172.21.15.137:0/2563641605 shutdown_connections 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- 172.21.15.137:0/2563641605 wait complete. 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.536+0000 7f8378615740 1 -- start start 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 Processor -- start 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678780c0 0x55eb6787fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb67882790 0x55eb678801c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb67885580 con 0x55eb678780c0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55eb67797ec0 con 0x55eb67882790 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55eb67885700 con 0x55eb678777a0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8378615740 10 client.0 _ll_register_callbacks cb 0x55eb677d43f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f836f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f836f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35952/0 (socket says 172.21.15.137:35952) 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f836f400640 1 -- 172.21.15.137:0/2920883983 learned_addr learned my addr 172.21.15.137:0/2920883983 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f8366000640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678780c0 0x55eb6787fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.537+0000 7f836f400640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb67882790 0x55eb678801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 -- 172.21.15.137:0/2920883983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb67882790 msgr2=0x55eb678801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb67882790 0x55eb678801c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 -- 172.21.15.137:0/2920883983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678780c0 msgr2=0x55eb6787fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678780c0 0x55eb6787fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 -- 172.21.15.137:0/2920883983 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb675ba7d0 con 0x55eb678777a0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f836f400640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a00 tx=0x7f83680124f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c381539db1cac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f835cc00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368016040 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8368012cc0 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.538+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8368004d20 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8368003970 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 10 client.25573 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55eb67891840 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8368004d20 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f8368028040 con 0x55eb678777a0 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 10 client.25573 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 10 client.25573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 20 client.25573 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb67892bf0 0x55eb67894fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 4 client.25573 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.539+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb677e9a20 con 0x55eb67892bf0 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.540+0000 7f8366000640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb67892bf0 0x55eb67894fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.540+0000 7f8366000640 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb67892bf0 0x55eb67894fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=877743803006597f server_cookie=dc7236ffab2c589d in_seq=0 out_seq=0 2024-04-25T02:10:22.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.540+0000 7f835cc00640 10 client.25573 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f835cc00640 1 -- 172.21.15.137:0/2920883983 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb677e9a20 con 0x55eb67892bf0 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f835cc00640 10 client.25573 handle_command_reply: tid=0 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f8378615740 1 client.25573 shutdown 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 msgr2=0x55eb6787f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a00 tx=0x7f83680124f0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.541+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 shutdown_connections 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb67882790 0x55eb678801c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678780c0 0x55eb6787fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb67892bf0 0x55eb67894fe0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 --2- 172.21.15.137:0/2920883983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678777a0 0x55eb6787f740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f835cc00640 0 client.25573 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 >> 172.21.15.137:0/2920883983 conn(0x55eb67873ac0 msgr2=0x55eb678798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 shutdown_connections 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 1 -- 172.21.15.137:0/2920883983 wait complete. 2024-04-25T02:10:22.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.542+0000 7f8378615740 20 client.25573 trim_cache size 0 max 16384 2024-04-25T02:10:22.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.556+0000 7f8378615740 1 Processor -- start 2024-04-25T02:10:22.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 -- start start 2024-04-25T02:10:22.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb6788e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb678729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83701b1d90 con 0x55eb67882790 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f83701af660 con 0x55eb678777a0 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8378615740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83701ad4b0 con 0x55eb678780c0 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f836f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f836f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36356/0 (socket says 172.21.15.137:36356) 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f836f400640 1 -- 172.21.15.137:0/3870218638 learned_addr learned my addr 172.21.15.137:0/3870218638 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f836f400640 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb6788e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.557+0000 7f8366000640 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb678729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 -- 172.21.15.137:0/3870218638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 msgr2=0x55eb678729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb678729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 -- 172.21.15.137:0/3870218638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 msgr2=0x55eb6788e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb6788e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 -- 172.21.15.137:0/3870218638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb67877ef0 con 0x55eb67882790 2024-04-25T02:10:22.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f836f400640 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8368032b80 tx=0x7f8368009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa62d0afd19796b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f835f400640 1 -- 172.21.15.137:0/3870218638 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368038070 con 0x55eb67882790 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f835f400640 1 -- 172.21.15.137:0/3870218638 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8368039040 con 0x55eb67882790 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.558+0000 7f835f400640 1 -- 172.21.15.137:0/3870218638 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368016040 con 0x55eb67882790 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- 172.21.15.137:0/3870218638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 msgr2=0x55eb6787ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8368032b80 tx=0x7f8368009600 comp rx=0 tx=0).stop 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- 172.21.15.137:0/3870218638 shutdown_connections 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb67882790 0x55eb6787ffe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb678780c0 0x55eb678729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 --2- 172.21.15.137:0/3870218638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678777a0 0x55eb6788e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- 172.21.15.137:0/3870218638 >> 172.21.15.137:0/3870218638 conn(0x55eb67873ac0 msgr2=0x55eb678722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- 172.21.15.137:0/3870218638 shutdown_connections 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- 172.21.15.137:0/3870218638 wait complete. 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.559+0000 7f8378615740 1 -- start start 2024-04-25T02:10:22.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 Processor -- start 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 0x55eb6787bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb67882790 0x55eb6787c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83701adb20 con 0x55eb678777a0 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f83701aef90 con 0x55eb678780c0 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83701ae1f0 con 0x55eb67882790 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8378615740 10 client.0 _ll_register_callbacks cb 0x7f8358009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f836f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f836f400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36368/0 (socket says 172.21.15.137:36368) 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f836f400640 1 -- 172.21.15.137:0/1330482358 learned_addr learned my addr 172.21.15.137:0/1330482358 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.560+0000 7f8366000640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 0x55eb6787bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb67882790 0x55eb6787c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 -- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb67882790 msgr2=0x55eb6787c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb67882790 0x55eb6787c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 -- 172.21.15.137:0/1330482358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 msgr2=0x55eb6787bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 0x55eb6787bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 -- 172.21.15.137:0/1330482358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb6787a560 con 0x55eb678777a0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f8366000640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 0x55eb6787bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f836f400640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a00 tx=0x7f8368005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77807efd4c492b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f835cc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368016050 con 0x55eb678777a0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8368032730 con 0x55eb678777a0 2024-04-25T02:10:22.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.561+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8368039040 con 0x55eb678777a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8368038040 con 0x55eb678777a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 10 client.15453 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55eb678f8af0 con 0x55eb678777a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8368039040 con 0x55eb678777a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f836800f040 con 0x55eb678777a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 10 client.15453 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 10 client.15453 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 20 client.15453 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb678f90a0 0x55eb678fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 4 client.15453 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.562+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb677e3d70 con 0x55eb678f90a0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f8366000640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb678f90a0 0x55eb678fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f8366000640 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb678f90a0 0x55eb678fb490 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3873cfb514c46686 server_cookie=74ecfd789237ae83 in_seq=0 out_seq=0 2024-04-25T02:10:22.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f835cc00640 10 client.15453 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:22.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f835cc00640 1 -- 172.21.15.137:0/1330482358 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb677e3d70 con 0x55eb678f90a0 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f835cc00640 10 client.15453 handle_command_reply: tid=0 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.563+0000 7f8378615740 1 client.15453 shutdown 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 msgr2=0x55eb6788ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8368012a00 tx=0x7f8368005fd0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 shutdown_connections 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55eb678f90a0 0x55eb678fb490 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55eb67882790 0x55eb6787c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55eb678780c0 0x55eb6787bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 --2- 172.21.15.137:0/1330482358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb678777a0 0x55eb6788ab40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f835cc00640 0 client.15453 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 >> 172.21.15.137:0/1330482358 conn(0x55eb67873ac0 msgr2=0x55eb67872b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 shutdown_connections 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 1 -- 172.21.15.137:0/1330482358 wait complete. 2024-04-25T02:10:22.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f8378615740 20 client.15453 trim_cache size 0 max 16384 2024-04-25T02:10:22.575 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:22.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 msgr2=0x7f83540a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 0x7f83540a5370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83600ecfc0 tx=0x7f8360009260 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.564+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 msgr2=0x7f837019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f836002a960 tx=0x7f83600329c0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 shutdown_connections 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f83540a2eb0 0x7f83540a5370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8370109800 0x7f837019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83701041b0 0x7f837019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 --2- 172.21.15.137:0/2297309144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f83701037f0 0x7f837019a2e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 >> 172.21.15.137:0/2297309144 conn(0x7f83700ff280 msgr2=0x7f83700ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 shutdown_connections 2024-04-25T02:10:22.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.565+0000 7f836fe00640 1 -- 172.21.15.137:0/2297309144 wait complete. 2024-04-25T02:10:22.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T02:10:22.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 -- 172.21.15.137:0/3763318973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 msgr2=0x7fdcf4103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 --2- 172.21.15.137:0/3763318973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf4103c70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009930 tx=0x7fdcdc02a420 comp rx=0 tx=0).stop 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 -- 172.21.15.137:0/3763318973 shutdown_connections 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 --2- 172.21.15.137:0/3763318973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf41106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 --2- 172.21.15.137:0/3763318973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf4103c70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 --2- 172.21.15.137:0/3763318973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf4109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 -- 172.21.15.137:0/3763318973 >> 172.21.15.137:0/3763318973 conn(0x7fdcf40ff280 msgr2=0x7fdcf41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 -- 172.21.15.137:0/3763318973 shutdown_connections 2024-04-25T02:10:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.785+0000 7fdcf9400640 1 -- 172.21.15.137:0/3763318973 wait complete. 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.786+0000 7fdcf9400640 1 Processor -- start 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.786+0000 7fdcf9400640 1 -- start start 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113d80 con 0x7fdcf4109800 2024-04-25T02:10:22.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113c00 con 0x7fdcf41041b0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf9400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf4113f00 con 0x7fdcf41037f0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36388/0 (socket says 172.21.15.137:36388) 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35976/0 (socket says 172.21.15.137:35976) 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf8a00640 1 -- 172.21.15.137:0/57254915 learned_addr learned my addr 172.21.15.137:0/57254915 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 -- 172.21.15.137:0/57254915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 msgr2=0x7fdcf419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 -- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 msgr2=0x7fdcf419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.787+0000 7fdcf3400640 1 -- 172.21.15.137:0/57254915 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf419f260 con 0x7fdcf41041b0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf3400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf419a800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc02a940 tx=0x7fdcdc032910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf0c00640 1 -- 172.21.15.137:0/57254915 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc03f030 con 0x7fdcf41041b0 2024-04-25T02:10:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf0c00640 1 -- 172.21.15.137:0/57254915 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcdc032d10 con 0x7fdcf41041b0 2024-04-25T02:10:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf419f4f0 con 0x7fdcf41041b0 2024-04-25T02:10:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf0c00640 1 -- 172.21.15.137:0/57254915 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc035070 con 0x7fdcf41041b0 2024-04-25T02:10:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.788+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf41a6de0 con 0x7fdcf41041b0 2024-04-25T02:10:22.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.791+0000 7fdcfd79d740 1 Processor -- start 2024-04-25T02:10:22.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.791+0000 7fdcfd79d740 1 -- start start 2024-04-25T02:10:22.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5b0c0 0x56416ed65250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed67b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56416ecbf4e0 con 0x56416ed5a7a0 2024-04-25T02:10:22.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56416ec67a70 con 0x56416ed5b0c0 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56416ecbb4a0 con 0x56416ed65790 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf0c00640 1 -- 172.21.15.137:0/57254915 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fdcdc042030 con 0x7fdcf41041b0 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed67b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36400/0 (socket says 172.21.15.137:36400) 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed67b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35988/0 (socket says 172.21.15.137:35988) 2024-04-25T02:10:22.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.792+0000 7fdcf8a00640 1 -- 172.21.15.137:0/1784386930 learned_addr learned my addr 172.21.15.137:0/1784386930 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 -- 172.21.15.137:0/1784386930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 msgr2=0x56416ed67b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed67b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 -- 172.21.15.137:0/1784386930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5b0c0 msgr2=0x56416ed65250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5b0c0 0x56416ed65250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 -- 172.21.15.137:0/1784386930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416e9d33f0 con 0x56416ed5a7a0 2024-04-25T02:10:22.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0115b0 tx=0x7fdcec011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b9fa481cd7868d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdce9200640 1 -- 172.21.15.137:0/1784386930 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec01e070 con 0x56416ed5a7a0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdce9200640 1 -- 172.21.15.137:0/1784386930 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcec00fb60 con 0x56416ed5a7a0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.793+0000 7fdce9200640 1 -- 172.21.15.137:0/1784386930 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec019d80 con 0x56416ed5a7a0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcf0c00640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 0x7fdcd80a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcf0c00640 1 -- 172.21.15.137:0/57254915 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdcdc0ef850 con 0x7fdcf41041b0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 0x7fdcd80a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 -- 172.21.15.137:0/1784386930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 msgr2=0x56416ed5ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0115b0 tx=0x7fdcec011a70 comp rx=0 tx=0).stop 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 -- 172.21.15.137:0/1784386930 shutdown_connections 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed67b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5b0c0 0x56416ed65250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/1784386930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed5ab80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 -- 172.21.15.137:0/1784386930 >> 172.21.15.137:0/1784386930 conn(0x56416ed56ac0 msgr2=0x56416ed56ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.794+0000 7fdcfd79d740 1 -- 172.21.15.137:0/1784386930 shutdown_connections 2024-04-25T02:10:22.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.795+0000 7fdcfd79d740 1 -- 172.21.15.137:0/1784386930 wait complete. 2024-04-25T02:10:22.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.795+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 0x7fdcd80a53f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009fd0 tx=0x7fdce4009e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.795+0000 7fdcfd79d740 1 -- start start 2024-04-25T02:10:22.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.795+0000 7fdcfd79d740 1 Processor -- start 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5a7a0 0x56416ed62690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56416ed68580 con 0x56416ed5b0c0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56416ec7aec0 con 0x56416ed5a7a0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56416ed68700 con 0x56416ed65790 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcfd79d740 10 client.0 _ll_register_callbacks cb 0x56416ecb73f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed62bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36414/0 (socket says 172.21.15.137:36414) 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:35994/0 (socket says 172.21.15.137:35994) 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf3400640 1 -- 172.21.15.137:0/3376231002 learned_addr learned my addr 172.21.15.137:0/3376231002 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 -- 172.21.15.137:0/3376231002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5a7a0 msgr2=0x56416ed62690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5a7a0 0x56416ed62690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 -- 172.21.15.137:0/3376231002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 msgr2=0x56416ed62bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.796+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed62bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdcf8a00640 1 -- 172.21.15.137:0/3376231002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416ea9d7d0 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcec011580 tx=0x7fdcec019600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=145285d21a557b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdce1600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec027060 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcec00fb60 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdcec00f660 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdcec01e040 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdcfd79d740 10 client.25591 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.797+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56416ed74800 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcec00fb60 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fdcec021070 con 0x56416ed65790 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 10 client.25591 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 10 client.25591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 20 client.25591 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:22.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416ed75bb0 0x56416ed77fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 4 client.25591 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.798+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56416eccca20 con 0x56416ed75bb0 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.799+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416ed75bb0 0x56416ed77fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.799+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416ed75bb0 0x56416ed77fa0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8ef6ef95b03400b server_cookie=6cab0350ec232020 in_seq=0 out_seq=0 2024-04-25T02:10:22.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.799+0000 7fdce1600640 10 client.25591 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.800+0000 7fdce1600640 1 -- 172.21.15.137:0/3376231002 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56416eccca20 con 0x56416ed75bb0 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.800+0000 7fdce1600640 10 client.25591 handle_command_reply: tid=0 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 client.25591 shutdown 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 msgr2=0x56416ed63110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdcec011580 tx=0x7fdcec019600 comp rx=0 tx=0).stop 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 shutdown_connections 2024-04-25T02:10:22.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416ed75bb0 0x56416ed77fa0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed65790 0x56416ed63110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed62bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdce1600640 0 client.25591 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3376231002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed5a7a0 0x56416ed62690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 >> 172.21.15.137:0/3376231002 conn(0x56416ed56ac0 msgr2=0x56416ed5c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 shutdown_connections 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3376231002 wait complete. 2024-04-25T02:10:22.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.801+0000 7fdcfd79d740 20 client.25591 trim_cache size 0 max 16384 2024-04-25T02:10:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 Processor -- start 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 -- start start 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5b0c0 0x56416ed62f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed7d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41b1e20 con 0x56416ed5a7a0 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41af6f0 con 0x56416ed65790 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41ad540 con 0x56416ed5b0c0 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcf3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36428/0 (socket says 172.21.15.137:36428) 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcf3e00640 1 -- 172.21.15.137:0/2107507633 learned_addr learned my addr 172.21.15.137:0/2107507633 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed7d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.816+0000 7fdcf3400640 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5b0c0 0x56416ed62f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 -- 172.21.15.137:0/2107507633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5b0c0 msgr2=0x56416ed62f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5b0c0 0x56416ed62f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 -- 172.21.15.137:0/2107507633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 msgr2=0x56416ed7d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed7d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 -- 172.21.15.137:0/2107507633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416ed68460 con 0x56416ed5a7a0 2024-04-25T02:10:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56416ed78660 tx=0x7fdce4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b497882dc2a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdce3e00640 1 -- 172.21.15.137:0/2107507633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4025250 con 0x56416ed5a7a0 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdce3e00640 1 -- 172.21.15.137:0/2107507633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdce40258f0 con 0x56416ed5a7a0 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.817+0000 7fdce3e00640 1 -- 172.21.15.137:0/2107507633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce401ebe0 con 0x56416ed5a7a0 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 -- 172.21.15.137:0/2107507633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 msgr2=0x56416ed71470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56416ed78660 tx=0x7fdce4014000 comp rx=0 tx=0).stop 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 -- 172.21.15.137:0/2107507633 shutdown_connections 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed7d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5b0c0 0x56416ed62f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/2107507633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5a7a0 0x56416ed71470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 -- 172.21.15.137:0/2107507633 >> 172.21.15.137:0/2107507633 conn(0x56416ed56ac0 msgr2=0x56416ed55b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 -- 172.21.15.137:0/2107507633 shutdown_connections 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.818+0000 7fdcfd79d740 1 -- 172.21.15.137:0/2107507633 wait complete. 2024-04-25T02:10:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 -- start start 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 Processor -- start 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5a7a0 0x56416ed6dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed69500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41adbb0 con 0x56416ed5b0c0 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41af020 con 0x56416ed65790 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf41ae280 con 0x56416ed5a7a0 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.819+0000 7fdcfd79d740 10 client.0 _ll_register_callbacks cb 0x7fdcec01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36444/0 (socket says 172.21.15.137:36444) 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 -- 172.21.15.137:0/3585215037 learned_addr learned my addr 172.21.15.137:0/3585215037 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5a7a0 0x56416ed6dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf8a00640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed69500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 -- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5a7a0 msgr2=0x56416ed6dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5a7a0 0x56416ed6dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 -- 172.21.15.137:0/3585215037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 msgr2=0x56416ed69500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed69500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 -- 172.21.15.137:0/3585215037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416ed69b40 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdcf3400640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0b85e0 tx=0x7fdcdc032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bd6390bab518b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.820+0000 7fdce1600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc049040 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdcdc0c4340 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce40258f0 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdcdc0bb750 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 10 client.15471 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56416eddbe30 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdce40258f0 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fdcdc0da2e0 con 0x56416ed5b0c0 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 10 client.15471 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 10 client.15471 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:10:22.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 20 client.15471 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416eddc5e0 0x56416eddea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 4 client.15471 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.821+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56416ecc6d70 con 0x56416eddc5e0 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.822+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416eddc5e0 0x56416eddea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.822+0000 7fdcf3e00640 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416eddc5e0 0x56416eddea00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4ec70b78a06951bc server_cookie=85fe9d7f0633d8b3 in_seq=0 out_seq=0 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.822+0000 7fdce1600640 10 client.15471 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdce1600640 1 -- 172.21.15.137:0/3585215037 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56416ecc6d70 con 0x56416eddc5e0 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdce1600640 10 client.15471 handle_command_reply: tid=0 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 client.15471 shutdown 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 msgr2=0x56416ed68fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0b85e0 tx=0x7fdcdc032f50 comp rx=0 tx=0).stop 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 shutdown_connections 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x56416eddc5e0 0x56416eddea00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56416ed65790 0x56416ed69500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56416ed5b0c0 0x56416ed68fc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdce1600640 0 client.15471 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 --2- 172.21.15.137:0/3585215037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56416ed5a7a0 0x56416ed6dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 >> 172.21.15.137:0/3585215037 conn(0x56416ed56ac0 msgr2=0x56416ed5bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 shutdown_connections 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 1 -- 172.21.15.137:0/3585215037 wait complete. 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.823+0000 7fdcfd79d740 20 client.15471 trim_cache size 0 max 16384 2024-04-25T02:10:22.833 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 msgr2=0x7fdcd80a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 0x7fdcd80a53f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009fd0 tx=0x7fdce4009e80 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 msgr2=0x7fdcf419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf419a800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc02a940 tx=0x7fdcdc032910 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 shutdown_connections 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdcd80a2f30 0x7fdcd80a53f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf4109800 0x7fdcf419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdcf41041b0 0x7fdcf419a800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 --2- 172.21.15.137:0/57254915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcf41037f0 0x7fdcf419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 >> 172.21.15.137:0/57254915 conn(0x7fdcf40ff280 msgr2=0x7fdcf40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 shutdown_connections 2024-04-25T02:10:22.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:22.824+0000 7fdcf9400640 1 -- 172.21.15.137:0/57254915 wait complete. 2024-04-25T02:10:22.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T02:10:23.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 -- 172.21.15.137:0/232364968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4102830 msgr2=0x7f0fc4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 --2- 172.21.15.137:0/232364968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4102830 0x7f0fc4102c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009900 tx=0x7f0fb802a480 comp rx=0 tx=0).stop 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 -- 172.21.15.137:0/232364968 shutdown_connections 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 --2- 172.21.15.137:0/232364968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 0x7f0fc410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 --2- 172.21.15.137:0/232364968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4103150 0x7f0fc410b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 --2- 172.21.15.137:0/232364968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4102830 0x7f0fc4102c10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 -- 172.21.15.137:0/232364968 >> 172.21.15.137:0/232364968 conn(0x7f0fc40fc010 msgr2=0x7f0fc40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 -- 172.21.15.137:0/232364968 shutdown_connections 2024-04-25T02:10:23.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.032+0000 7f0fcc200640 1 -- 172.21.15.137:0/232364968 wait complete. 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.033+0000 7f0fcc200640 1 Processor -- start 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.033+0000 7f0fcc200640 1 -- start start 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4102830 0x7f0fc419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 0x7f0fc419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc4111b50 con 0x7f0fc410bc00 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41119d0 con 0x7f0fc4103150 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fcc200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc4111cd0 con 0x7f0fc4102830 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:54916/0 (socket says 172.21.15.137:54916) 2024-04-25T02:10:23.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fc8e00640 1 -- 172.21.15.137:0/2675040115 learned_addr learned my addr 172.21.15.137:0/2675040115 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fca200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 0x7f0fc419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.034+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4102830 0x7f0fc419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 -- 172.21.15.137:0/2675040115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4102830 msgr2=0x7f0fc419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4102830 0x7f0fc419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 -- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 msgr2=0x7f0fc419ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 0x7f0fc419ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 -- 172.21.15.137:0/2675040115 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc419f1b0 con 0x7f0fc4103150 2024-04-25T02:10:23.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9f0 tx=0x7f0fb000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc2000640 1 -- 172.21.15.137:0/2675040115 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000cd80 con 0x7f0fc4103150 2024-04-25T02:10:23.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc419f4a0 con 0x7f0fc4103150 2024-04-25T02:10:23.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc2000640 1 -- 172.21.15.137:0/2675040115 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fb0010930 con 0x7f0fc4103150 2024-04-25T02:10:23.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fc2000640 1 -- 172.21.15.137:0/2675040115 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0018b00 con 0x7f0fc4103150 2024-04-25T02:10:23.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.035+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc41a6d30 con 0x7f0fc4103150 2024-04-25T02:10:23.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.038+0000 7f0fcf1be740 1 Processor -- start 2024-04-25T02:10:23.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 -- start start 2024-04-25T02:10:23.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953521250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d953523b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d95347b4e0 con 0x55d9535170c0 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d953423a70 con 0x55d953521790 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d9534774a0 con 0x55d9535167a0 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fc2000640 1 -- 172.21.15.137:0/2675040115 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f0fb0018ca0 con 0x7f0fc4103150 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fca200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fca200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36032/0 (socket says 172.21.15.137:36032) 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fc9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953521250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.039+0000 7f0fca200640 1 -- 172.21.15.137:0/3388574211 learned_addr learned my addr 172.21.15.137:0/3388574211 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d953523b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 -- 172.21.15.137:0/3388574211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 msgr2=0x55d953523b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d953523b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 -- 172.21.15.137:0/3388574211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 msgr2=0x55d953521250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953521250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 -- 172.21.15.137:0/3388574211 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95318f3f0 con 0x55d9535167a0 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d953523b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fc9800640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953521250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fca200640 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009f50 tx=0x7f0fbc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb3ba67045a6c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fb6a00640 1 -- 172.21.15.137:0/3388574211 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc004d20 con 0x55d9535167a0 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fb6a00640 1 -- 172.21.15.137:0/3388574211 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fbc004050 con 0x55d9535167a0 2024-04-25T02:10:23.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.040+0000 7f0fb6a00640 1 -- 172.21.15.137:0/3388574211 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc005260 con 0x55d9535167a0 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fc2000640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 0x7f0fac0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3388574211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 msgr2=0x55d953516b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009f50 tx=0x7f0fbc0118d0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fc2000640 1 -- 172.21.15.137:0/2675040115 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0fb00cfa80 con 0x7f0fc4103150 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3388574211 shutdown_connections 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 0x7f0fac0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d953523b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953521250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3388574211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953516b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3388574211 >> 172.21.15.137:0/3388574211 conn(0x55d953512ac0 msgr2=0x55d953512ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3388574211 shutdown_connections 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.041+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3388574211 wait complete. 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.042+0000 7f0fcf1be740 1 -- start start 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.042+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 0x7f0fac0a5370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8000c00 tx=0x7f0fb8005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.042+0000 7f0fcf1be740 1 Processor -- start 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d95351e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d95351f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d953524580 con 0x55d9535170c0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d953436ec0 con 0x55d9535167a0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d953524700 con 0x55d953521790 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fcf1be740 10 client.0 _ll_register_callbacks cb 0x55d9534733f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d95351e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36494/0 (socket says 172.21.15.137:36494) 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fca200640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d95351f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 -- 172.21.15.137:0/895869276 learned_addr learned my addr 172.21.15.137:0/895869276 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 -- 172.21.15.137:0/895869276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 msgr2=0x55d95351f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d95351f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 -- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 msgr2=0x55d95351e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d95351e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.043+0000 7f0fc8e00640 1 -- 172.21.15.137:0/895869276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9532597d0 con 0x55d9535170c0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009830 tx=0x7f0fb009b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9e5099a70489ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fab400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb009b490 con 0x55d9535170c0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0fb0010430 con 0x55d9535170c0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fbc004050 con 0x55d9535170c0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0fb00b9050 con 0x55d9535170c0 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fcf1be740 10 client.15483 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:23.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d953530840 con 0x55d9535170c0 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.044+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fbc004050 con 0x55d9535170c0 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0fb009ad70 con 0x55d9535170c0 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 10 client.15483 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 20 client.15483 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d953531c50 0x55d953534040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 4 client.15483 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d953488a20 con 0x55d953531c50 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.045+0000 7f0fc9800640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d953531c50 0x55d953534040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.046+0000 7f0fc9800640 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d953531c50 0x55d953534040 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3b8139ba55d385 server_cookie=9dae87ae63e3f13a in_seq=0 out_seq=0 2024-04-25T02:10:23.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.046+0000 7f0fab400640 10 client.15483 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:23.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fab400640 1 -- 172.21.15.137:0/895869276 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d953488a20 con 0x55d953531c50 2024-04-25T02:10:23.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fab400640 10 client.15483 handle_command_reply: tid=0 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 client.15483 shutdown 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 msgr2=0x55d95351ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009830 tx=0x7f0fb009b7a0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 shutdown_connections 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d953531c50 0x55d953534040 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d95351f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351ecb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/895869276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d95351e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 >> 172.21.15.137:0/895869276 conn(0x55d953512ac0 msgr2=0x55d9535188c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fab400640 0 client.15483 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 shutdown_connections 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 1 -- 172.21.15.137:0/895869276 wait complete. 2024-04-25T02:10:23.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.047+0000 7f0fcf1be740 20 client.15483 trim_cache size 0 max 16384 2024-04-25T02:10:23.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.062+0000 7f0fcf1be740 1 Processor -- start 2024-04-25T02:10:23.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.062+0000 7f0fcf1be740 1 -- start start 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d9535119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41b1dc0 con 0x55d9535170c0 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41af690 con 0x55d9535167a0 2024-04-25T02:10:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41ad4e0 con 0x55d953521790 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fc9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fc9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:54930/0 (socket says 172.21.15.137:54930) 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fc9800640 1 -- 172.21.15.137:0/3061024286 learned_addr learned my addr 172.21.15.137:0/3061024286 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fca200640 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d9535119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.063+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 -- 172.21.15.137:0/3061024286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 msgr2=0x55d9535119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d9535119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 -- 172.21.15.137:0/3061024286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 msgr2=0x55d95351f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 -- 172.21.15.137:0/3061024286 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d953523b80 con 0x55d9535167a0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fc9800640 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009230 tx=0x7f0fb803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59137fbd3a02473f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fb6000640 1 -- 172.21.15.137:0/3061024286 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8035040 con 0x55d9535167a0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fb6000640 1 -- 172.21.15.137:0/3061024286 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fb805a070 con 0x55d9535167a0 2024-04-25T02:10:23.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.064+0000 7f0fb6000640 1 -- 172.21.15.137:0/3061024286 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8032650 con 0x55d9535167a0 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3061024286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 msgr2=0x55d953518f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009230 tx=0x7f0fb803f000 comp rx=0 tx=0).stop 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3061024286 shutdown_connections 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d953521790 0x55d9535119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d95351f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/3061024286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d9535167a0 0x55d953518f40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3061024286 >> 172.21.15.137:0/3061024286 conn(0x55d953512ac0 msgr2=0x55d9535112b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3061024286 shutdown_connections 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- 172.21.15.137:0/3061024286 wait complete. 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.065+0000 7f0fcf1be740 1 -- start start 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 Processor -- start 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953524b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41adb50 con 0x55d9535170c0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41aefc0 con 0x55d953521790 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41ae220 con 0x55d9535167a0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fcf1be740 10 client.0 _ll_register_callbacks cb 0x7f0fb0018420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fca200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fca200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:54942/0 (socket says 172.21.15.137:54942) 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36520/0 (socket says 172.21.15.137:36520) 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fca200640 1 -- 172.21.15.137:0/2244198694 learned_addr learned my addr 172.21.15.137:0/2244198694 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.066+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953524b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 -- 172.21.15.137:0/2244198694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 msgr2=0x55d953524b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953524b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 -- 172.21.15.137:0/2244198694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 msgr2=0x55d953525040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 -- 172.21.15.137:0/2244198694 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d95359ef20 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fc8e00640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953524b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fca200640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc01b040 tx=0x7f0fbc0050c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02e45595ae03e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fab400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.067+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc005500 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb805a070 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0fbc0056a0 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0fbc0058a0 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 10 client.25562 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d9535a0200 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fb805a070 con 0x55d953521790 2024-04-25T02:10:23.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0fbc0195c0 con 0x55d953521790 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 10 client.25562 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 20 client.25562 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d9535a0810 0x55d9535a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 4 client.25562 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.068+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d953482d70 con 0x55d9535a0810 2024-04-25T02:10:23.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.069+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d9535a0810 0x55d9535a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.069+0000 7f0fc9800640 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d9535a0810 0x55d9535a2c30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f602e9b11a70eea5 server_cookie=a37fc8172656508c in_seq=0 out_seq=0 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.069+0000 7f0fab400640 10 client.25562 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.069+0000 7f0fab400640 1 -- 172.21.15.137:0/2244198694 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d953482d70 con 0x55d9535a0810 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fab400640 10 client.25562 handle_command_reply: tid=0 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 client.25562 shutdown 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 msgr2=0x55d95359e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc01b040 tx=0x7f0fbc0050c0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 shutdown_connections 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d9535a0810 0x55d9535a2c30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d953521790 0x55d95359e960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9535170c0 0x55d953525040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 --2- 172.21.15.137:0/2244198694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d9535167a0 0x55d953524b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 >> 172.21.15.137:0/2244198694 conn(0x55d953512ac0 msgr2=0x55d953511b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fab400640 0 client.25562 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 shutdown_connections 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 1 -- 172.21.15.137:0/2244198694 wait complete. 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.070+0000 7f0fcf1be740 20 client.25562 trim_cache size 0 max 16384 2024-04-25T02:10:23.081 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 msgr2=0x7f0fac0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 0x7f0fac0a5370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8000c00 tx=0x7f0fb8005e80 comp rx=0 tx=0).stop 2024-04-25T02:10:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 msgr2=0x7f0fc419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9f0 tx=0x7f0fb000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 shutdown_connections 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0fac0a2eb0 0x7f0fac0a5370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0fc410bc00 0x7f0fc419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0fc4103150 0x7f0fc419a700 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 --2- 172.21.15.137:0/2675040115 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc4102830 0x7f0fc419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 >> 172.21.15.137:0/2675040115 conn(0x7f0fc40fc010 msgr2=0x7f0fc40fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 shutdown_connections 2024-04-25T02:10:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:23.071+0000 7f0fcc200640 1 -- 172.21.15.137:0/2675040115 wait complete. 2024-04-25T02:10:23.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:23 smithi174 ceph-mon[33171]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:10:23.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:23 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2127236967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:23.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:23 smithi137 ceph-mon[28303]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:10:23.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:23 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2127236967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:23.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:23 smithi163 ceph-mon[32577]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:10:23.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:23 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2127236967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:24.098 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T02:10:24.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:24.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.296+0000 7fa430200640 1 -- 172.21.15.137:0/676190516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 msgr2=0x7fa428073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.296+0000 7fa430200640 1 --2- 172.21.15.137:0/676190516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa428073ec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009900 tx=0x7fa41c02a480 comp rx=0 tx=0).stop 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 -- 172.21.15.137:0/676190516 shutdown_connections 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 --2- 172.21.15.137:0/676190516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa428114af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 --2- 172.21.15.137:0/676190516 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 0x7fa4281121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 --2- 172.21.15.137:0/676190516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa428073ec0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 -- 172.21.15.137:0/676190516 >> 172.21.15.137:0/676190516 conn(0x7fa4280fd1c0 msgr2=0x7fa4280ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 -- 172.21.15.137:0/676190516 shutdown_connections 2024-04-25T02:10:24.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.297+0000 7fa430200640 1 -- 172.21.15.137:0/676190516 wait complete. 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 Processor -- start 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 -- start start 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa42819e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 0x7fa42819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa428118270 con 0x7fa428112700 2024-04-25T02:10:24.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281180f0 con 0x7fa428074400 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.298+0000 7fa430200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281183f0 con 0x7fa428073ae0 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36542/0 (socket says 172.21.15.137:36542) 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 -- 172.21.15.137:0/3045493702 learned_addr learned my addr 172.21.15.137:0/3045493702 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42d800640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa42819e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 0x7fa42819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 -- 172.21.15.137:0/3045493702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 msgr2=0x7fa42819e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa42819e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 -- 172.21.15.137:0/3045493702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 msgr2=0x7fa42819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 0x7fa42819ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.299+0000 7fa42e200640 1 -- 172.21.15.137:0/3045493702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4281a3740 con 0x7fa428112700 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa42e200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa420009c90 tx=0x7fa42000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa426000640 1 -- 172.21.15.137:0/3045493702 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420003b70 con 0x7fa428112700 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa426000640 1 -- 172.21.15.137:0/3045493702 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa420003d10 con 0x7fa428112700 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4281a3a30 con 0x7fa428112700 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa426000640 1 -- 172.21.15.137:0/3045493702 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420010a20 con 0x7fa428112700 2024-04-25T02:10:24.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.300+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4281ab2c0 con 0x7fa428112700 2024-04-25T02:10:24.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.303+0000 7fa43317a740 1 Processor -- start 2024-04-25T02:10:24.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.303+0000 7fa426000640 1 -- 172.21.15.137:0/3045493702 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fa420004020 con 0x7fa428112700 2024-04-25T02:10:24.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 -- start start 2024-04-25T02:10:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd95140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd9f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b0ccf3f40 con 0x559b0cd95680 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x559b0ccf9190 con 0x559b0cd9fd50 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa43317a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b0cca1a10 con 0x559b0cd94d60 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa42d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd9f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd95140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd95140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36072/0 (socket says 172.21.15.137:36072) 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.304+0000 7fa42ce00640 1 -- 172.21.15.137:0/1795209375 learned_addr learned my addr 172.21.15.137:0/1795209375 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42ce00640 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 -- 172.21.15.137:0/1795209375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 msgr2=0x559b0cd95140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd95140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 -- 172.21.15.137:0/1795209375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 msgr2=0x559b0cda2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 -- 172.21.15.137:0/1795209375 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0cad57e0 con 0x559b0cd95680 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa426000640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 0x7fa4100a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa42d800640 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd9f810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa41c02aa70 tx=0x7fa41c031490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afe51c5115d27f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.305+0000 7fa426000640 1 -- 172.21.15.137:0/3045493702 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa4200cfc40 con 0x7fa428112700 2024-04-25T02:10:24.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.306+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 0x7fa4100a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.306+0000 7fa41aa00640 1 -- 172.21.15.137:0/1795209375 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c035040 con 0x559b0cd95680 2024-04-25T02:10:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.306+0000 7fa41aa00640 1 -- 172.21.15.137:0/1795209375 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa41c005540 con 0x559b0cd95680 2024-04-25T02:10:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.306+0000 7fa41aa00640 1 -- 172.21.15.137:0/1795209375 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c031640 con 0x559b0cd95680 2024-04-25T02:10:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 0x7fa4100a53f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x559b0cd92210 tx=0x7fa414005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 -- 172.21.15.137:0/1795209375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 msgr2=0x559b0cd9f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd9f810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa41c02aa70 tx=0x7fa41c031490 comp rx=0 tx=0).stop 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 -- 172.21.15.137:0/1795209375 shutdown_connections 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd9f810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 --2- 172.21.15.137:0/1795209375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd95140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 -- 172.21.15.137:0/1795209375 >> 172.21.15.137:0/1795209375 conn(0x559b0cd91080 msgr2=0x559b0cd91460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 -- 172.21.15.137:0/1795209375 shutdown_connections 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.307+0000 7fa43317a740 1 -- 172.21.15.137:0/1795209375 wait complete. 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 -- start start 2024-04-25T02:10:24.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 Processor -- start 2024-04-25T02:10:24.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd9cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd95680 0x559b0cd9d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b0ccb4e70 con 0x559b0cd9fd50 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x559b0ccf5150 con 0x559b0cd95680 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b0cda2b80 con 0x559b0cd94d60 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.308+0000 7fa43317a740 10 client.0 _ll_register_callbacks cb 0x559b0ccf01f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42d800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd9cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36564/0 (socket says 172.21.15.137:36564) 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd95680 0x559b0cd9d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 -- 172.21.15.137:0/1694911802 learned_addr learned my addr 172.21.15.137:0/1694911802 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 -- 172.21.15.137:0/1694911802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 msgr2=0x559b0cd9cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd9cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 -- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd95680 msgr2=0x559b0cd9d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd95680 0x559b0cd9d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 -- 172.21.15.137:0/1694911802 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0cb35f70 con 0x559b0cd9fd50 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42d800640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd9cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.309+0000 7fa42e200640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa42000cba0 tx=0x7fa42009bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b40f2b13cf8706c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200b4070 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa4200a4730 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa41c005540 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa42009bf50 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa43317a740 10 client.15501 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559b0c9cd170 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa41c005540 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.310+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fa4200bab90 con 0x559b0cd9fd50 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 10 client.15501 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 20 client.15501 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0cdafef0 0x559b0cdb2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 4 client.15501 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b0cd066d0 con 0x559b0cdafef0 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.311+0000 7fa42d800640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0cdafef0 0x559b0cdb2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.312+0000 7fa42d800640 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0cdafef0 0x559b0cdb2350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e4cf9b7860b730d server_cookie=d89a366a866fa8f4 in_seq=0 out_seq=0 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.312+0000 7fa40f400640 10 client.15501 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa40f400640 1 -- 172.21.15.137:0/1694911802 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b0cd066d0 con 0x559b0cdafef0 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa40f400640 10 client.15501 handle_command_reply: tid=0 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 client.15501 shutdown 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 msgr2=0x559b0cd9d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa42000cba0 tx=0x7fa42009bb80 comp rx=0 tx=0).stop 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 shutdown_connections 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0cdafef0 0x559b0cdb2350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd9fd50 0x559b0cd9d6d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd95680 0x559b0cd9d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 --2- 172.21.15.137:0/1694911802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd94d60 0x559b0cd9cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 >> 172.21.15.137:0/1694911802 conn(0x559b0cd91080 msgr2=0x559b0cd96e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa40f400640 0 client.15501 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 shutdown_connections 2024-04-25T02:10:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 1 -- 172.21.15.137:0/1694911802 wait complete. 2024-04-25T02:10:24.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.313+0000 7fa43317a740 20 client.15501 trim_cache size 0 max 16384 2024-04-25T02:10:24.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 Processor -- start 2024-04-25T02:10:24.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 -- start start 2024-04-25T02:10:24.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 0x559b0cdab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd9fd50 0x559b0cdb7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b6340 con 0x559b0cd95680 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b3c10 con 0x559b0cd94d60 2024-04-25T02:10:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.332+0000 7fa43317a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b1a60 con 0x559b0cd9fd50 2024-04-25T02:10:24.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36578/0 (socket says 172.21.15.137:36578) 2024-04-25T02:10:24.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 -- 172.21.15.137:0/4146180654 learned_addr learned my addr 172.21.15.137:0/4146180654 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42d800640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 0x559b0cdab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42e200640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd9fd50 0x559b0cdb7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 -- 172.21.15.137:0/4146180654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd9fd50 msgr2=0x559b0cdb7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd9fd50 0x559b0cdb7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 -- 172.21.15.137:0/4146180654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 msgr2=0x559b0cdab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 0x559b0cdab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42ce00640 1 -- 172.21.15.137:0/4146180654 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0cd97a00 con 0x559b0cd95680 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.333+0000 7fa42d800640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 0x559b0cdab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.334+0000 7fa42ce00640 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa414011ef0 tx=0x7fa414016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b11333e60328b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.334+0000 7fa41a000640 1 -- 172.21.15.137:0/4146180654 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414005020 con 0x559b0cd95680 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.334+0000 7fa41a000640 1 -- 172.21.15.137:0/4146180654 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4140047a0 con 0x559b0cd95680 2024-04-25T02:10:24.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.334+0000 7fa41a000640 1 -- 172.21.15.137:0/4146180654 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414020700 con 0x559b0cd95680 2024-04-25T02:10:24.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- 172.21.15.137:0/4146180654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 msgr2=0x559b0cd974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa414011ef0 tx=0x7fa414016000 comp rx=0 tx=0).stop 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- 172.21.15.137:0/4146180654 shutdown_connections 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd9fd50 0x559b0cdb7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd95680 0x559b0cd974c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 --2- 172.21.15.137:0/4146180654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd94d60 0x559b0cdab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- 172.21.15.137:0/4146180654 >> 172.21.15.137:0/4146180654 conn(0x559b0cd91080 msgr2=0x559b0cd9e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- 172.21.15.137:0/4146180654 shutdown_connections 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- 172.21.15.137:0/4146180654 wait complete. 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.335+0000 7fa43317a740 1 -- start start 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 Processor -- start 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 0x559b0cda8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b20d0 con 0x559b0cd94d60 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b3540 con 0x559b0cd9fd50 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281b27a0 con 0x559b0cd95680 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa43317a740 10 client.0 _ll_register_callbacks cb 0x7fa420004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa42d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 0x559b0cda8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa42d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36582/0 (socket says 172.21.15.137:36582) 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.336+0000 7fa42d800640 1 -- 172.21.15.137:0/3554614428 learned_addr learned my addr 172.21.15.137:0/3554614428 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42e200640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 -- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 msgr2=0x559b0cda4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 -- 172.21.15.137:0/3554614428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 msgr2=0x559b0cda7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 -- 172.21.15.137:0/3554614428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0cda5360 con 0x559b0cd95680 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42d800640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa42ce00640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 0x559b0cda8310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa41400f790 tx=0x7fa414011550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8009924bea84d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa40f400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414005410 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4140047a0 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.337+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fa414020480 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa414020680 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 10 client.25633 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559b0ce16da0 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4140047a0 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fa4140357a0 con 0x559b0cd95680 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 10 client.25633 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 10 client.25633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 20 client.25633 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0ce174c0 0x559b0ce198e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 4 client.25633 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T02:10:24.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.338+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b0cd8c300 con 0x559b0ce174c0 2024-04-25T02:10:24.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.339+0000 7fa42d800640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0ce174c0 0x559b0ce198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.339+0000 7fa40f400640 10 client.25633 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.339+0000 7fa42d800640 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0ce174c0 0x559b0ce198e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99fe579daa9850b server_cookie=d4aa0849fb67ae05 in_seq=0 out_seq=0 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.340+0000 7fa40f400640 1 -- 172.21.15.137:0/3554614428 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b0cd8c300 con 0x559b0ce174c0 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.340+0000 7fa40f400640 10 client.25633 handle_command_reply: tid=0 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.340+0000 7fa43317a740 1 client.25633 shutdown 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.340+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 msgr2=0x559b0cda8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.340+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 0x559b0cda8310 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa41400f790 tx=0x7fa414011550 comp rx=0 tx=0).stop 2024-04-25T02:10:24.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 shutdown_connections 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b0ce174c0 0x559b0ce198e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b0cd9fd50 0x559b0cda4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b0cd95680 0x559b0cda8310 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 --2- 172.21.15.137:0/3554614428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b0cd94d60 0x559b0cda7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 >> 172.21.15.137:0/3554614428 conn(0x559b0cd91080 msgr2=0x559b0cd9ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa40f400640 0 client.25633 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 shutdown_connections 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 1 -- 172.21.15.137:0/3554614428 wait complete. 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa43317a740 20 client.25633 trim_cache size 0 max 16384 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "7500925a-c71c-4fc1-a3b1-fdd8ee260cad", 2024-04-25T02:10:24.351 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-25T02:10:24.352 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:24.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 msgr2=0x7fa4100a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 0x7fa4100a53f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x559b0cd92210 tx=0x7fa414005f90 comp rx=0 tx=0).stop 2024-04-25T02:10:24.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 msgr2=0x7fa4281a3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.341+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa420009c90 tx=0x7fa42000c6a0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 shutdown_connections 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa4100a2f30 0x7fa4100a53f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa428112700 0x7fa4281a3010 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa428074400 0x7fa42819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 --2- 172.21.15.137:0/3045493702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa428073ae0 0x7fa42819e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 >> 172.21.15.137:0/3045493702 conn(0x7fa4280fd1c0 msgr2=0x7fa4280fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 shutdown_connections 2024-04-25T02:10:24.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.342+0000 7fa430200640 1 -- 172.21.15.137:0/3045493702 wait complete. 2024-04-25T02:10:24.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:10:24.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 -- 172.21.15.137:0/1473772319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d9410bbd0 msgr2=0x7f0d9410e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 --2- 172.21.15.137:0/1473772319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d9410bbd0 0x7f0d9410e050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009be0 tx=0x7f0d8c02a750 comp rx=0 tx=0).stop 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 -- 172.21.15.137:0/1473772319 shutdown_connections 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 --2- 172.21.15.137:0/1473772319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d9410bbd0 0x7f0d9410e050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 --2- 172.21.15.137:0/1473772319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94103120 0x7f0d9410b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 --2- 172.21.15.137:0/1473772319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d94102800 0x7f0d94102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 -- 172.21.15.137:0/1473772319 >> 172.21.15.137:0/1473772319 conn(0x7f0d940fbfc0 msgr2=0x7f0d940fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 -- 172.21.15.137:0/1473772319 shutdown_connections 2024-04-25T02:10:24.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.566+0000 7f0d93200640 1 -- 172.21.15.137:0/1473772319 wait complete. 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 Processor -- start 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 -- start start 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d94103120 0x7f0d9419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 0x7f0d9419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94111ad0 con 0x7f0d9410bbd0 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94111950 con 0x7f0d94103120 2024-04-25T02:10:24.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d93200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94111c50 con 0x7f0d94102800 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 0x7f0d9419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d91e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d91e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36128/0 (socket says 172.21.15.137:36128) 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d94103120 0x7f0d9419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.567+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 0x7f0d9419ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36608/0 (socket says 172.21.15.137:36608) 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 -- 172.21.15.137:0/3068551521 learned_addr learned my addr 172.21.15.137:0/3068551521 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 -- 172.21.15.137:0/3068551521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d94103120 msgr2=0x7f0d9419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d94103120 0x7f0d9419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 -- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 msgr2=0x7f0d9419ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 0x7f0d9419ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 -- 172.21.15.137:0/3068551521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9419f190 con 0x7f0d94102800 2024-04-25T02:10:24.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.568+0000 7f0d91e00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400e9c0 tx=0x7f0d8400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.569+0000 7f0d8aa00640 1 -- 172.21.15.137:0/3068551521 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400cde0 con 0x7f0d94102800 2024-04-25T02:10:24.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.569+0000 7f0d8aa00640 1 -- 172.21.15.137:0/3068551521 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d840035f0 con 0x7f0d94102800 2024-04-25T02:10:24.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.569+0000 7f0d8aa00640 1 -- 172.21.15.137:0/3068551521 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84010670 con 0x7f0d94102800 2024-04-25T02:10:24.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.569+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9419f480 con 0x7f0d94102800 2024-04-25T02:10:24.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.569+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941a6d10 con 0x7f0d94102800 2024-04-25T02:10:24.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.573+0000 7f0d9bb9d740 1 Processor -- start 2024-04-25T02:10:24.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.573+0000 7f0d9bb9d740 1 -- start start 2024-04-25T02:10:24.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d8aa00640 1 -- 172.21.15.137:0/3068551521 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f0d840037a0 con 0x7f0d94102800 2024-04-25T02:10:24.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f6127c6560 con 0x55f61286d1d0 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f61276e930 con 0x55f612862b00 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6127c2520 con 0x55f6128621e0 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d91400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d92800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d92800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36138/0 (socket says 172.21.15.137:36138) 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d92800640 1 -- 172.21.15.137:0/2134574901 learned_addr learned my addr 172.21.15.137:0/2134574901 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.574+0000 7f0d91e00640 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 -- 172.21.15.137:0/2134574901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 msgr2=0x55f61286cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 -- 172.21.15.137:0/2134574901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 msgr2=0x55f61286f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 -- 172.21.15.137:0/2134574901 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6125a47d0 con 0x55f6128621e0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d92800640 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009be0 tx=0x7f0d8c030b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104472863a63ff12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d8aa00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 0x7f0d780a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d8aa00640 1 -- 172.21.15.137:0/3068551521 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d840cf9b0 con 0x7f0d94102800 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d7f000640 1 -- 172.21.15.137:0/2134574901 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c041030 con 0x55f6128621e0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d91e00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 0x7f0d780a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d7f000640 1 -- 172.21.15.137:0/2134574901 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d8c030cb0 con 0x55f6128621e0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.575+0000 7f0d7f000640 1 -- 172.21.15.137:0/2134574901 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c036040 con 0x55f6128621e0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2134574901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 msgr2=0x55f6128625c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009be0 tx=0x7f0d8c030b00 comp rx=0 tx=0).stop 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d91e00640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 0x7f0d780a53f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ccf50 tx=0x7f0d840d5530 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2134574901 shutdown_connections 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2134574901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f6128625c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2134574901 >> 172.21.15.137:0/2134574901 conn(0x55f61285e500 msgr2=0x55f61285e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2134574901 shutdown_connections 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.576+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2134574901 wait complete. 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.577+0000 7f0d9bb9d740 1 -- start start 2024-04-25T02:10:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.577+0000 7f0d9bb9d740 1 Processor -- start 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f61286a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f61286ff60 con 0x55f61286d1d0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55f612781d90 con 0x55f612862b00 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6128700e0 con 0x55f6128621e0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d9bb9d740 10 client.0 _ll_register_callbacks cb 0x55f612781780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d92800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f61286a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:55022/0 (socket says 172.21.15.137:55022) 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36626/0 (socket says 172.21.15.137:36626) 2024-04-25T02:10:24.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 -- 172.21.15.137:0/3189993160 learned_addr learned my addr 172.21.15.137:0/3189993160 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 -- 172.21.15.137:0/3189993160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 msgr2=0x55f61286a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f61286a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 -- 172.21.15.137:0/3189993160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 msgr2=0x55f61286ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.578+0000 7f0d91400640 1 -- 172.21.15.137:0/3189993160 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6124da3f0 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d91400640 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0d80012700 tx=0x7f0d80012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e699cbcb5be219c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d73400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000f8c0 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d8000fa60 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d8c030cb0 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0d8000fc60 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d9bb9d740 10 client.25592 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f61249a0f0 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.579+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d8c030cb0 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0d80025610 con 0x55f612862b00 2024-04-25T02:10:24.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 10 client.25592 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 10 client.25592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 20 client.25592 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f61287d550 0x55f61287f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 4 client.25592 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6127d9d90 con 0x55f61287d550 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.580+0000 7f0d92800640 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f61287d550 0x55f61287f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.581+0000 7f0d73400640 10 client.25592 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.581+0000 7f0d92800640 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f61287d550 0x55f61287f970 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8efeed49c9587ff server_cookie=eb49f82add633f5 in_seq=0 out_seq=0 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d73400640 1 -- 172.21.15.137:0/3189993160 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f6127d9d90 con 0x55f61287d550 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d73400640 10 client.25592 handle_command_reply: tid=0 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 client.25592 shutdown 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 msgr2=0x55f61286a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0d80012700 tx=0x7f0d80012bc0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 shutdown_connections 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f61287d550 0x55f61287f970 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f61286ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f61286a710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/3189993160 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6128621e0 0x55f61286a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 >> 172.21.15.137:0/3189993160 conn(0x55f61285e500 msgr2=0x55f61285d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d73400640 0 client.25592 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 shutdown_connections 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/3189993160 wait complete. 2024-04-25T02:10:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.582+0000 7f0d9bb9d740 20 client.25592 trim_cache size 0 max 16384 2024-04-25T02:10:24.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.601+0000 7f0d9bb9d740 1 Processor -- start 2024-04-25T02:10:24.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.601+0000 7f0d9bb9d740 1 -- start start 2024-04-25T02:10:24.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.601+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f6128621e0 0x55f61285df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f612885240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941b1d70 con 0x55f61286d1d0 2024-04-25T02:10:24.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941af640 con 0x55f6128621e0 2024-04-25T02:10:24.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941ad490 con 0x55f612862b00 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f612885240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:36162/0 (socket says 172.21.15.137:36162) 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 -- 172.21.15.137:0/418622333 learned_addr learned my addr 172.21.15.137:0/418622333 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d92800640 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f6128621e0 0x55f61285df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 -- 172.21.15.137:0/418622333 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f6128621e0 msgr2=0x55f61285df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f6128621e0 0x55f61285df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 -- 172.21.15.137:0/418622333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 msgr2=0x55f612885240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f612885240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d91400640 1 -- 172.21.15.137:0/418622333 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f612859e60 con 0x55f612862b00 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.602+0000 7f0d92800640 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f612885240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.603+0000 7f0d91400640 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d80025a60 tx=0x7f0d8000ff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdacb0a232510639 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.603+0000 7f0d7e600640 1 -- 172.21.15.137:0/418622333 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80026e20 con 0x55f612862b00 2024-04-25T02:10:24.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.603+0000 7f0d7e600640 1 -- 172.21.15.137:0/418622333 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d8000f790 con 0x55f612862b00 2024-04-25T02:10:24.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.603+0000 7f0d7e600640 1 -- 172.21.15.137:0/418622333 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80004640 con 0x55f612862b00 2024-04-25T02:10:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/418622333 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 msgr2=0x55f612878e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0d80025a60 tx=0x7f0d8000ff90 comp rx=0 tx=0).stop 2024-04-25T02:10:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/418622333 shutdown_connections 2024-04-25T02:10:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f61286d1d0 0x55f612885240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f612862b00 0x55f612878e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/418622333 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f6128621e0 0x55f61285df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/418622333 >> 172.21.15.137:0/418622333 conn(0x55f61285e500 msgr2=0x55f612864280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/418622333 shutdown_connections 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/418622333 wait complete. 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 -- start start 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.604+0000 7f0d9bb9d740 1 Processor -- start 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 0x55f612870de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f61286d1d0 0x55f612871860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941adb00 con 0x55f6128621e0 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941aef70 con 0x55f612862b00 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d941ae1d0 con 0x55f61286d1d0 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d9bb9d740 10 client.0 _ll_register_callbacks cb 0x7f0d80009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d92800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 0x55f612870de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:55036/0 (socket says 172.21.15.137:55036) 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 -- 172.21.15.137:0/2252487372 learned_addr learned my addr 172.21.15.137:0/2252487372 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d92800640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f61286d1d0 0x55f612871860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 -- 172.21.15.137:0/2252487372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f61286d1d0 msgr2=0x55f612871860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f61286d1d0 0x55f612871860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.605+0000 7f0d91400640 1 -- 172.21.15.137:0/2252487372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 msgr2=0x55f612870de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d91400640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 0x55f612870de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d91400640 1 -- 172.21.15.137:0/2252487372 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6128e2b60 con 0x55f612862b00 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d92800640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 0x55f612870de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d91400640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d80015040 tx=0x7f0d80009d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c6b9fd6aa1905c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d73400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8000f940 con 0x55f612862b00 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0d80025bd0 con 0x55f612862b00 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d8000f790 con 0x55f612862b00 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0d80025dd0 con 0x55f612862b00 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d9bb9d740 10 client.25598 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.606+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f6128e3e30 con 0x55f612862b00 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d8000f790 con 0x55f612862b00 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0d8001c590 con 0x55f612862b00 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 10 client.25598 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 10 client.25598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 20 client.25598 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f6128e4530 0x55f6128e6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 4 client.25598 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6127d3aa0 con 0x55f6128e4530 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.607+0000 7f0d92800640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f6128e4530 0x55f6128e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d92800640 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f6128e4530 0x55f6128e6950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56cf4b082b52699a server_cookie=4408cbc2aad0ba1b in_seq=0 out_seq=0 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d73400640 10 client.25598 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d73400640 1 -- 172.21.15.137:0/2252487372 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f6127d3aa0 con 0x55f6128e4530 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d73400640 10 client.25598 handle_command_reply: tid=0 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 client.25598 shutdown 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 msgr2=0x55f612871320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d80015040 tx=0x7f0d80009d40 comp rx=0 tx=0).stop 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 shutdown_connections 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55f6128e4530 0x55f6128e6950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f61286d1d0 0x55f612871860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d73400640 0 client.25598 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f612862b00 0x55f612871320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 --2- 172.21.15.137:0/2252487372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f6128621e0 0x55f612870de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 >> 172.21.15.137:0/2252487372 conn(0x55f61285e500 msgr2=0x55f61286a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.608+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 shutdown_connections 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d9bb9d740 1 -- 172.21.15.137:0/2252487372 wait complete. 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d9bb9d740 20 client.25598 trim_cache size 0 max 16384 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "7500925a-c71c-4fc1-a3b1-fdd8ee260cad": { 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "7500925a-c71c-4fc1-a3b1-fdd8ee260cad", 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,force" 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:10:24.619 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 msgr2=0x7f0d780a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 0x7f0d780a53f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ccf50 tx=0x7f0d840d5530 comp rx=0 tx=0).stop 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 msgr2=0x7f0d9419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400e9c0 tx=0x7f0d8400ee80 comp rx=0 tx=0).stop 2024-04-25T02:10:24.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 shutdown_connections 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0d780a2f30 0x7f0d780a53f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d9410bbd0 0x7f0d9419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d94103120 0x7f0d9419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.609+0000 7f0d93200640 1 --2- 172.21.15.137:0/3068551521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d94102800 0x7f0d9419a1a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.610+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 >> 172.21.15.137:0/3068551521 conn(0x7f0d940fbfc0 msgr2=0x7f0d94100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.610+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 shutdown_connections 2024-04-25T02:10:24.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:24.610+0000 7f0d93200640 1 -- 172.21.15.137:0/3068551521 wait complete. 2024-04-25T02:10:24.640 INFO:tasks.cephfs.filesystem:scrub status for tag:7500925a-c71c-4fc1-a3b1-fdd8ee260cad - {'path': '/', 'tag': '7500925a-c71c-4fc1-a3b1-fdd8ee260cad', 'options': 'recursive,force'} 2024-04-25T02:10:25.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:25 smithi174 ceph-mon[33171]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:25.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:25 smithi174 ceph-mon[33171]: scrub queued for path: / 2024-04-25T02:10:25.428 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:25 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:25.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:25 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:10:25.429 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:25 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:25.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:25 smithi137 ceph-mon[28303]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:25.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:25 smithi137 ceph-mon[28303]: scrub queued for path: / 2024-04-25T02:10:25.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:25 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:25.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:25 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:10:25.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:25 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:25.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:25 smithi163 ceph-mon[32577]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:25.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:25 smithi163 ceph-mon[32577]: scrub queued for path: / 2024-04-25T02:10:25.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:25 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:25.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:25 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:10:25.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:25 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:27.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:27 smithi137 ceph-mon[28303]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:27.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:27 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:10:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:27 smithi163 ceph-mon[32577]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:27.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:27 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:10:27.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:27 smithi174 ceph-mon[33171]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:27.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:27 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:10:29.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:29 smithi137 ceph-mon[28303]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:29.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:29 smithi163 ceph-mon[32577]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:29.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:29 smithi174 ceph-mon[33171]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:31.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:31 smithi137 ceph-mon[28303]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T02:10:31.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:31 smithi163 ceph-mon[32577]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T02:10:31.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:31 smithi174 ceph-mon[33171]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-25T02:10:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.840+0000 7f2f13800640 1 -- 172.21.15.137:0/700488952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 msgr2=0x7f2f0c103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 --2- 172.21.15.137:0/700488952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c103db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009930 tx=0x7f2efc02a420 comp rx=0 tx=0).stop 2024-04-25T02:10:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 -- 172.21.15.137:0/700488952 shutdown_connections 2024-04-25T02:10:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 --2- 172.21.15.137:0/700488952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 0x7f2f0c110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 --2- 172.21.15.137:0/700488952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c103db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 --2- 172.21.15.137:0/700488952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 0x7f2f0c109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 -- 172.21.15.137:0/700488952 >> 172.21.15.137:0/700488952 conn(0x7f2f0c0ff400 msgr2=0x7f2f0c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 -- 172.21.15.137:0/700488952 shutdown_connections 2024-04-25T02:10:32.849 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.841+0000 7f2f13800640 1 -- 172.21.15.137:0/700488952 wait complete. 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 Processor -- start 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 -- start start 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 0x7f2f0c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 0x7f2f0c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c113e70 con 0x7f2f0c103930 2024-04-25T02:10:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c113cf0 con 0x7f2f0c109940 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.842+0000 7f2f13800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c113ff0 con 0x7f2f0c1042f0 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51524/0 (socket says 172.21.15.137:51524) 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 -- 172.21.15.137:0/1104699616 learned_addr learned my addr 172.21.15.137:0/1104699616 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f0be00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 0x7f2f0c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f11800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 0x7f2f0c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 -- 172.21.15.137:0/1104699616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 msgr2=0x7f2f0c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 0x7f2f0c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 -- 172.21.15.137:0/1104699616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 msgr2=0x7f2f0c19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 0x7f2f0c19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 -- 172.21.15.137:0/1104699616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c19f280 con 0x7f2f0c103930 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.843+0000 7f2f10e00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.844+0000 7f2f09600640 1 -- 172.21.15.137:0/1104699616 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000cd80 con 0x7f2f0c103930 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.844+0000 7f2f09600640 1 -- 172.21.15.137:0/1104699616 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f00010930 con 0x7f2f0c103930 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.844+0000 7f2f09600640 1 -- 172.21.15.137:0/1104699616 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00018b00 con 0x7f2f0c103930 2024-04-25T02:10:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.844+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c19f570 con 0x7f2f0c103930 2024-04-25T02:10:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.844+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c1a6e00 con 0x7f2f0c103930 2024-04-25T02:10:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.847+0000 7f2f167db740 1 Processor -- start 2024-04-25T02:10:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.847+0000 7f2f167db740 1 -- start start 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a6720 0x55a4230b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4230b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a423009ab0 con 0x55a4230a6720 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a422fb2640 con 0x55a4230a5e00 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f167db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a423005a70 con 0x55a4230b0fe0 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f09600640 1 -- 172.21.15.137:0/1104699616 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f2f00018ca0 con 0x7f2f0c103930 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f11800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f11800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:34108/0 (socket says 172.21.15.137:34108) 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f11800640 1 -- 172.21.15.137:0/3384650251 learned_addr learned my addr 172.21.15.137:0/3384650251 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f10e00640 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a6720 0x55a4230b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.848+0000 7f2f0be00640 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4230b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 -- 172.21.15.137:0/3384650251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 msgr2=0x55a4230b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4230b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 -- 172.21.15.137:0/3384650251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a6720 msgr2=0x55a4230b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a6720 0x55a4230b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 -- 172.21.15.137:0/3384650251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a422d1e210 con 0x55a4230a5e00 2024-04-25T02:10:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2f11800640 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fd0 tx=0x7f2f040118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f1bc995f65dabe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2efa000640 1 -- 172.21.15.137:0/3384650251 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04004d20 con 0x55a4230a5e00 2024-04-25T02:10:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2efa000640 1 -- 172.21.15.137:0/3384650251 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f04004050 con 0x55a4230a5e00 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.849+0000 7f2efa000640 1 -- 172.21.15.137:0/3384650251 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04005260 con 0x55a4230a5e00 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f09600640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 0x7f2ef40a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f09600640 1 -- 172.21.15.137:0/1104699616 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2f000cf9a0 con 0x7f2f0c103930 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f10e00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 0x7f2ef40a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 -- 172.21.15.137:0/3384650251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 msgr2=0x55a4230a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fd0 tx=0x7f2f040118d0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 -- 172.21.15.137:0/3384650251 shutdown_connections 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4230b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a6720 0x55a4230b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 --2- 172.21.15.137:0/3384650251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230a61e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.850+0000 7f2f167db740 1 -- 172.21.15.137:0/3384650251 >> 172.21.15.137:0/3384650251 conn(0x55a4230a2310 msgr2=0x55a4230a26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.851+0000 7f2f167db740 1 -- 172.21.15.137:0/3384650251 shutdown_connections 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.851+0000 7f2f10e00640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 0x7f2ef40a5490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f000ccf40 tx=0x7f2f00018520 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.851+0000 7f2f167db740 1 -- 172.21.15.137:0/3384650251 wait complete. 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.851+0000 7f2f167db740 1 -- start start 2024-04-25T02:10:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.851+0000 7f2f167db740 1 Processor -- start 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 0x55a4230adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a4230b3c10 con 0x55a4230b0fe0 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a422fc5990 con 0x55a4230a6720 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a4230b3d90 con 0x55a4230a5e00 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f167db740 10 client.0 _ll_register_callbacks cb 0x55a422fc7950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f11800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:34112/0 (socket says 172.21.15.137:34112) 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f0be00640 1 -- 172.21.15.137:0/2962480553 learned_addr learned my addr 172.21.15.137:0/2962480553 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.852+0000 7f2f11800640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 0x55a4230adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 -- 172.21.15.137:0/2962480553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 msgr2=0x55a4230adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 0x55a4230adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 -- 172.21.15.137:0/2962480553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 msgr2=0x55a4230aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 -- 172.21.15.137:0/2962480553 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a422dea620 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f11800640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 0x55a4230adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2efc02a940 tx=0x7f2efc031870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b758529b31d03cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2eeea00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc035040 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f04004050 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.853+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2efc004240 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2efc031a60 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 10 client.25610 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a4230bfb50 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f04004050 con 0x55a4230a6720 2024-04-25T02:10:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f2efc004be0 con 0x55a4230a6720 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 10 client.25610 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 20 client.25610 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a4230c0fc0 0x55a4230c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 4 client.25610 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.854+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a423016ff0 con 0x55a4230c0fc0 2024-04-25T02:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.855+0000 7f2f11800640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a4230c0fc0 0x55a4230c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.855+0000 7f2f11800640 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a4230c0fc0 0x55a4230c33b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d713509f0ddd2be server_cookie=e13c78cf8d50d3a7 in_seq=0 out_seq=0 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.855+0000 7f2eeea00640 10 client.25610 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2eeea00640 1 -- 172.21.15.137:0/2962480553 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a423016ff0 con 0x55a4230c0fc0 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2eeea00640 10 client.25610 handle_command_reply: tid=0 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 client.25610 shutdown 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 msgr2=0x55a4230ae4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2efc02a940 tx=0x7f2efc031870 comp rx=0 tx=0).stop 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 shutdown_connections 2024-04-25T02:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a4230c0fc0 0x55a4230c33b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ae4c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 --2- 172.21.15.137:0/2962480553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a5e00 0x55a4230adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2eeea00640 0 client.25610 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 >> 172.21.15.137:0/2962480553 conn(0x55a4230a2310 msgr2=0x55a4230a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 shutdown_connections 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 1 -- 172.21.15.137:0/2962480553 wait complete. 2024-04-25T02:10:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.856+0000 7f2f167db740 20 client.25610 trim_cache size 0 max 16384 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 Processor -- start 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 -- start start 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1b1fa0 con 0x55a4230b0fe0 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1af870 con 0x55a4230a5e00 2024-04-25T02:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f167db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1ad6c0 con 0x55a4230a6720 2024-04-25T02:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.874+0000 7f2f11800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:47622/0 (socket says 172.21.15.137:47622) 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 -- 172.21.15.137:0/2603723588 learned_addr learned my addr 172.21.15.137:0/2603723588 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f11800640 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 -- 172.21.15.137:0/2603723588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 msgr2=0x55a4230bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 -- 172.21.15.137:0/2603723588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 msgr2=0x55a4230c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 -- 172.21.15.137:0/2603723588 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4230acf30 con 0x55a4230a6720 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f11800640 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009850 tx=0x7f2efc009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eae7f9569bc2be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.875+0000 7f2ef9600640 1 -- 172.21.15.137:0/2603723588 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc035070 con 0x55a4230a6720 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2ef9600640 1 -- 172.21.15.137:0/2603723588 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2efc0039b0 con 0x55a4230a6720 2024-04-25T02:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2ef9600640 1 -- 172.21.15.137:0/2603723588 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc003c30 con 0x55a4230a6720 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 -- 172.21.15.137:0/2603723588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 msgr2=0x55a4230a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009850 tx=0x7f2efc009230 comp rx=0 tx=0).stop 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 -- 172.21.15.137:0/2603723588 shutdown_connections 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230b0fe0 0x55a4230c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230a6720 0x55a4230a1c00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 --2- 172.21.15.137:0/2603723588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a5e00 0x55a4230bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 -- 172.21.15.137:0/2603723588 >> 172.21.15.137:0/2603723588 conn(0x55a4230a2310 msgr2=0x55a4230ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 -- 172.21.15.137:0/2603723588 shutdown_connections 2024-04-25T02:10:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.876+0000 7f2f167db740 1 -- 172.21.15.137:0/2603723588 wait complete. 2024-04-25T02:10:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.877+0000 7f2f167db740 1 -- start start 2024-04-25T02:10:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.877+0000 7f2f167db740 1 Processor -- start 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 0x55a4230ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4231264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1add30 con 0x55a4230a5e00 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1af1a0 con 0x55a4230a6720 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c1ae400 con 0x55a4230b0fe0 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f167db740 10 client.0 _ll_register_callbacks cb 0x7f2efc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f11800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 0x55a4230ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f11800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 0x55a4230ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:51546/0 (socket says 172.21.15.137:51546) 2024-04-25T02:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f11800640 1 -- 172.21.15.137:0/2327691931 learned_addr learned my addr 172.21.15.137:0/2327691931 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f11800640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4231264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 -- 172.21.15.137:0/2327691931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 msgr2=0x55a4231264e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4231264e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 -- 172.21.15.137:0/2327691931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 msgr2=0x55a4230ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 0x55a4230ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.878+0000 7f2f0be00640 1 -- 172.21.15.137:0/2327691931 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a423126a20 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.879+0000 7f2f0be00640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ab7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55a4230a2a30 tx=0x7f2efc0058f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a481359dabeff67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.879+0000 7f2eeea00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.879+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc035070 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.879+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2efc003c30 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.879+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2efc0039b0 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f2efc003e70 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 10 client.25616 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a423127c90 con 0x55a4230a6720 2024-04-25T02:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2efc0039b0 con 0x55a4230a6720 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f2efc046c30 con 0x55a4230a6720 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 10 client.25616 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 10 client.25616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 20 client.25616 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a423128290 0x55a42312a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 4 client.25616 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a423011340 con 0x55a423128290 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.880+0000 7f2f11800640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a423128290 0x55a42312a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.881+0000 7f2f11800640 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a423128290 0x55a42312a680 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c36284bde4edbb server_cookie=f7e517c263653623 in_seq=0 out_seq=0 2024-04-25T02:10:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.881+0000 7f2eeea00640 10 client.25616 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.888+0000 7f2eeea00640 1 -- 172.21.15.137:0/2327691931 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a423011340 con 0x55a423128290 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.888+0000 7f2eeea00640 10 client.25616 handle_command_reply: tid=0 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.888+0000 7f2f167db740 1 client.25616 shutdown 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 msgr2=0x55a4230ab7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ab7f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55a4230a2a30 tx=0x7f2efc0058f0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 shutdown_connections 2024-04-25T02:10:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55a423128290 0x55a42312a680 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a4230b0fe0 0x55a4231264e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a4230a6720 0x55a4230ab7f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 --2- 172.21.15.137:0/2327691931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a4230a5e00 0x55a4230ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2eeea00640 0 client.25616 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 >> 172.21.15.137:0/2327691931 conn(0x55a4230a2310 msgr2=0x55a4230a77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 shutdown_connections 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 1 -- 172.21.15.137:0/2327691931 wait complete. 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.889+0000 7f2f167db740 20 client.25616 trim_cache size 0 max 16384 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:10:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 msgr2=0x7f2ef40a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 0x7f2ef40a5490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f000ccf40 tx=0x7f2f00018520 comp rx=0 tx=0).stop 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 msgr2=0x7f2f0c19a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e9f0 tx=0x7f2f0000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 shutdown_connections 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ef40a2fd0 0x7f2ef40a5490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2f0c109940 0x7f2f0c19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f0c1042f0 0x7f2f0c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 --2- 172.21.15.137:0/1104699616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f0c103930 0x7f2f0c19a290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 >> 172.21.15.137:0/1104699616 conn(0x7f2f0c0ff400 msgr2=0x7f2f0c0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 shutdown_connections 2024-04-25T02:10:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:32.890+0000 7f2f13800640 1 -- 172.21.15.137:0/1104699616 wait complete. 2024-04-25T02:10:33.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:33 smithi137 ceph-mon[28303]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-04-25T02:10:33.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:33 smithi163 ceph-mon[32577]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-04-25T02:10:33.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:33 smithi174 ceph-mon[33171]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-04-25T02:10:35.283 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:35 smithi137 ceph-mon[28303]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-04-25T02:10:35.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:35 smithi163 ceph-mon[32577]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-04-25T02:10:35.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:35 smithi174 ceph-mon[33171]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-04-25T02:10:37.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:37 smithi137 ceph-mon[28303]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-04-25T02:10:37.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:37 smithi163 ceph-mon[32577]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-04-25T02:10:37.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:37 smithi174 ceph-mon[33171]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-04-25T02:10:39.479 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:39 smithi174 ceph-mon[33171]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:39.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:39 smithi137 ceph-mon[28303]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:39.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:39 smithi163 ceph-mon[32577]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:41.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:41 smithi137 ceph-mon[28303]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:41.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:41 smithi163 ceph-mon[32577]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:41.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:41 smithi174 ceph-mon[33171]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-04-25T02:10:43.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:43 smithi137 ceph-mon[28303]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T02:10:43.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:43 smithi163 ceph-mon[32577]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T02:10:43.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:43 smithi174 ceph-mon[33171]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-25T02:10:45.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:45 smithi137 ceph-mon[28303]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T02:10:45.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:45 smithi163 ceph-mon[32577]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T02:10:45.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:45 smithi174 ceph-mon[33171]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 -- 172.21.15.137:0/3276459234 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c6410bbc0 msgr2=0x7f8c6410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/3276459234 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c6410bbc0 0x7f8c6410dff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009be0 tx=0x7f8c5c02a750 comp rx=0 tx=0).stop 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 -- 172.21.15.137:0/3276459234 shutdown_connections 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/3276459234 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c6410bbc0 0x7f8c6410dff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/3276459234 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c64103110 0x7f8c6410b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/3276459234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c641027f0 0x7f8c64102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 -- 172.21.15.137:0/3276459234 >> 172.21.15.137:0/3276459234 conn(0x7f8c640fbfb0 msgr2=0x7f8c640fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.062+0000 7f8c6ae00640 1 -- 172.21.15.137:0/3276459234 shutdown_connections 2024-04-25T02:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.063+0000 7f8c6ae00640 1 -- 172.21.15.137:0/3276459234 wait complete. 2024-04-25T02:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 Processor -- start 2024-04-25T02:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 -- start start 2024-04-25T02:10:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c64103110 0x7f8c64100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c6410bbc0 0x7f8c64100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64111a70 con 0x7f8c6410bbc0 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641118f0 con 0x7f8c641027f0 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.064+0000 7f8c6ae00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64111bf0 con 0x7f8c64103110 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:39256/0 (socket says 172.21.15.137:39256) 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 -- 172.21.15.137:0/162729038 learned_addr learned my addr 172.21.15.137:0/162729038 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c6a400640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c6410bbc0 0x7f8c64100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69000640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c64103110 0x7f8c64100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 -- 172.21.15.137:0/162729038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c64103110 msgr2=0x7f8c64100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c64103110 0x7f8c64100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 -- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c6410bbc0 msgr2=0x7f8c64100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c6410bbc0 0x7f8c64100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.065+0000 7f8c69a00640 1 -- 172.21.15.137:0/162729038 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c641a63f0 con 0x7f8c641027f0 2024-04-25T02:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c69a00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800e9f0 tx=0x7f8c5800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c62000640 1 -- 172.21.15.137:0/162729038 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800cd80 con 0x7f8c641027f0 2024-04-25T02:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c62000640 1 -- 172.21.15.137:0/162729038 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c58005520 con 0x7f8c641027f0 2024-04-25T02:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c641a66e0 con 0x7f8c641027f0 2024-04-25T02:10:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c62000640 1 -- 172.21.15.137:0/162729038 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58010690 con 0x7f8c641027f0 2024-04-25T02:10:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.066+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641a6c30 con 0x7f8c641027f0 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 Processor -- start 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 -- start start 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e338751580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e3386a7ab0 con 0x55e338743fb0 2024-04-25T02:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e338650640 con 0x55e3387448d0 2024-04-25T02:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.071+0000 7f8c6f220740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e3386a3a70 con 0x55e33874f190 2024-04-25T02:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c62000640 1 -- 172.21.15.137:0/162729038 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f8c580046c0 con 0x7f8c641027f0 2024-04-25T02:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c6a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c6a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46978/0 (socket says 172.21.15.137:46978) 2024-04-25T02:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c6a400640 1 -- 172.21.15.137:0/335175047 learned_addr learned my addr 172.21.15.137:0/335175047 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c69a00640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.072+0000 7f8c69000640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e338751580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 -- 172.21.15.137:0/335175047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 msgr2=0x55e338751580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e338751580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 -- 172.21.15.137:0/335175047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 msgr2=0x55e338744390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 -- 172.21.15.137:0/335175047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3383bc210 con 0x55e3387448d0 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c6a400640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.073+0000 7f8c69a00640 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874ec50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8c580ccfc0 tx=0x7f8c580e0d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33bd3032c45ac01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c62000640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 0x7f8c4c0a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c56a00640 1 -- 172.21.15.137:0/335175047 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580dfb90 con 0x55e3387448d0 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c62000640 1 -- 172.21.15.137:0/162729038 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8c580cfa80 con 0x7f8c641027f0 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c56a00640 1 -- 172.21.15.137:0/335175047 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c5809c490 con 0x55e3387448d0 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c56a00640 1 -- 172.21.15.137:0/335175047 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5809b8d0 con 0x55e3387448d0 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.074+0000 7f8c6a400640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 0x7f8c4c0a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 -- 172.21.15.137:0/335175047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 msgr2=0x55e33874ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874ec50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8c580ccfc0 tx=0x7f8c580e0d70 comp rx=0 tx=0).stop 2024-04-25T02:10:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6a400640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 0x7f8c4c0a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c6406a940 tx=0x7f8c5c005fd0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 -- 172.21.15.137:0/335175047 shutdown_connections 2024-04-25T02:10:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e338751580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874ec50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.085 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 --2- 172.21.15.137:0/335175047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e338744390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.075+0000 7f8c6f220740 1 -- 172.21.15.137:0/335175047 >> 172.21.15.137:0/335175047 conn(0x55e3387404c0 msgr2=0x55e3387408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.076+0000 7f8c6f220740 1 -- 172.21.15.137:0/335175047 shutdown_connections 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.076+0000 7f8c6f220740 1 -- 172.21.15.137:0/335175047 wait complete. 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.076+0000 7f8c6f220740 1 -- start start 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.076+0000 7f8c6f220740 1 Processor -- start 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e33874cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e338751dc0 con 0x55e33874f190 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e338663990 con 0x55e3387448d0 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e338751f40 con 0x55e338743fb0 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6f220740 10 client.0 _ll_register_callbacks cb 0x55e338665950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:55382/0 (socket says 172.21.15.137:55382) 2024-04-25T02:10:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 -- 172.21.15.137:0/1196795251 learned_addr learned my addr 172.21.15.137:0/1196795251 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69000640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c6a400640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e33874cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 -- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 msgr2=0x55e33874c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 -- 172.21.15.137:0/1196795251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 msgr2=0x55e33874cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e33874cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.077+0000 7f8c69a00640 1 -- 172.21.15.137:0/1196795251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e338488620 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cd0b0 tx=0x7f8c58009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36618717a08e0b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c4b400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5809b6f0 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8c5809c1f0 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c5809c490 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8c5809b8d0 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c6f220740 10 client.25681 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.078+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55e338751dc0 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c5809c490 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f8c580a4570 con 0x55e338743fb0 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 10 client.25681 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 10 client.25681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 20 client.25681 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e33875ee30 0x55e338761220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 4 client.25681 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3386b4ff0 con 0x55e33875ee30 2024-04-25T02:10:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.079+0000 7f8c69000640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e33875ee30 0x55e338761220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.080+0000 7f8c4b400640 10 client.25681 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.080+0000 7f8c69000640 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e33875ee30 0x55e338761220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f2f0d8117af25d server_cookie=87312a753cf2397 in_seq=0 out_seq=0 2024-04-25T02:10:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c4b400640 1 -- 172.21.15.137:0/1196795251 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e3386b4ff0 con 0x55e33875ee30 2024-04-25T02:10:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c4b400640 10 client.25681 handle_command_reply: tid=0 2024-04-25T02:10:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 client.25681 shutdown 2024-04-25T02:10:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 msgr2=0x55e33874c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cd0b0 tx=0x7f8c58009790 comp rx=0 tx=0).stop 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 shutdown_connections 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e33875ee30 0x55e338761220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e33874cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e33874c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1196795251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e33874c130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 >> 172.21.15.137:0/1196795251 conn(0x55e3387404c0 msgr2=0x55e338746240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.081+0000 7f8c4b400640 0 client.25681 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.082+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 shutdown_connections 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.082+0000 7f8c6f220740 1 -- 172.21.15.137:0/1196795251 wait complete. 2024-04-25T02:10:46.092 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.082+0000 7f8c6f220740 20 client.25681 trim_cache size 0 max 16384 2024-04-25T02:10:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 Processor -- start 2024-04-25T02:10:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 -- start start 2024-04-25T02:10:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e33875ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e33874c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641adab0 con 0x55e338743fb0 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641ab380 con 0x55e3387448d0 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.100+0000 7f8c6f220740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641a91f0 con 0x55e33874f190 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:39264/0 (socket says 172.21.15.137:39264) 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 -- 172.21.15.137:0/3698246058 learned_addr learned my addr 172.21.15.137:0/3698246058 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c6a400640 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e33874c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69a00640 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e33875ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 -- 172.21.15.137:0/3698246058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 msgr2=0x55e33874c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e33874c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 -- 172.21.15.137:0/3698246058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 msgr2=0x55e33875ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e33875ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.101+0000 7f8c69000640 1 -- 172.21.15.137:0/3698246058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e338746eb0 con 0x55e3387448d0 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.102+0000 7f8c69000640 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55e3387418e0 tx=0x7f8c5000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c69dc78426f8b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.102+0000 7f8c56000640 1 -- 172.21.15.137:0/3698246058 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50003f30 con 0x55e3387448d0 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.102+0000 7f8c56000640 1 -- 172.21.15.137:0/3698246058 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c50024020 con 0x55e3387448d0 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.102+0000 7f8c56000640 1 -- 172.21.15.137:0/3698246058 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50011900 con 0x55e3387448d0 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- 172.21.15.137:0/3698246058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 msgr2=0x55e338746970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55e3387418e0 tx=0x7f8c5000b390 comp rx=0 tx=0).stop 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- 172.21.15.137:0/3698246058 shutdown_connections 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e33874f190 0x55e33874c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338746970 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 --2- 172.21.15.137:0/3698246058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e338743fb0 0x55e33875ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- 172.21.15.137:0/3698246058 >> 172.21.15.137:0/3698246058 conn(0x55e3387404c0 msgr2=0x55e33874d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- 172.21.15.137:0/3698246058 shutdown_connections 2024-04-25T02:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- 172.21.15.137:0/3698246058 wait complete. 2024-04-25T02:10:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.103+0000 7f8c6f220740 1 -- start start 2024-04-25T02:10:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 Processor -- start 2024-04-25T02:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338752770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e338752cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641a9840 con 0x55e33874f190 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641aacb0 con 0x55e3387448d0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641a9f10 con 0x55e338743fb0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c6f220740 10 client.0 _ll_register_callbacks cb 0x7f8c58005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338752770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c69a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:55414/0 (socket says 172.21.15.137:55414) 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c69000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338752770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:39266/0 (socket says 172.21.15.137:39266) 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.104+0000 7f8c69a00640 1 -- 172.21.15.137:0/1980762232 learned_addr learned my addr 172.21.15.137:0/1980762232 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c6a400640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e338752cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 -- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 msgr2=0x55e338752770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338752770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 -- 172.21.15.137:0/1980762232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 msgr2=0x55e338752cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e338752cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 -- 172.21.15.137:0/1980762232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3387531f0 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c69a00640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800e9c0 tx=0x7f8c5800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfaf3e7eb5bf118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c4b400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58098030 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8c58097ae0 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.105+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c50024020 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8c5809b6f0 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 10 client.25687 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55e3387531f0 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c50024020 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f8c58097ce0 con 0x55e338743fb0 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 10 client.25687 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 20 client.25687 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e3387c5190 0x55e3387c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 4 client.25687 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.106+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3386af340 con 0x55e3387c5190 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.107+0000 7f8c69000640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e3387c5190 0x55e3387c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.107+0000 7f8c69000640 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e3387c5190 0x55e3387c75b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacb5a744e153418 server_cookie=663247e3c553e355 in_seq=0 out_seq=0 2024-04-25T02:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.107+0000 7f8c4b400640 10 client.25687 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.111+0000 7f8c4b400640 1 -- 172.21.15.137:0/1980762232 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3386af340 con 0x55e3387c5190 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.111+0000 7f8c4b400640 10 client.25687 handle_command_reply: tid=0 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.111+0000 7f8c6f220740 1 client.25687 shutdown 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.111+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 msgr2=0x55e338757260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.111+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800e9c0 tx=0x7f8c5800cf20 comp rx=0 tx=0).stop 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 shutdown_connections 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e3387c5190 0x55e3387c75b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e33874f190 0x55e338752cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3387448d0 0x55e338752770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 --2- 172.21.15.137:0/1980762232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e338743fb0 0x55e338757260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 >> 172.21.15.137:0/1980762232 conn(0x55e3387404c0 msgr2=0x55e338759c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c4b400640 0 client.25687 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 shutdown_connections 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 1 -- 172.21.15.137:0/1980762232 wait complete. 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.112+0000 7f8c6f220740 20 client.25687 trim_cache size 0 max 16384 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:10:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:10:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 msgr2=0x7f8c4c0a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 0x7f8c4c0a53e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c6406a940 tx=0x7f8c5c005fd0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 msgr2=0x7f8c64100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800e9f0 tx=0x7f8c5800edf0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 shutdown_connections 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8c4c0a2f20 0x7f8c4c0a53e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c6410bbc0 0x7f8c64100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c64103110 0x7f8c64100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 --2- 172.21.15.137:0/162729038 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c641027f0 0x7f8c64100440 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 >> 172.21.15.137:0/162729038 conn(0x7f8c640fbfb0 msgr2=0x7f8c640fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 shutdown_connections 2024-04-25T02:10:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:46.113+0000 7f8c6ae00640 1 -- 172.21.15.137:0/162729038 wait complete. 2024-04-25T02:10:47.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:47 smithi137 ceph-mon[28303]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-25T02:10:47.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:47 smithi163 ceph-mon[32577]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-25T02:10:47.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:47 smithi174 ceph-mon[33171]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-25T02:10:49.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:49 smithi137 ceph-mon[28303]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:49.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:49 smithi163 ceph-mon[32577]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:49.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:49 smithi174 ceph-mon[33171]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:51.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:51.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:51.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.535 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:51 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:51 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:51.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:51 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:52.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:52 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:52.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:52 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:52.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:52 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:52.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:52 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:52.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:52 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:52.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:52 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:52.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:52 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:10:52.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:52 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:10:52.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:52 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:10:53.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:53 smithi137 ceph-mon[28303]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:53.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:53 smithi163 ceph-mon[32577]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:53.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:53 smithi174 ceph-mon[33171]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:54.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:10:54.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 -- 172.21.15.137:0/4020793691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e410bbc0 msgr2=0x7f12e410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 --2- 172.21.15.137:0/4020793691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e410bbc0 0x7f12e410e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009ca0 tx=0x7f12dc02a950 comp rx=0 tx=0).stop 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 -- 172.21.15.137:0/4020793691 shutdown_connections 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 --2- 172.21.15.137:0/4020793691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e410bbc0 0x7f12e410e060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 --2- 172.21.15.137:0/4020793691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e410b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 --2- 172.21.15.137:0/4020793691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e41027a0 0x7f12e4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.805+0000 7f12e8c00640 1 -- 172.21.15.137:0/4020793691 >> 172.21.15.137:0/4020793691 conn(0x7f12e40fbfc0 msgr2=0x7f12e40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.806+0000 7f12e8c00640 1 -- 172.21.15.137:0/4020793691 shutdown_connections 2024-04-25T02:10:54.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.806+0000 7f12e8c00640 1 -- 172.21.15.137:0/4020793691 wait complete. 2024-04-25T02:10:54.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.807+0000 7f12e8c00640 1 Processor -- start 2024-04-25T02:10:54.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.807+0000 7f12e8c00640 1 -- start start 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e4100930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 0x7f12e4100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12e4111b30 con 0x7f12e41030c0 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41119b0 con 0x7f12e41027a0 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e8c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12e4111cb0 con 0x7f12e410bbc0 2024-04-25T02:10:54.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e2a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e4100930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52200/0 (socket says 172.21.15.137:52200) 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e3400640 1 -- 172.21.15.137:0/693571278 learned_addr learned my addr 172.21.15.137:0/693571278 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.808+0000 7f12e3e00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 0x7f12e4100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 -- 172.21.15.137:0/693571278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 msgr2=0x7f12e4100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 0x7f12e4100e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 -- 172.21.15.137:0/693571278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 msgr2=0x7f12e41003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 -- 172.21.15.137:0/693571278 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e41a6430 con 0x7f12e41030c0 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e3e00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 0x7f12e4100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e3400640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:54.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12e2a00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e4100930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12d000e7a0 tx=0x7f12d000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12dbe00640 1 -- 172.21.15.137:0/693571278 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d000ccc0 con 0x7f12e41030c0 2024-04-25T02:10:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12dbe00640 1 -- 172.21.15.137:0/693571278 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12d0009530 con 0x7f12e41030c0 2024-04-25T02:10:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.809+0000 7f12dbe00640 1 -- 172.21.15.137:0/693571278 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00188e0 con 0x7f12e41030c0 2024-04-25T02:10:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.810+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e41a6720 con 0x7f12e41030c0 2024-04-25T02:10:54.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.810+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e41a6c20 con 0x7f12e41030c0 2024-04-25T02:10:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 Processor -- start 2024-04-25T02:10:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 -- start start 2024-04-25T02:10:54.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab59c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fd4aab3560 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55fd4aa5b930 con 0x55fd4ab4fb00 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.814+0000 7f12ed180740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fd4aaaf520 con 0x55fd4ab5a1d0 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32982/0 (socket says 172.21.15.137:32982) 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 -- 172.21.15.137:0/1431859573 learned_addr learned my addr 172.21.15.137:0/1431859573 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3400640 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab59c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12dbe00640 1 -- 172.21.15.137:0/693571278 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f12d0018a80 con 0x7f12e41030c0 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 -- 172.21.15.137:0/1431859573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 msgr2=0x55fd4ab5c5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 -- 172.21.15.137:0/1431859573 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 msgr2=0x55fd4ab59c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab59c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3e00640 1 -- 172.21.15.137:0/1431859573 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4a8917d0 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.815+0000 7f12e3400640 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab59c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.816+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009ca0 tx=0x7f12dc005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2054048a594737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.816+0000 7f12cfe00640 1 -- 172.21.15.137:0/1431859573 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc048070 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.816+0000 7f12cfe00640 1 -- 172.21.15.137:0/1431859573 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12dc003970 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.816+0000 7f12cfe00640 1 -- 172.21.15.137:0/1431859573 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc034040 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12dbe00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 0x7f12c80a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 -- 172.21.15.137:0/1431859573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 msgr2=0x55fd4ab4f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009ca0 tx=0x7f12dc005fa0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 -- 172.21.15.137:0/1431859573 shutdown_connections 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab59c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 --2- 172.21.15.137:0/1431859573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab4f5c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.817+0000 7f12ed180740 1 -- 172.21.15.137:0/1431859573 >> 172.21.15.137:0/1431859573 conn(0x55fd4ab4b500 msgr2=0x55fd4ab4b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.818+0000 7f12dbe00640 1 -- 172.21.15.137:0/693571278 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f12d00cf810 con 0x7f12e41030c0 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.818+0000 7f12e3400640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 0x7f12c80a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.818+0000 7f12ed180740 1 -- 172.21.15.137:0/1431859573 shutdown_connections 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.818+0000 7f12ed180740 1 -- 172.21.15.137:0/1431859573 wait complete. 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.818+0000 7f12e3400640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 0x7f12c80a53f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55fd4ab507a0 tx=0x7f12d4005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.819+0000 7f12ed180740 1 -- start start 2024-04-25T02:10:54.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.819+0000 7f12ed180740 1 Processor -- start 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab57cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fd4ab5cf60 con 0x55fd4ab4fb00 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55fd4aa6ed90 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fd4ab5d0e0 con 0x55fd4ab5a1d0 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12ed180740 10 client.0 _ll_register_callbacks cb 0x55fd4aa6e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12e3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12e3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52212/0 (socket says 172.21.15.137:52212) 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12e3400640 1 -- 172.21.15.137:0/1514986244 learned_addr learned my addr 172.21.15.137:0/1514986244 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.820+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 -- 172.21.15.137:0/1514986244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 msgr2=0x55fd4ab57cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab57cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab57cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 -- 172.21.15.137:0/1514986244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 msgr2=0x55fd4ab57770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab57770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 -- 172.21.15.137:0/1514986244 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4a7c73f0 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab57cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:54.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12e3400640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f12d400f820 tx=0x7f12d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33049c521b53dd55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.821+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40119c0 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f12d4011b60 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12dc003970 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f12d4011d60 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ed180740 10 client.25646 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fd4a7870f0 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.822+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12d401e970 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f12d4027070 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 10 client.25646 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 20 client.25646 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4ab6a680 0x55fd4ab6cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 4 client.25646 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:54.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12dc003970 con 0x55fd4ab6a680 2024-04-25T02:10:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.823+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4ab6a680 0x55fd4ab6cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.824+0000 7f12ccc00640 10 client.25646 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.824+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4ab6a680 0x55fd4ab6cae0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa535ba3041601e server_cookie=9b8fd5c191f87b31 in_seq=0 out_seq=0 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.824+0000 7f12ccc00640 1 -- 172.21.15.137:0/1514986244 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f12dc003970 con 0x55fd4ab6a680 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.824+0000 7f12ccc00640 10 client.25646 handle_command_reply: tid=0 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 client.25646 shutdown 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 msgr2=0x55fd4ab57230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f12d400f820 tx=0x7f12d4004730 comp rx=0 tx=0).stop 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 shutdown_connections 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4ab6a680 0x55fd4ab6cae0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab57cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab57770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 --2- 172.21.15.137:0/1514986244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab57230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 >> 172.21.15.137:0/1514986244 conn(0x55fd4ab4b500 msgr2=0x55fd4ab50a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ccc00640 0 client.25646 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 shutdown_connections 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 1 -- 172.21.15.137:0/1514986244 wait complete. 2024-04-25T02:10:54.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.825+0000 7f12ed180740 20 client.25646 trim_cache size 0 max 16384 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.843+0000 7f12ed180740 1 Processor -- start 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 -- start start 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab65e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab4a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab56210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41b1d00 con 0x55fd4ab5a1d0 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41af5d0 con 0x55fd4ab4fb00 2024-04-25T02:10:54.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12ed180740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41ad420 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab56210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab56210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33002/0 (socket says 172.21.15.137:33002) 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12e3e00640 1 -- 172.21.15.137:0/3237229767 learned_addr learned my addr 172.21.15.137:0/3237229767 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12e2a00640 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab4a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.844+0000 7f12e3400640 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab65e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 -- 172.21.15.137:0/3237229767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab4f1e0 msgr2=0x55fd4ab65e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab65e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 -- 172.21.15.137:0/3237229767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 msgr2=0x55fd4ab56210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab56210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 -- 172.21.15.137:0/3237229767 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4ab50050 con 0x55fd4ab4fb00 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12e2a00640 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab4a800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f12d00ccd50 tx=0x7f12d000ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5b96a8fc936b22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12cf400640 1 -- 172.21.15.137:0/3237229767 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0099ed0 con 0x55fd4ab4fb00 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12cf400640 1 -- 172.21.15.137:0/3237229767 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12d009ce50 con 0x55fd4ab4fb00 2024-04-25T02:10:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.845+0000 7f12cf400640 1 -- 172.21.15.137:0/3237229767 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d009aa90 con 0x55fd4ab4fb00 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- 172.21.15.137:0/3237229767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 msgr2=0x55fd4ab4a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab4a800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f12d00ccd50 tx=0x7f12d000ef70 comp rx=0 tx=0).stop 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- 172.21.15.137:0/3237229767 shutdown_connections 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab56210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab4a800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 --2- 172.21.15.137:0/3237229767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab65e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- 172.21.15.137:0/3237229767 >> 172.21.15.137:0/3237229767 conn(0x55fd4ab4b500 msgr2=0x55fd4ab55b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- 172.21.15.137:0/3237229767 shutdown_connections 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- 172.21.15.137:0/3237229767 wait complete. 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.846+0000 7f12ed180740 1 -- start start 2024-04-25T02:10:54.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 Processor -- start 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab5da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41ada90 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41aef00 con 0x55fd4ab4fb00 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f12e41ae160 con 0x55fd4ab5a1d0 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12ed180740 10 client.0 _ll_register_callbacks cb 0x7f12d400f6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.847+0000 7f12e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33008/0 (socket says 172.21.15.137:33008) 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 -- 172.21.15.137:0/1817998200 learned_addr learned my addr 172.21.15.137:0/1817998200 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3e00640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab5da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 -- 172.21.15.137:0/1817998200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 msgr2=0x55fd4ab5dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 -- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 msgr2=0x55fd4ab5da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab5da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 -- 172.21.15.137:0/1817998200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4ab5e780 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12e3400640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f12d40299b0 tx=0x7f12d4029e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f3689828e4b846 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.848+0000 7f12ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4036070 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f12d40296d0 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12d009ce50 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f12d4040050 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ed180740 10 client.15576 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55fd4abd0c40 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.849+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f12d009ce50 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f12d4027040 con 0x55fd4ab4f1e0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 10 client.15576 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 20 client.15576 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4abd13b0 0x55fd4abd37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 4 client.15576 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd4aac6d90 con 0x55fd4abd13b0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.850+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4abd13b0 0x55fd4abd37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12e2a00640 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4abd13b0 0x55fd4abd37d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15807b12f664a7 server_cookie=d646806c841c1125 in_seq=0 out_seq=0 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ccc00640 10 client.15576 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:54.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ccc00640 1 -- 172.21.15.137:0/1817998200 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fd4aac6d90 con 0x55fd4abd13b0 2024-04-25T02:10:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ccc00640 10 client.15576 handle_command_reply: tid=0 2024-04-25T02:10:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 client.15576 shutdown 2024-04-25T02:10:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 msgr2=0x55fd4ab626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f12d40299b0 tx=0x7f12d4029e50 comp rx=0 tx=0).stop 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 shutdown_connections 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55fd4abd13b0 0x55fd4abd37d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fd4ab5a1d0 0x55fd4ab5dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fd4ab4fb00 0x55fd4ab5da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 --2- 172.21.15.137:0/1817998200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fd4ab4f1e0 0x55fd4ab626f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 >> 172.21.15.137:0/1817998200 conn(0x55fd4ab4b500 msgr2=0x55fd4ab4a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ccc00640 0 client.15576 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 shutdown_connections 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.851+0000 7f12ed180740 1 -- 172.21.15.137:0/1817998200 wait complete. 2024-04-25T02:10:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12ed180740 20 client.15576 trim_cache size 0 max 16384 2024-04-25T02:10:54.864 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:54.864 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-25T02:10:54.864 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-25T02:10:54.864 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:54.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 msgr2=0x7f12c80a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 0x7f12c80a53f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55fd4ab507a0 tx=0x7f12d4005f90 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 msgr2=0x7f12e4100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e4100930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12d000e7a0 tx=0x7f12d000ec60 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 shutdown_connections 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f12c80a2f30 0x7f12c80a53f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12e410bbc0 0x7f12e4100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f12e41030c0 0x7f12e4100930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 --2- 172.21.15.137:0/693571278 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f12e41027a0 0x7f12e41003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.852+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 >> 172.21.15.137:0/693571278 conn(0x7f12e40fbfc0 msgr2=0x7f12e410d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.853+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 shutdown_connections 2024-04-25T02:10:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:54.853+0000 7f12e8c00640 1 -- 172.21.15.137:0/693571278 wait complete. 2024-04-25T02:10:54.877 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:10:54.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:10:55.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 -- 172.21.15.137:0/3991793139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0080688d0 msgr2=0x7fe008068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 --2- 172.21.15.137:0/3991793139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0080688d0 0x7fe008068d50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009900 tx=0x7fdff402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 -- 172.21.15.137:0/3991793139 shutdown_connections 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 --2- 172.21.15.137:0/3991793139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe008069290 0x7fe00810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 --2- 172.21.15.137:0/3991793139 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0080688d0 0x7fe008068d50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 --2- 172.21.15.137:0/3991793139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe0081075f0 0x7fe0081079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.100+0000 7fe00e000640 1 -- 172.21.15.137:0/3991793139 >> 172.21.15.137:0/3991793139 conn(0x7fe008075f80 msgr2=0x7fe008076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.101+0000 7fe00e000640 1 -- 172.21.15.137:0/3991793139 shutdown_connections 2024-04-25T02:10:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.101+0000 7fe00e000640 1 -- 172.21.15.137:0/3991793139 wait complete. 2024-04-25T02:10:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.102+0000 7fe00e000640 1 Processor -- start 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.102+0000 7fe00e000640 1 -- start start 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 0x7fe008100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0081075f0 0x7fe008101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe008111ad0 con 0x7fe008069290 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe008111950 con 0x7fe0080688d0 2024-04-25T02:10:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00e000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe008111c50 con 0x7fe0081075f0 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe007e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00cc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 0x7fe008100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe007e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33024/0 (socket says 172.21.15.137:33024) 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe007e00640 1 -- 172.21.15.137:0/3952084826 learned_addr learned my addr 172.21.15.137:0/3952084826 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.103+0000 7fe00d600640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0081075f0 0x7fe008101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 -- 172.21.15.137:0/3952084826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0081075f0 msgr2=0x7fe008101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0081075f0 0x7fe008101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 -- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 msgr2=0x7fe008100d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 -- 172.21.15.137:0/3952084826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0081a6430 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe007e00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00cc00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 0x7fe008100800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00b3c0 tx=0x7fdffc00b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc011830 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdffc016070 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00f2e0 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.104+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0081a6720 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.105+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0081a6c70 con 0x7fe0080688d0 2024-04-25T02:10:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.106+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe008068480 con 0x7fe0080688d0 2024-04-25T02:10:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.110+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fdffc01a410 con 0x7fe0080688d0 2024-04-25T02:10:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.111+0000 7fe005600640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 0x7fdff00a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.111+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fdffc0cebe0 con 0x7fe0080688d0 2024-04-25T02:10:55.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.112+0000 7fe007e00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 0x7fdff00a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.112+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fdffc01f060 con 0x7fe0080688d0 2024-04-25T02:10:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.113+0000 7fe007e00640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 0x7fdff00a53a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005ec0 tx=0x7fdff4005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.347+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0081099e0 con 0x7fe0080688d0 2024-04-25T02:10:55.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.348+0000 7fe005600640 1 -- 172.21.15.137:0/3952084826 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11884 (secure 0 0 0) 0x7fdffc09b790 con 0x7fe0080688d0 2024-04-25T02:10:55.357 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:10:55.357 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:09:41.384129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24559,24538]},"id":1}]} 2024-04-25T02:10:55.358 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 23 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 msgr2=0x7fdff00a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 0x7fdff00a53a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdff4005ec0 tx=0x7fdff4005a20 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 msgr2=0x7fe008100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 0x7fe008100800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00b3c0 tx=0x7fdffc00b880 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 shutdown_connections 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fdff00a2ee0 0x7fdff00a53a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0081075f0 0x7fe008101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe008069290 0x7fe008100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 --2- 172.21.15.137:0/3952084826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe0080688d0 0x7fe008100800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 >> 172.21.15.137:0/3952084826 conn(0x7fe008075f80 msgr2=0x7fe0080ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 shutdown_connections 2024-04-25T02:10:55.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.351+0000 7fe00e000640 1 -- 172.21.15.137:0/3952084826 wait complete. 2024-04-25T02:10:55.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T02:10:55.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:55 smithi137 ceph-mon[28303]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:55.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 -- 172.21.15.137:0/4131920644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd360101710 msgr2=0x7fd360101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 --2- 172.21.15.137:0/4131920644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd360101710 0x7fd360101b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd348009900 tx=0x7fd34802a3f0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 -- 172.21.15.137:0/4131920644 shutdown_connections 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 --2- 172.21.15.137:0/4131920644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3601020d0 0x7fd36010e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 --2- 172.21.15.137:0/4131920644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd360101710 0x7fd360101b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 --2- 172.21.15.137:0/4131920644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd360107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 -- 172.21.15.137:0/4131920644 >> 172.21.15.137:0/4131920644 conn(0x7fd360078b90 msgr2=0x7fd360078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 -- 172.21.15.137:0/4131920644 shutdown_connections 2024-04-25T02:10:55.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.611+0000 7fd365600640 1 -- 172.21.15.137:0/4131920644 wait complete. 2024-04-25T02:10:55.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.613+0000 7fd365600640 1 Processor -- start 2024-04-25T02:10:55.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.613+0000 7fd365600640 1 -- start start 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.613+0000 7fd365600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd360101710 0x7fd36019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd365600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd365600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd36019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd365600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd360111c50 con 0x7fd360107720 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd365600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd360111ad0 con 0x7fd3601020d0 2024-04-25T02:10:55.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd365600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd360111dd0 con 0x7fd360101710 2024-04-25T02:10:55.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52270/0 (socket says 172.21.15.137:52270) 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 -- 172.21.15.137:0/1012555511 learned_addr learned my addr 172.21.15.137:0/1012555511 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd35ea00640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd360101710 0x7fd36019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd35f400640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd36019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 -- 172.21.15.137:0/1012555511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd360101710 msgr2=0x7fd36019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd360101710 0x7fd36019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 -- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 msgr2=0x7fd36019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd36019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd357e00640 1 -- 172.21.15.137:0/1012555511 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36019f330 con 0x7fd3601020d0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.614+0000 7fd35f400640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd36019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd357e00640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd348006010 tx=0x7fd3480049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd357400640 1 -- 172.21.15.137:0/1012555511 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34803f030 con 0x7fd3601020d0 2024-04-25T02:10:55.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd357400640 1 -- 172.21.15.137:0/1012555511 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd348004dd0 con 0x7fd3601020d0 2024-04-25T02:10:55.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd357400640 1 -- 172.21.15.137:0/1012555511 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348035070 con 0x7fd3601020d0 2024-04-25T02:10:55.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36019f5c0 con 0x7fd3601020d0 2024-04-25T02:10:55.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.615+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3601a6eb0 con 0x7fd3601020d0 2024-04-25T02:10:55.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.619+0000 7fd357400640 1 -- 172.21.15.137:0/1012555511 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fd348042030 con 0x7fd3601020d0 2024-04-25T02:10:55.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.620+0000 7fd3685c3740 1 Processor -- start 2024-04-25T02:10:55.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.620+0000 7fd3685c3740 1 -- start start 2024-04-25T02:10:55.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.620+0000 7fd357400640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 0x7fd3440a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd357400640 1 -- 172.21.15.137:0/1012555511 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd3480efa60 con 0x7fd3601020d0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e1fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd35f400640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 0x7fd3440a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e2085b0 0x55d41e20a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d41e1624e0 con 0x55d41e1fd5c0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d41e10aa70 con 0x55d41e2085b0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd3685c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d41e15e4a0 con 0x55d41e1fdee0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd357e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd357e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45744/0 (socket says 172.21.15.137:45744) 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.621+0000 7fd357e00640 1 -- 172.21.15.137:0/2332850437 learned_addr learned my addr 172.21.15.137:0/2332850437 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e1fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 -- 172.21.15.137:0/2332850437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e2085b0 msgr2=0x55d41e20a9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:10:55.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e2085b0 0x55d41e20a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 -- 172.21.15.137:0/2332850437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 msgr2=0x55d41e1fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e1fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 -- 172.21.15.137:0/2332850437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41de763f0 con 0x55d41e1fdee0 2024-04-25T02:10:55.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd357e00640 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd348005ec0 tx=0x7fd3480bb9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40730ac77fc67ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd35f400640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 0x7fd3440a5370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd358005fd0 tx=0x7fd358009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd34f400640 1 -- 172.21.15.137:0/2332850437 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348049040 con 0x55d41e1fdee0 2024-04-25T02:10:55.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd34f400640 1 -- 172.21.15.137:0/2332850437 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3480c0120 con 0x55d41e1fdee0 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.622+0000 7fd34f400640 1 -- 172.21.15.137:0/2332850437 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3480c4550 con 0x55d41e1fdee0 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 -- 172.21.15.137:0/2332850437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 msgr2=0x55d41e208070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd348005ec0 tx=0x7fd3480bb9e0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 -- 172.21.15.137:0/2332850437 shutdown_connections 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e2085b0 0x55d41e20a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e208070 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2332850437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e1fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.623+0000 7fd3685c3740 1 -- 172.21.15.137:0/2332850437 >> 172.21.15.137:0/2332850437 conn(0x55d41e1f98e0 msgr2=0x55d41e1f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.624+0000 7fd3685c3740 1 -- 172.21.15.137:0/2332850437 shutdown_connections 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.624+0000 7fd3685c3740 1 -- 172.21.15.137:0/2332850437 wait complete. 2024-04-25T02:10:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.624+0000 7fd3685c3740 1 -- start start 2024-04-25T02:10:55.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 Processor -- start 2024-04-25T02:10:55.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fd5c0 0x55d41e2055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e2085b0 0x55d41e206050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d41e213970 con 0x55d41e2085b0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d41e11dec0 con 0x55d41e1fd5c0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d41e213af0 con 0x55d41e1fdee0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.625+0000 7fd3685c3740 10 client.0 _ll_register_callbacks cb 0x55d41e15a3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd35ea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fd5c0 0x55d41e2055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45758/0 (socket says 172.21.15.137:45758) 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 -- 172.21.15.137:0/1178060427 learned_addr learned my addr 172.21.15.137:0/1178060427 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd35f400640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e2085b0 0x55d41e206050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 -- 172.21.15.137:0/1178060427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fd5c0 msgr2=0x55d41e2055d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fd5c0 0x55d41e2055d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 -- 172.21.15.137:0/1178060427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e2085b0 msgr2=0x55d41e206050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e2085b0 0x55d41e206050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 -- 172.21.15.137:0/1178060427 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41df407d0 con 0x55d41e1fdee0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd357e00640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd3480bba70 tx=0x7fd348005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e5a24e1e72969a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.626+0000 7fd343e00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34809e020 con 0x55d41e1fdee0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd3480b83e0 con 0x55d41e1fdee0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3480c0120 con 0x55d41e1fdee0 2024-04-25T02:10:55.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd348049070 con 0x55d41e1fdee0 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd3685c3740 10 client.25717 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.627+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d41e213970 con 0x55d41e1fdee0 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3480c0120 con 0x55d41e1fdee0 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd3480d2070 con 0x55d41e1fdee0 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 10 client.25717 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 10 client.25717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 20 client.25717 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e220ef0 0x55d41e223310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 4 client.25717 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.628+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d41e16fa20 con 0x55d41e220ef0 2024-04-25T02:10:55.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.629+0000 7fd35ea00640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e220ef0 0x55d41e223310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.629+0000 7fd35ea00640 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e220ef0 0x55d41e223310 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8be9a46880ad5ac4 server_cookie=c2780810a2d61e3c in_seq=0 out_seq=0 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.629+0000 7fd343e00640 10 client.25717 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.630+0000 7fd343e00640 1 -- 172.21.15.137:0/1178060427 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d41e16fa20 con 0x55d41e220ef0 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.630+0000 7fd343e00640 10 client.25717 handle_command_reply: tid=0 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.630+0000 7fd3685c3740 1 client.25717 shutdown 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 msgr2=0x55d41e205b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd3480bba70 tx=0x7fd348005b50 comp rx=0 tx=0).stop 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 shutdown_connections 2024-04-25T02:10:55.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e2085b0 0x55d41e206050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e220ef0 0x55d41e223310 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e1fdee0 0x55d41e205b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 --2- 172.21.15.137:0/1178060427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fd5c0 0x55d41e2055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 >> 172.21.15.137:0/1178060427 conn(0x55d41e1f98e0 msgr2=0x55d41e1f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd343e00640 0 client.25717 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 shutdown_connections 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.631+0000 7fd3685c3740 1 -- 172.21.15.137:0/1178060427 wait complete. 2024-04-25T02:10:55.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.632+0000 7fd3685c3740 20 client.25717 trim_cache size 0 max 16384 2024-04-25T02:10:55.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:55 smithi163 ceph-mon[32577]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:55.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 Processor -- start 2024-04-25T02:10:55.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 -- start start 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e205e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e228b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601adb70 con 0x55d41e1fd5c0 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601ab440 con 0x55d41e1fdee0 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.659+0000 7fd3685c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601a92b0 con 0x55d41e2085b0 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33078/0 (socket says 172.21.15.137:33078) 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 -- 172.21.15.137:0/2570312182 learned_addr learned my addr 172.21.15.137:0/2570312182 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35f400640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e228b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd357e00640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e205e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 -- 172.21.15.137:0/2570312182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 msgr2=0x55d41e228b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e228b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 -- 172.21.15.137:0/2570312182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 msgr2=0x55d41e205e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e205e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd35ea00640 1 -- 172.21.15.137:0/2570312182 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41e203b20 con 0x55d41e1fd5c0 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.660+0000 7fd357e00640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e205e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.661+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd350005870 tx=0x7fd350005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7066f9f333a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.661+0000 7fd34ea00640 1 -- 172.21.15.137:0/2570312182 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350004250 con 0x55d41e1fd5c0 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.661+0000 7fd34ea00640 1 -- 172.21.15.137:0/2570312182 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd35001f930 con 0x55d41e1fd5c0 2024-04-25T02:10:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.661+0000 7fd34ea00640 1 -- 172.21.15.137:0/2570312182 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35001e390 con 0x55d41e1fd5c0 2024-04-25T02:10:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 -- 172.21.15.137:0/2570312182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 msgr2=0x55d41e21c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd350005870 tx=0x7fd350005f90 comp rx=0 tx=0).stop 2024-04-25T02:10:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 -- 172.21.15.137:0/2570312182 shutdown_connections 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e228b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e205e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2570312182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e21c7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 -- 172.21.15.137:0/2570312182 >> 172.21.15.137:0/2570312182 conn(0x55d41e1f98e0 msgr2=0x55d41e1ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 -- 172.21.15.137:0/2570312182 shutdown_connections 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.662+0000 7fd3685c3740 1 -- 172.21.15.137:0/2570312182 wait complete. 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 -- start start 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 Processor -- start 2024-04-25T02:10:55.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e202110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e202650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601a9900 con 0x55d41e1fd5c0 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601aad70 con 0x55d41e1fdee0 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.663+0000 7fd3685c3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3601a9fd0 con 0x55d41e2085b0 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd3685c3740 10 client.0 _ll_register_callbacks cb 0x7fd3480bb8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33088/0 (socket says 172.21.15.137:33088) 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 -- 172.21.15.137:0/2432436752 learned_addr learned my addr 172.21.15.137:0/2432436752 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd357e00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e202110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35f400640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e202650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 -- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 msgr2=0x55d41e202650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e202650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 -- 172.21.15.137:0/2432436752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 msgr2=0x55d41e202110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e202110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35ea00640 1 -- 172.21.15.137:0/2432436752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41e202e30 con 0x55d41e1fd5c0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd35f400640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e202650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.664+0000 7fd357e00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e202110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd35ea00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd350010fb0 tx=0x7fd3500038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c192cea4144c2d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd343e00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350003d80 con 0x55d41e1fd5c0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd35001f430 con 0x55d41e1fd5c0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd35001f930 con 0x55d41e1fd5c0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd35001f630 con 0x55d41e1fd5c0 2024-04-25T02:10:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd3685c3740 10 client.15597 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.665+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55d41e287360 con 0x55d41e1fd5c0 2024-04-25T02:10:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd35001f930 con 0x55d41e1fd5c0 2024-04-25T02:10:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd350032470 con 0x55d41e1fd5c0 2024-04-25T02:10:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 10 client.15597 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 10 client.15597 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:10:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 20 client.15597 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e2879d0 0x55d41e289df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 4 client.15597 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.666+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d41e169d70 con 0x55d41e2879d0 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.667+0000 7fd357e00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e2879d0 0x55d41e289df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.667+0000 7fd357e00640 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e2879d0 0x55d41e289df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17230eae20a5a1ae server_cookie=9c545135d5f08782 in_seq=0 out_seq=0 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.667+0000 7fd343e00640 10 client.15597 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd343e00640 1 -- 172.21.15.137:0/2432436752 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d41e169d70 con 0x55d41e2879d0 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd343e00640 10 client.15597 handle_command_reply: tid=0 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 client.15597 shutdown 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 msgr2=0x55d41e219110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd350010fb0 tx=0x7fd3500038c0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 shutdown_connections 2024-04-25T02:10:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d41e2879d0 0x55d41e289df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41e2085b0 0x55d41e202650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d41e1fdee0 0x55d41e202110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 --2- 172.21.15.137:0/2432436752 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d41e1fd5c0 0x55d41e219110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 >> 172.21.15.137:0/2432436752 conn(0x55d41e1f98e0 msgr2=0x55d41e206e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd343e00640 0 client.15597 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 shutdown_connections 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.668+0000 7fd3685c3740 1 -- 172.21.15.137:0/2432436752 wait complete. 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd3685c3740 20 client.15597 trim_cache size 0 max 16384 2024-04-25T02:10:55.679 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 msgr2=0x7fd3440a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 0x7fd3440a5370 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd358005fd0 tx=0x7fd358009500 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 msgr2=0x7fd36019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd348006010 tx=0x7fd3480049d0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 shutdown_connections 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd3440a2eb0 0x7fd3440a5370 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd360107720 0x7fd36019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd3601020d0 0x7fd36019a8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 --2- 172.21.15.137:0/1012555511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd360101710 0x7fd36019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.669+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 >> 172.21.15.137:0/1012555511 conn(0x7fd360078b90 msgr2=0x7fd3600fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.670+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 shutdown_connections 2024-04-25T02:10:55.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.670+0000 7fd365600640 1 -- 172.21.15.137:0/1012555511 wait complete. 2024-04-25T02:10:55.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:55 smithi174 ceph-mon[33171]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:10:55.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 -- 172.21.15.137:0/3599987777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc1030c0 msgr2=0x7fd5fc10b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 --2- 172.21.15.137:0/3599987777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc10b5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009860 tx=0x7fd5e802a3d0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 -- 172.21.15.137:0/3599987777 shutdown_connections 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 --2- 172.21.15.137:0/3599987777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc10bbc0 0x7fd5fc10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 --2- 172.21.15.137:0/3599987777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc10b5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 --2- 172.21.15.137:0/3599987777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 -- 172.21.15.137:0/3599987777 >> 172.21.15.137:0/3599987777 conn(0x7fd5fc0fbfc0 msgr2=0x7fd5fc0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 -- 172.21.15.137:0/3599987777 shutdown_connections 2024-04-25T02:10:55.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.856+0000 7fd600e00640 1 -- 172.21.15.137:0/3599987777 wait complete. 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 Processor -- start 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 -- start start 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc10bbc0 0x7fd5fc19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc111b30 con 0x7fd5fc1027a0 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1119b0 con 0x7fd5fc1030c0 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.857+0000 7fd600e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc111cb0 con 0x7fd5fc10bbc0 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33114/0 (socket says 172.21.15.137:33114) 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5fb400640 1 -- 172.21.15.137:0/248775552 learned_addr learned my addr 172.21.15.137:0/248775552 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc10bbc0 0x7fd5fc19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 -- 172.21.15.137:0/248775552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc10bbc0 msgr2=0x7fd5fc19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc10bbc0 0x7fd5fc19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 -- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 msgr2=0x7fd5fc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.858+0000 7fd5faa00640 1 -- 172.21.15.137:0/248775552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc19cfb0 con 0x7fd5fc1030c0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd5faa00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc198550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5e802a8f0 tx=0x7fd5e8030910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd5f3e00640 1 -- 172.21.15.137:0/248775552 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8040020 con 0x7fd5fc1030c0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc19d240 con 0x7fd5fc1030c0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd5f3e00640 1 -- 172.21.15.137:0/248775552 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5e8031e50 con 0x7fd5fc1030c0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd5f3e00640 1 -- 172.21.15.137:0/248775552 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80046c0 con 0x7fd5fc1030c0 2024-04-25T02:10:55.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.859+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1a4b30 con 0x7fd5fc1030c0 2024-04-25T02:10:55.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 Processor -- start 2024-04-25T02:10:55.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 -- start start 2024-04-25T02:10:55.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e9b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8df54e0 con 0x55b8d8e910c0 2024-04-25T02:10:55.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8d9da70 con 0x55b8d8e9b790 2024-04-25T02:10:55.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.864+0000 7fd605389740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8df14a0 con 0x55b8d8e907a0 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45810/0 (socket says 172.21.15.137:45810) 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 -- 172.21.15.137:0/3559021056 learned_addr learned my addr 172.21.15.137:0/3559021056 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fb400640 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e9b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 -- 172.21.15.137:0/3559021056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 msgr2=0x55b8d8e9db80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e9db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 -- 172.21.15.137:0/3559021056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 msgr2=0x55b8d8e9b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e9b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.865+0000 7fd5fbe00640 1 -- 172.21.15.137:0/3559021056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d8b093f0 con 0x55b8d8e907a0 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.866+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009f60 tx=0x7fd5f4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de61f0cde68c7a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.866+0000 7fd5f3e00640 1 -- 172.21.15.137:0/248775552 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7fd5e8043020 con 0x7fd5fc1030c0 2024-04-25T02:10:55.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.866+0000 7fd5f0c00640 1 -- 172.21.15.137:0/3559021056 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f401e070 con 0x55b8d8e907a0 2024-04-25T02:10:55.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.866+0000 7fd5f0c00640 1 -- 172.21.15.137:0/3559021056 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5f400fa40 con 0x55b8d8e907a0 2024-04-25T02:10:55.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.866+0000 7fd5f0c00640 1 -- 172.21.15.137:0/3559021056 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4019c00 con 0x55b8d8e907a0 2024-04-25T02:10:55.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.867+0000 7fd605389740 1 -- 172.21.15.137:0/3559021056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 msgr2=0x55b8d8e90b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.867+0000 7fd605389740 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009f60 tx=0x7fd5f4009f90 comp rx=0 tx=0).stop 2024-04-25T02:10:55.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.867+0000 7fd5f3e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 0x7fd5e00a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd5f3e00640 1 -- 172.21.15.137:0/248775552 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd5e80f0110 con 0x7fd5fc1030c0 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 -- 172.21.15.137:0/3559021056 shutdown_connections 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e9db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e9b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 --2- 172.21.15.137:0/3559021056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e90b80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 -- 172.21.15.137:0/3559021056 >> 172.21.15.137:0/3559021056 conn(0x55b8d8e8cac0 msgr2=0x55b8d8e8cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 0x7fd5e00a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 -- 172.21.15.137:0/3559021056 shutdown_connections 2024-04-25T02:10:55.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.868+0000 7fd605389740 1 -- 172.21.15.137:0/3559021056 wait complete. 2024-04-25T02:10:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.869+0000 7fd605389740 1 -- start start 2024-04-25T02:10:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.869+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 0x7fd5e00a53f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4019660 tx=0x7fd5f40196c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.869+0000 7fd605389740 1 Processor -- start 2024-04-25T02:10:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e98c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e99150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8ea2990 con 0x55b8d8e910c0 2024-04-25T02:10:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8db0ec0 con 0x55b8d8e9b790 2024-04-25T02:10:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b8d8ea2b10 con 0x55b8d8e907a0 2024-04-25T02:10:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd605389740 10 client.0 _ll_register_callbacks cb 0x55b8d8ded3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45812/0 (socket says 172.21.15.137:45812) 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd5fb400640 1 -- 172.21.15.137:0/920304425 learned_addr learned my addr 172.21.15.137:0/920304425 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.870+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e99150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5faa00640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e98c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 -- 172.21.15.137:0/920304425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 msgr2=0x55b8d8e99150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e99150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 -- 172.21.15.137:0/920304425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 msgr2=0x55b8d8e98c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e98c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 -- 172.21.15.137:0/920304425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d8bd37d0 con 0x55b8d8e907a0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5faa00640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e98c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5fb400640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec012730 tx=0x7fd5ec012bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67068baea1605ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5e5600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.871+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec010dc0 con 0x55b8d8e907a0 2024-04-25T02:10:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd5ec01c3f0 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5f400fa40 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd5ec01c5f0 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd605389740 10 client.25732 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b8d8eaec70 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5f400fa40 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd5ec00e980 con 0x55b8d8e907a0 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.872+0000 7fd605389740 10 client.25732 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd605389740 10 client.25732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd605389740 20 client.25732 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8eb0130 0x55b8d8eb2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd605389740 4 client.25732 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:55.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8d8e02a20 con 0x55b8d8eb0130 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.873+0000 7fd5faa00640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8eb0130 0x55b8d8eb2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.874+0000 7fd5faa00640 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8eb0130 0x55b8d8eb2560 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=abb7d82436c1a3bc server_cookie=6542150215dbc8b0 in_seq=0 out_seq=0 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.874+0000 7fd5e5600640 10 client.25732 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.874+0000 7fd5e5600640 1 -- 172.21.15.137:0/920304425 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b8d8e02a20 con 0x55b8d8eb0130 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.874+0000 7fd5e5600640 10 client.25732 handle_command_reply: tid=0 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.874+0000 7fd605389740 1 client.25732 shutdown 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 msgr2=0x55b8d8e986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec012730 tx=0x7fd5ec012bf0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 shutdown_connections 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8eb0130 0x55b8d8eb2560 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e9b790 0x55b8d8e99150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e910c0 0x55b8d8e98c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 --2- 172.21.15.137:0/920304425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e907a0 0x55b8d8e986d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 >> 172.21.15.137:0/920304425 conn(0x55b8d8e8cac0 msgr2=0x55b8d8e927c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd5e5600640 0 client.25732 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 shutdown_connections 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 1 -- 172.21.15.137:0/920304425 wait complete. 2024-04-25T02:10:55.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.875+0000 7fd605389740 20 client.25732 trim_cache size 0 max 16384 2024-04-25T02:10:55.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 Processor -- start 2024-04-25T02:10:55.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 -- start start 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8eab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8eb7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8eb8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1ad9a0 con 0x55b8d8e907a0 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1ab270 con 0x55b8d8e910c0 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.902+0000 7fd605389740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1a90c0 con 0x55b8d8e9b790 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8eab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8eb7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8eab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33142/0 (socket says 172.21.15.137:33142) 2024-04-25T02:10:55.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5fb400640 1 -- 172.21.15.137:0/29176946 learned_addr learned my addr 172.21.15.137:0/29176946 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8eb8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 -- 172.21.15.137:0/29176946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 msgr2=0x55b8d8eb8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8eb8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 -- 172.21.15.137:0/29176946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 msgr2=0x55b8d8eab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8eab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.903+0000 7fd5faa00640 1 -- 172.21.15.137:0/29176946 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8d8e86f90 con 0x55b8d8e910c0 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.904+0000 7fd5faa00640 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8eb7e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80ed6f0 tx=0x7fd5e8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575ca9392b62b755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.904+0000 7fd5e7e00640 1 -- 172.21.15.137:0/29176946 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80bcc50 con 0x55b8d8e910c0 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.904+0000 7fd5e7e00640 1 -- 172.21.15.137:0/29176946 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5e80bc550 con 0x55b8d8e910c0 2024-04-25T02:10:55.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.904+0000 7fd5e7e00640 1 -- 172.21.15.137:0/29176946 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80c4ca0 con 0x55b8d8e910c0 2024-04-25T02:10:55.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- 172.21.15.137:0/29176946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 msgr2=0x55b8d8eb7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8eb7e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80ed6f0 tx=0x7fd5e8000bc0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- 172.21.15.137:0/29176946 shutdown_connections 2024-04-25T02:10:55.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8eb8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8eb7e30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 --2- 172.21.15.137:0/29176946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8eab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- 172.21.15.137:0/29176946 >> 172.21.15.137:0/29176946 conn(0x55b8d8e8cac0 msgr2=0x55b8d8e939d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- 172.21.15.137:0/29176946 shutdown_connections 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- 172.21.15.137:0/29176946 wait complete. 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.905+0000 7fd605389740 1 -- start start 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 Processor -- start 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8e95020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8e95560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1a9730 con 0x55b8d8e907a0 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1aaba0 con 0x55b8d8e910c0 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1a9e00 con 0x55b8d8e9b790 2024-04-25T02:10:55.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.906+0000 7fd605389740 10 client.0 _ll_register_callbacks cb 0x7fd5ec0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:55.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33148/0 (socket says 172.21.15.137:33148) 2024-04-25T02:10:55.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 -- 172.21.15.137:0/4042743599 learned_addr learned my addr 172.21.15.137:0/4042743599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:55.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5faa00640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8e95020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fbe00640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8e95560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 -- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 msgr2=0x55b8d8e95560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8e95560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 -- 172.21.15.137:0/4042743599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 msgr2=0x55b8d8e95020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8e95020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5fb400640 1 -- 172.21.15.137:0/4042743599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8d8e95d40 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.907+0000 7fd5faa00640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8e95020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd5fb400640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326b477f7899a05f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd5e5600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0050c0 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd5ec005260 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5e80bc550 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd5ec005460 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd605389740 10 client.15612 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.908+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b8d8f165f0 con 0x55b8d8e907a0 2024-04-25T02:10:55.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5e80bc550 con 0x55b8d8e907a0 2024-04-25T02:10:55.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fd5ec00e640 con 0x55b8d8e907a0 2024-04-25T02:10:55.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 10 client.15612 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 10 client.15612 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 20 client.15612 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8f16d00 0x55b8d8f19120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 4 client.15612 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.909+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8d8dfcd70 con 0x55b8d8f16d00 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.910+0000 7fd5faa00640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8f16d00 0x55b8d8f19120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.910+0000 7fd5faa00640 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8f16d00 0x55b8d8f19120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fab27e8ace5d8878 server_cookie=fddd33c31371d78d in_seq=0 out_seq=0 2024-04-25T02:10:55.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.910+0000 7fd5e5600640 10 client.15612 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd5e5600640 1 -- 172.21.15.137:0/4042743599 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8d8dfcd70 con 0x55b8d8f16d00 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd5e5600640 10 client.15612 handle_command_reply: tid=0 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 client.15612 shutdown 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 msgr2=0x55b8d8ea8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec009e60 comp rx=0 tx=0).stop 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 shutdown_connections 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b8d8f16d00 0x55b8d8f19120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b8d8e9b790 0x55b8d8e95560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8d8e910c0 0x55b8d8e95020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 --2- 172.21.15.137:0/4042743599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b8d8e907a0 0x55b8d8ea8130 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd5e5600640 0 client.15612 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 >> 172.21.15.137:0/4042743599 conn(0x55b8d8e8cac0 msgr2=0x55b8d8e91f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 shutdown_connections 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 1 -- 172.21.15.137:0/4042743599 wait complete. 2024-04-25T02:10:55.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.911+0000 7fd605389740 20 client.15612 trim_cache size 0 max 16384 2024-04-25T02:10:55.922 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:55.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 msgr2=0x7fd5e00a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 0x7fd5e00a53f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4019660 tx=0x7fd5f40196c0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 msgr2=0x7fd5fc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:55.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc198550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5e802a8f0 tx=0x7fd5e8030910 comp rx=0 tx=0).stop 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 shutdown_connections 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd5e00a2f30 0x7fd5e00a53f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd5fc10bbc0 0x7fd5fc19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5fc1030c0 0x7fd5fc198550 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 --2- 172.21.15.137:0/248775552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5fc1027a0 0x7fd5fc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.912+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 >> 172.21.15.137:0/248775552 conn(0x7fd5fc0fbfc0 msgr2=0x7fd5fc0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.913+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 shutdown_connections 2024-04-25T02:10:55.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:55.913+0000 7fd600e00640 1 -- 172.21.15.137:0/248775552 wait complete. 2024-04-25T02:10:55.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T02:10:56.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 -- 172.21.15.137:0/2160128240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9010074410 msgr2=0x7f901010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 --2- 172.21.15.137:0/2160128240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9010074410 0x7f901010d960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009900 tx=0x7f8ffc02a490 comp rx=0 tx=0).stop 2024-04-25T02:10:56.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 -- 172.21.15.137:0/2160128240 shutdown_connections 2024-04-25T02:10:56.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 --2- 172.21.15.137:0/2160128240 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f901010dea0 0x7f9010110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 --2- 172.21.15.137:0/2160128240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9010074410 0x7f901010d960 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 --2- 172.21.15.137:0/2160128240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f9010073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.097+0000 7f9016200640 1 -- 172.21.15.137:0/2160128240 >> 172.21.15.137:0/2160128240 conn(0x7f90100fd110 msgr2=0x7f90100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.098+0000 7f9016200640 1 -- 172.21.15.137:0/2160128240 shutdown_connections 2024-04-25T02:10:56.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.098+0000 7f9016200640 1 -- 172.21.15.137:0/2160128240 wait complete. 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 Processor -- start 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 -- start start 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f901019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f901010dea0 0x7f901019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9010113d30 con 0x7f901010dea0 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9010113bb0 con 0x7f9010074410 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.099+0000 7f9016200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9010113eb0 con 0x7f9010073af0 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f9015800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f901010dea0 0x7f901019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f9014e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f901019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52372/0 (socket says 172.21.15.137:52372) 2024-04-25T02:10:56.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 -- 172.21.15.137:0/3223317327 learned_addr learned my addr 172.21.15.137:0/3223317327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 -- 172.21.15.137:0/3223317327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 msgr2=0x7f901019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f901019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 -- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f901010dea0 msgr2=0x7f901019ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f901010dea0 0x7f901019ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 -- 172.21.15.137:0/3223317327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901019f160 con 0x7f9010074410 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f9014e00640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f901019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.100+0000 7f900fe00640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc02aa80 tx=0x7f8ffc032a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.101+0000 7f900d600640 1 -- 172.21.15.137:0/3223317327 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc03f030 con 0x7f9010074410 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.101+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901019f3f0 con 0x7f9010074410 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.101+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90101a6ce0 con 0x7f9010074410 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.101+0000 7f900d600640 1 -- 172.21.15.137:0/3223317327 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ffc032e40 con 0x7f9010074410 2024-04-25T02:10:56.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.101+0000 7f900d600640 1 -- 172.21.15.137:0/3223317327 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc035070 con 0x7f9010074410 2024-04-25T02:10:56.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.104+0000 7f901a7c2740 1 Processor -- start 2024-04-25T02:10:56.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 -- start start 2024-04-25T02:10:56.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f59b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f59b790 0x56125f59db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56125f4f54e0 con 0x56125f5907a0 2024-04-25T02:10:56.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56125f49da70 con 0x56125f5910c0 2024-04-25T02:10:56.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.105+0000 7f901a7c2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56125f4f14a0 con 0x56125f59b790 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9015800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9015800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33182/0 (socket says 172.21.15.137:33182) 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9015800640 1 -- 172.21.15.137:0/580872239 learned_addr learned my addr 172.21.15.137:0/580872239 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f59b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 -- 172.21.15.137:0/580872239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f59b790 msgr2=0x56125f59db80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f59b790 0x56125f59db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 -- 172.21.15.137:0/580872239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 msgr2=0x56125f590b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9014e00640 1 -- 172.21.15.137:0/580872239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125f2093f0 con 0x56125f5910c0 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.106+0000 7f9015800640 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:56.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.107+0000 7f9014e00640 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f59b250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f900400afc0 tx=0x7f900400f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceaa8d29038c2d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.107+0000 7f9002000640 1 -- 172.21.15.137:0/580872239 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004005220 con 0x56125f5910c0 2024-04-25T02:10:56.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.107+0000 7f9002000640 1 -- 172.21.15.137:0/580872239 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9004004ca0 con 0x56125f5910c0 2024-04-25T02:10:56.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.107+0000 7f900d600640 1 -- 172.21.15.137:0/3223317327 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f8ffc042030 con 0x7f9010074410 2024-04-25T02:10:56.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.107+0000 7f9002000640 1 -- 172.21.15.137:0/580872239 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004010cd0 con 0x56125f5910c0 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 -- 172.21.15.137:0/580872239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 msgr2=0x56125f59b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f59b250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f900400afc0 tx=0x7f900400f850 comp rx=0 tx=0).stop 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 -- 172.21.15.137:0/580872239 shutdown_connections 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f59b790 0x56125f59db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f59b250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 --2- 172.21.15.137:0/580872239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f5907a0 0x56125f590b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.108+0000 7f901a7c2740 1 -- 172.21.15.137:0/580872239 >> 172.21.15.137:0/580872239 conn(0x56125f58cac0 msgr2=0x56125f58cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.109+0000 7f901a7c2740 1 -- 172.21.15.137:0/580872239 shutdown_connections 2024-04-25T02:10:56.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.109+0000 7f901a7c2740 1 -- 172.21.15.137:0/580872239 wait complete. 2024-04-25T02:10:56.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.109+0000 7f901a7c2740 1 -- start start 2024-04-25T02:10:56.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.109+0000 7f900d600640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 0x7f8ff80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.109+0000 7f901a7c2740 1 Processor -- start 2024-04-25T02:10:56.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f900d600640 1 -- 172.21.15.137:0/3223317327 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8ffc0ef8b0 con 0x7f9010074410 2024-04-25T02:10:56.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 0x56125f5986f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f9015800640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 0x7f8ff80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f599170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56125f59e580 con 0x56125f59b790 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56125f4b0ec0 con 0x56125f5907a0 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56125f59e700 con 0x56125f5910c0 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.110+0000 7f901a7c2740 10 client.0 _ll_register_callbacks cb 0x56125f4ed3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f9014e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 0x56125f5986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f900fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f9014e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 0x56125f5986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52384/0 (socket says 172.21.15.137:52384) 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f9014e00640 1 -- 172.21.15.137:0/3753140258 learned_addr learned my addr 172.21.15.137:0/3753140258 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f900fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45842/0 (socket says 172.21.15.137:45842) 2024-04-25T02:10:56.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.111+0000 7f9015800640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f599170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 -- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 msgr2=0x56125f5986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 0x56125f5986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 -- 172.21.15.137:0/3753140258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 msgr2=0x56125f599170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f599170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 -- 172.21.15.137:0/3753140258 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125f2d37d0 con 0x56125f5910c0 2024-04-25T02:10:56.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f9015800640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f599170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f9015800640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 0x7f8ff80a5280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9008005fd0 tx=0x7f9008009c40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f900fe00640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0ecdf0 tx=0x7f8ffc0bb7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbdd443e47e52795 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f8ff6a00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0bbbc0 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f8ffc0b8230 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.112+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9004004ca0 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc0bff70 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 10 client.25744 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56125f59e580 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ffc082080 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f8ffc0ed100 con 0x56125f5910c0 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 10 client.25744 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 10 client.25744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 20 client.25744 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f5b4410 0x56125f5b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 4 client.25744 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:56.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.113+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56125f502a20 con 0x56125f5b4410 2024-04-25T02:10:56.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.114+0000 7f9014e00640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f5b4410 0x56125f5b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.115+0000 7f9014e00640 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f5b4410 0x56125f5b6830 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35cbd80cdc7bd53d server_cookie=319fcb131d1e2ff in_seq=0 out_seq=0 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.115+0000 7f8ff6a00640 10 client.25744 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3753140258 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56125f502a20 con 0x56125f5b4410 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f8ff6a00640 10 client.25744 handle_command_reply: tid=0 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 client.25744 shutdown 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 msgr2=0x56125f598c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0ecdf0 tx=0x7f8ffc0bb7c0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 shutdown_connections 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f5b4410 0x56125f5b6830 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f599170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f8ff6a00640 0 client.25744 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5910c0 0x56125f598c30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3753140258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5907a0 0x56125f5986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 >> 172.21.15.137:0/3753140258 conn(0x56125f58cac0 msgr2=0x56125f5927c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 shutdown_connections 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.116+0000 7f901a7c2740 1 -- 172.21.15.137:0/3753140258 wait complete. 2024-04-25T02:10:56.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.117+0000 7f901a7c2740 20 client.25744 trim_cache size 0 max 16384 2024-04-25T02:10:56.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 Processor -- start 2024-04-25T02:10:56.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 -- start start 2024-04-25T02:10:56.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5bc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0010ea0 con 0x56125f59b790 2024-04-25T02:10:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000e770 con 0x56125f5910c0 2024-04-25T02:10:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.144+0000 7f901a7c2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000c5c0 con 0x56125f5907a0 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f9014e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52388/0 (socket says 172.21.15.137:52388) 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f9014e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45848/0 (socket says 172.21.15.137:45848) 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 -- 172.21.15.137:0/3484129369 learned_addr learned my addr 172.21.15.137:0/3484129369 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f9015800640 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 -- 172.21.15.137:0/3484129369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 msgr2=0x56125f5afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 -- 172.21.15.137:0/3484129369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 msgr2=0x56125f5bc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5bc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 -- 172.21.15.137:0/3484129369 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56125f5996c0 con 0x56125f5910c0 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f9015800640 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.145+0000 7f900fe00640 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc004650 tx=0x7f8ffc0ba0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb7fcd5f390f6f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.146+0000 7f9001600640 1 -- 172.21.15.137:0/3484129369 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0bbbc0 con 0x56125f5910c0 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.146+0000 7f9001600640 1 -- 172.21.15.137:0/3484129369 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ffc085070 con 0x56125f5910c0 2024-04-25T02:10:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.146+0000 7f9001600640 1 -- 172.21.15.137:0/3484129369 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0c43a0 con 0x56125f5910c0 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 -- 172.21.15.137:0/3484129369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 msgr2=0x56125f5bc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc004650 tx=0x7f8ffc0ba0d0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 -- 172.21.15.137:0/3484129369 shutdown_connections 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5bc100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3484129369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 -- 172.21.15.137:0/3484129369 >> 172.21.15.137:0/3484129369 conn(0x56125f58cac0 msgr2=0x56125f592780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 -- 172.21.15.137:0/3484129369 shutdown_connections 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.147+0000 7f901a7c2740 1 -- 172.21.15.137:0/3484129369 wait complete. 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 -- start start 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 Processor -- start 2024-04-25T02:10:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5a9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000cc30 con 0x56125f59b790 2024-04-25T02:10:56.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000e0a0 con 0x56125f5910c0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000d300 con 0x56125f5907a0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.148+0000 7f901a7c2740 10 client.0 _ll_register_callbacks cb 0x7f8ffc009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9015800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f900fe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52390/0 (socket says 172.21.15.137:52390) 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45862/0 (socket says 172.21.15.137:45862) 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f900fe00640 1 -- 172.21.15.137:0/3027955218 learned_addr learned my addr 172.21.15.137:0/3027955218 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 -- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 msgr2=0x56125f5ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 -- 172.21.15.137:0/3027955218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 msgr2=0x56125f5a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f9014e00640 1 -- 172.21.15.137:0/3027955218 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56125f5a9a40 con 0x56125f5907a0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.149+0000 7f900fe00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.150+0000 7f9014e00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9004010850 tx=0x7f90040107e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3675107925456922 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.150+0000 7f8ff6a00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.150+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004004870 con 0x56125f5907a0 2024-04-25T02:10:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.150+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f9004004a10 con 0x56125f5907a0 2024-04-25T02:10:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.150+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ffc085070 con 0x56125f5907a0 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9004004e50 con 0x56125f5907a0 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 10 client.25750 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56125f61b420 con 0x56125f5907a0 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ffc085070 con 0x56125f5907a0 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f9004018810 con 0x56125f5907a0 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 10 client.25750 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 20 client.25750 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f61b910 0x56125f61dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:56.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 4 client.25750 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.151+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56125f4fcd70 con 0x56125f61b910 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f900fe00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f61b910 0x56125f61dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f900fe00640 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f61b910 0x56125f61dd00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0c40408a6ef6f6 server_cookie=8c08e54d87eb4c16 in_seq=0 out_seq=0 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f8ff6a00640 10 client.25750 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f8ff6a00640 1 -- 172.21.15.137:0/3027955218 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56125f4fcd70 con 0x56125f61b910 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f8ff6a00640 10 client.25750 handle_command_reply: tid=0 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.152+0000 7f901a7c2740 1 client.25750 shutdown 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 msgr2=0x56125f5ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9004010850 tx=0x7f90040107e0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 shutdown_connections 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56125f61b910 0x56125f61dd00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56125f59b790 0x56125f5a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56125f5910c0 0x56125f5ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 --2- 172.21.15.137:0/3027955218 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56125f5907a0 0x56125f5ac240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 >> 172.21.15.137:0/3027955218 conn(0x56125f58cac0 msgr2=0x56125f598eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f8ff6a00640 0 client.25750 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 shutdown_connections 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 1 -- 172.21.15.137:0/3027955218 wait complete. 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.153+0000 7f901a7c2740 20 client.25750 trim_cache size 0 max 16384 2024-04-25T02:10:56.164 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 msgr2=0x7f8ff80a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 0x7f8ff80a5280 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9008005fd0 tx=0x7f9008009c40 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 msgr2=0x7f901019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc02aa80 tx=0x7f8ffc032a40 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 shutdown_connections 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f8ff80a2dc0 0x7f8ff80a5280 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f901010dea0 0x7f901019ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9010074410 0x7f901019a6b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 --2- 172.21.15.137:0/3223317327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9010073af0 0x7f901019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:56.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 >> 172.21.15.137:0/3223317327 conn(0x7f90100fd110 msgr2=0x7f9010110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:56.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 shutdown_connections 2024-04-25T02:10:56.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:56.154+0000 7f9016200640 1 -- 172.21.15.137:0/3223317327 wait complete. 2024-04-25T02:10:56.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3952084826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:56.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3952084826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:56.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3952084826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:10:57.182 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T02:10:57.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:10:57.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 -- 172.21.15.137:0/3257429459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 msgr2=0x7ff2d4100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 --2- 172.21.15.137:0/3257429459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d4100970 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009860 tx=0x7ff2c802a3e0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 -- 172.21.15.137:0/3257429459 shutdown_connections 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 --2- 172.21.15.137:0/3257429459 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d4105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 --2- 172.21.15.137:0/3257429459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d4105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 --2- 172.21.15.137:0/3257429459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d4100970 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.361+0000 7ff2da800640 1 -- 172.21.15.137:0/3257429459 >> 172.21.15.137:0/3257429459 conn(0x7ff2d40fbfc0 msgr2=0x7ff2d40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.362+0000 7ff2da800640 1 -- 172.21.15.137:0/3257429459 shutdown_connections 2024-04-25T02:10:57.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.362+0000 7ff2da800640 1 -- 172.21.15.137:0/3257429459 wait complete. 2024-04-25T02:10:57.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 Processor -- start 2024-04-25T02:10:57.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 -- start start 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d419e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d41a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4118140 con 0x7ff2d4105990 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d4117fc0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.363+0000 7ff2da800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41182c0 con 0x7ff2d4100590 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52418/0 (socket says 172.21.15.137:52418) 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 -- 172.21.15.137:0/3497116599 learned_addr learned my addr 172.21.15.137:0/3497116599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d41a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d9400640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d419e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 -- 172.21.15.137:0/3497116599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 msgr2=0x7ff2d419e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d419e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 -- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 msgr2=0x7ff2d41a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d41a2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 -- 172.21.15.137:0/3497116599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d41a35b0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d41a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.364+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e910 tx=0x7ff2c000edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.365+0000 7ff2d2000640 1 -- 172.21.15.137:0/3497116599 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000cd80 con 0x7ff2d4100eb0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.365+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d41a38a0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.365+0000 7ff2d2000640 1 -- 172.21.15.137:0/3497116599 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2c00035f0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.365+0000 7ff2d2000640 1 -- 172.21.15.137:0/3497116599 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0010690 con 0x7ff2d4100eb0 2024-04-25T02:10:57.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.365+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d41ab130 con 0x7ff2d4100eb0 2024-04-25T02:10:57.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.368+0000 7ff2dec51740 1 Processor -- start 2024-04-25T02:10:57.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.368+0000 7ff2dec51740 1 -- start start 2024-04-25T02:10:57.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df7d349f40 con 0x55df7d3eaf20 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55df7d34f190 con 0x55df7d3eb840 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2dec51740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55df7d2f7a10 con 0x55df7d3f5f10 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2d9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2d9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33224/0 (socket says 172.21.15.137:33224) 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2d9e00640 1 -- 172.21.15.137:0/1346542662 learned_addr learned my addr 172.21.15.137:0/1346542662 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.369+0000 7ff2d9400640 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 -- 172.21.15.137:0/1346542662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 msgr2=0x55df7d3f8300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f8300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 -- 172.21.15.137:0/1346542662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 msgr2=0x55df7d3f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 -- 172.21.15.137:0/1346542662 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7d12b7e0 con 0x55df7d3eaf20 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d2000640 1 -- 172.21.15.137:0/3497116599 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7ff2c00037a0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.370+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009fd0 tx=0x7ff2cc010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2aa7d8823b1d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.371+0000 7ff2c6600640 1 -- 172.21.15.137:0/1346542662 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011700 con 0x55df7d3eaf20 2024-04-25T02:10:57.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.371+0000 7ff2c6600640 1 -- 172.21.15.137:0/1346542662 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc011da0 con 0x55df7d3eaf20 2024-04-25T02:10:57.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.371+0000 7ff2c6600640 1 -- 172.21.15.137:0/1346542662 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00e620 con 0x55df7d3eaf20 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.371+0000 7ff2d2000640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 0x7ff2bc0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2d2000640 1 -- 172.21.15.137:0/3497116599 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff2c00cf9f0 con 0x7ff2d4100eb0 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2d9400640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 0x7ff2bc0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 -- 172.21.15.137:0/1346542662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 msgr2=0x55df7d3eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009fd0 tx=0x7ff2cc010860 comp rx=0 tx=0).stop 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 -- 172.21.15.137:0/1346542662 shutdown_connections 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1346542662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3eb300 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 -- 172.21.15.137:0/1346542662 >> 172.21.15.137:0/1346542662 conn(0x55df7d3e7240 msgr2=0x55df7d3e7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.372+0000 7ff2dec51740 1 -- 172.21.15.137:0/1346542662 shutdown_connections 2024-04-25T02:10:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.373+0000 7ff2dec51740 1 -- 172.21.15.137:0/1346542662 wait complete. 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.373+0000 7ff2d9400640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 0x7ff2bc0a53f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005e00 tx=0x7ff2c8005d50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.373+0000 7ff2dec51740 1 -- start start 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 Processor -- start 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df7d30ae70 con 0x55df7d3eaf20 2024-04-25T02:10:57.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55df7d34b150 con 0x55df7d3eb840 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55df7d3f8da0 con 0x55df7d3f5f10 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.374+0000 7ff2dec51740 10 client.0 _ll_register_callbacks cb 0x55df7d3461f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52440/0 (socket says 172.21.15.137:52440) 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 -- 172.21.15.137:0/1365344103 learned_addr learned my addr 172.21.15.137:0/1365344103 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d9400640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 -- 172.21.15.137:0/1365344103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 msgr2=0x55df7d3f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 -- 172.21.15.137:0/1365344103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 msgr2=0x55df7d3f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d8a00640 1 -- 172.21.15.137:0/1365344103 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7d18bf70 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.375+0000 7ff2d9400640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.376+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cd020 tx=0x7ff2c009c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95acff0c4a878430 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.376+0000 7ff2baa00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.376+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00b9060 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.376+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff2c009b150 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.376+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2cc011da0 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff2c00a4970 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2dec51740 10 client.25712 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55df7d023170 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc011da0 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7ff2c0097a50 con 0x55df7d3eb840 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2dec51740 10 client.25712 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.377+0000 7ff2dec51740 10 client.25712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:57.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.378+0000 7ff2dec51740 20 client.25712 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:57.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.378+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d406130 0x55df7d408520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.378+0000 7ff2dec51740 4 client.25712 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:57.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.378+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df7d35c6d0 con 0x55df7d406130 2024-04-25T02:10:57.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.378+0000 7ff2d9400640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d406130 0x55df7d408520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.379+0000 7ff2baa00640 10 client.25712 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.379+0000 7ff2d9400640 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d406130 0x55df7d408520 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9adf8b532929736 server_cookie=e4536b70b01b5c5c in_seq=0 out_seq=0 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2baa00640 1 -- 172.21.15.137:0/1365344103 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55df7d35c6d0 con 0x55df7d406130 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2baa00640 10 client.25712 handle_command_reply: tid=0 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 client.25712 shutdown 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 msgr2=0x55df7d3f34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00cd020 tx=0x7ff2c009c400 comp rx=0 tx=0).stop 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 shutdown_connections 2024-04-25T02:10:57.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d406130 0x55df7d408520 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3f34d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 --2- 172.21.15.137:0/1365344103 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 >> 172.21.15.137:0/1365344103 conn(0x55df7d3e7240 msgr2=0x55df7d3ecf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2baa00640 0 client.25712 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 shutdown_connections 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 1 -- 172.21.15.137:0/1365344103 wait complete. 2024-04-25T02:10:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.380+0000 7ff2dec51740 20 client.25712 trim_cache size 0 max 16384 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 Processor -- start 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 -- start start 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 0x55df7d401ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 0x55df7d3ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 0x55df7d40dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b6260 con 0x55df7d3eb840 2024-04-25T02:10:57.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b3b30 con 0x55df7d3f5f10 2024-04-25T02:10:57.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2dec51740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b1980 con 0x55df7d3eaf20 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.399+0000 7ff2d9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 0x55df7d401ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 0x55df7d401ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45882/0 (socket says 172.21.15.137:45882) 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9400640 1 -- 172.21.15.137:0/737001339 learned_addr learned my addr 172.21.15.137:0/737001339 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 0x55df7d3ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 0x55df7d40dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 -- 172.21.15.137:0/737001339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 msgr2=0x55df7d401ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 0x55df7d401ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 -- 172.21.15.137:0/737001339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 msgr2=0x55df7d3ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 0x55df7d3ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d9e00640 1 -- 172.21.15.137:0/737001339 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df7d408b50 con 0x55df7d3f5f10 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.400+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 0x55df7d3ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.401+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 0x55df7d40dd80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc000f80 tx=0x7ff2cc01bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c8f7cb90e81990 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.401+0000 7ff2c5c00640 1 -- 172.21.15.137:0/737001339 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc02a020 con 0x55df7d3f5f10 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.401+0000 7ff2c5c00640 1 -- 172.21.15.137:0/737001339 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc01b930 con 0x55df7d3f5f10 2024-04-25T02:10:57.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.401+0000 7ff2c5c00640 1 -- 172.21.15.137:0/737001339 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011ca0 con 0x55df7d3f5f10 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 -- 172.21.15.137:0/737001339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 msgr2=0x55df7d40dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 0x55df7d40dd80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc000f80 tx=0x7ff2cc01bbd0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 -- 172.21.15.137:0/737001339 shutdown_connections 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3f5f10 0x55df7d40dd80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eb840 0x55df7d3ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 --2- 172.21.15.137:0/737001339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3eaf20 0x55df7d401ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 -- 172.21.15.137:0/737001339 >> 172.21.15.137:0/737001339 conn(0x55df7d3e7240 msgr2=0x55df7d3f47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 -- 172.21.15.137:0/737001339 shutdown_connections 2024-04-25T02:10:57.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.402+0000 7ff2dec51740 1 -- 172.21.15.137:0/737001339 wait complete. 2024-04-25T02:10:57.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.403+0000 7ff2dec51740 1 -- start start 2024-04-25T02:10:57.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.403+0000 7ff2dec51740 1 Processor -- start 2024-04-25T02:10:57.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.403+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3fdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.403+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.403+0000 7ff2dec51740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2dec51740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b1ff0 con 0x55df7d3eaf20 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2dec51740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b3460 con 0x55df7d3eb840 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2dec51740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41b26c0 con 0x55df7d3f5f10 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2dec51740 10 client.0 _ll_register_callbacks cb 0x7ff2c00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52466/0 (socket says 172.21.15.137:52466) 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 -- 172.21.15.137:0/886519932 learned_addr learned my addr 172.21.15.137:0/886519932 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d9400640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d9e00640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 -- 172.21.15.137:0/886519932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 msgr2=0x55df7d3fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 -- 172.21.15.137:0/886519932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 msgr2=0x55df7d3fdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3fdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 -- 172.21.15.137:0/886519932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df7d3fb8e0 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.404+0000 7ff2d8a00640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000efa0 tx=0x7ff2c0003db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f74a3ef27a0644 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2baa00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00b9070 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff2c009b150 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2cc01b930 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff2c0009500 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2dec51740 10 client.25718 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.405+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55df7d46d260 con 0x55df7d3eb840 2024-04-25T02:10:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.406+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2cc01b930 con 0x55df7d3eb840 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.406+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7ff2c0004000 con 0x55df7d3eb840 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 10 client.25718 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 10 client.25718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 20 client.25718 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d46d7a0 0x55df7d46fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 4 client.25718 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55df7d356a20 con 0x55df7d46d7a0 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2d9400640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d46d7a0 0x55df7d46fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2d9400640 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d46d7a0 0x55df7d46fb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6268c32e112484 server_cookie=d4c99330289986a1 in_seq=0 out_seq=0 2024-04-25T02:10:57.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.407+0000 7ff2baa00640 10 client.25718 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2baa00640 1 -- 172.21.15.137:0/886519932 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55df7d356a20 con 0x55df7d46d7a0 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2baa00640 10 client.25718 handle_command_reply: tid=0 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 client.25718 shutdown 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 msgr2=0x55df7d3fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000efa0 tx=0x7ff2c0003db0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 shutdown_connections 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55df7d46d7a0 0x55df7d46fb90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55df7d3f5f10 0x55df7d3fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55df7d3eb840 0x55df7d3fe530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 --2- 172.21.15.137:0/886519932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df7d3eaf20 0x55df7d3fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 >> 172.21.15.137:0/886519932 conn(0x55df7d3e7240 msgr2=0x55df7d3f5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2baa00640 0 client.25718 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 shutdown_connections 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.409+0000 7ff2dec51740 1 -- 172.21.15.137:0/886519932 wait complete. 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.410+0000 7ff2dec51740 20 client.25718 trim_cache size 0 max 16384 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "effcf7c0-1266-448f-8c07-067469e351f4", 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-25T02:10:57.419 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.410+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 msgr2=0x7ff2bc0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.410+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 0x7ff2bc0a53f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005e00 tx=0x7ff2c8005d50 comp rx=0 tx=0).stop 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.410+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 msgr2=0x7ff2d419eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.410+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e910 tx=0x7ff2c000edd0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 shutdown_connections 2024-04-25T02:10:57.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff2bc0a2f30 0x7ff2bc0a53f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2d4105990 0x7ff2d41a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2d4100eb0 0x7ff2d419eb00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 --2- 172.21.15.137:0/3497116599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2d4100590 0x7ff2d419e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 >> 172.21.15.137:0/3497116599 conn(0x7ff2d40fbfc0 msgr2=0x7ff2d40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 shutdown_connections 2024-04-25T02:10:57.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.411+0000 7ff2da800640 1 -- 172.21.15.137:0/3497116599 wait complete. 2024-04-25T02:10:57.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:10:57.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:10:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:57 smithi137 ceph-mon[28303]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 -- 172.21.15.137:0/1931811076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 msgr2=0x7f411410b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 --2- 172.21.15.137:0/1931811076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411410b5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4100009900 tx=0x7f410002a480 comp rx=0 tx=0).stop 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 -- 172.21.15.137:0/1931811076 shutdown_connections 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 --2- 172.21.15.137:0/1931811076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f411410bbc0 0x7f411410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 --2- 172.21.15.137:0/1931811076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411410b5a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 --2- 172.21.15.137:0/1931811076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f41141027a0 0x7f4114102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 -- 172.21.15.137:0/1931811076 >> 172.21.15.137:0/1931811076 conn(0x7f41140fbfc0 msgr2=0x7f41140fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 -- 172.21.15.137:0/1931811076 shutdown_connections 2024-04-25T02:10:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.597+0000 7f411a000640 1 -- 172.21.15.137:0/1931811076 wait complete. 2024-04-25T02:10:57.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.598+0000 7f411a000640 1 Processor -- start 2024-04-25T02:10:57.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.598+0000 7f411a000640 1 -- start start 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.598+0000 7f411a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f411a000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f411a000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 0x7f411419ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f411a000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4114111b30 con 0x7f41141030c0 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f411a000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f41141119b0 con 0x7f411410bbc0 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f411a000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4114111cb0 con 0x7f41141027a0 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f4118c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f4118c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45908/0 (socket says 172.21.15.137:45908) 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f4118c00640 1 -- 172.21.15.137:0/406422624 learned_addr learned my addr 172.21.15.137:0/406422624 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f4119600640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 0x7f411419ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.599+0000 7f4113e00640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 -- 172.21.15.137:0/406422624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 msgr2=0x7f411419ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 0x7f411419ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 -- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 msgr2=0x7f411419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 -- 172.21.15.137:0/406422624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411419f1b0 con 0x7f41141027a0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4119600640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 0x7f411419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4118c00640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f410800e9f0 tx=0x7f410800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4111600640 1 -- 172.21.15.137:0/406422624 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410800cd80 con 0x7f41141027a0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4111600640 1 -- 172.21.15.137:0/406422624 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4108010930 con 0x7f41141027a0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f4111600640 1 -- 172.21.15.137:0/406422624 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108018b00 con 0x7f41141027a0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.600+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411419f4a0 con 0x7f41141027a0 2024-04-25T02:10:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.601+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41141a6d30 con 0x7f41141027a0 2024-04-25T02:10:57.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 Processor -- start 2024-04-25T02:10:57.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 -- start start 2024-04-25T02:10:57.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f4111600640 1 -- 172.21.15.137:0/406422624 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f4108018ca0 con 0x7f41141027a0 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 0x55bccc05c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bccbfb3560 con 0x55bccc04f1e0 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55bccbf5b930 con 0x55bccc04fb00 2024-04-25T02:10:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.605+0000 7f411e3c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bccbfaf520 con 0x55bccc05a1d0 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52484/0 (socket says 172.21.15.137:52484) 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 -- 172.21.15.137:0/1374449372 learned_addr learned my addr 172.21.15.137:0/1374449372 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4119600640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4113e00640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 0x55bccc05c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 -- 172.21.15.137:0/1374449372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 msgr2=0x55bccc05c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 0x55bccc05c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 -- 172.21.15.137:0/1374449372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 msgr2=0x55bccc04f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4118c00640 1 -- 172.21.15.137:0/1374449372 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccbd917d0 con 0x55bccc04fb00 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.606+0000 7f4113e00640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 0x55bccc05c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.607+0000 7f4118c00640 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41080ccf00 tx=0x7f41080d8140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce1dbf76cde7ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.607+0000 7f4105c00640 1 -- 172.21.15.137:0/1374449372 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080e3070 con 0x55bccc04fb00 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.607+0000 7f4105c00640 1 -- 172.21.15.137:0/1374449372 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41080d8d50 con 0x55bccc04fb00 2024-04-25T02:10:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.607+0000 7f4105c00640 1 -- 172.21.15.137:0/1374449372 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080dd7c0 con 0x55bccc04fb00 2024-04-25T02:10:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.607+0000 7f4111600640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 0x7f40fc0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f4111600640 1 -- 172.21.15.137:0/406422624 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f41080cfa50 con 0x7f41141027a0 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 -- 172.21.15.137:0/1374449372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 msgr2=0x55bccc059c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41080ccf00 tx=0x7f41080d8140 comp rx=0 tx=0).stop 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f4119600640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 0x7f40fc0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 -- 172.21.15.137:0/1374449372 shutdown_connections 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc05a1d0 0x55bccc05c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc059c90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 --2- 172.21.15.137:0/1374449372 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.608+0000 7f411e3c4740 1 -- 172.21.15.137:0/1374449372 >> 172.21.15.137:0/1374449372 conn(0x55bccc04b500 msgr2=0x55bccc04b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.609+0000 7f411e3c4740 1 -- 172.21.15.137:0/1374449372 shutdown_connections 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.609+0000 7f411e3c4740 1 -- 172.21.15.137:0/1374449372 wait complete. 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.609+0000 7f4119600640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 0x7f40fc0a53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fd0 tx=0x7f410c009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.609+0000 7f411e3c4740 1 -- start start 2024-04-25T02:10:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 Processor -- start 2024-04-25T02:10:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc0571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc057c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55bccc05cfc0 con 0x55bccc05a1d0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55bccbf6ed90 con 0x55bccc04fb00 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bccc05d140 con 0x55bccc04f1e0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.610+0000 7f411e3c4740 10 client.0 _ll_register_callbacks cb 0x55bccbf6e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52486/0 (socket says 172.21.15.137:52486) 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 -- 172.21.15.137:0/604696662 learned_addr learned my addr 172.21.15.137:0/604696662 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4119600640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc057c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4118c00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc0571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 -- 172.21.15.137:0/604696662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 msgr2=0x55bccc0571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc0571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 -- 172.21.15.137:0/604696662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 msgr2=0x55bccc057c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc057c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 -- 172.21.15.137:0/604696662 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccbcc73f0 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f4113e00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4100009900 tx=0x7f4100004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dedcbbb55fdf980e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.611+0000 7f40fa000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100035040 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41080d8d50 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f4100005230 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4100005430 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f411e3c4740 10 client.25730 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55bccbc870f0 con 0x55bccc04fb00 2024-04-25T02:10:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.612+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f41080d8d50 con 0x55bccc04fb00 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f4100031a40 con 0x55bccc04fb00 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 10 client.25730 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 10 client.25730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 20 client.25730 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc06a530 0x55bccc06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 4 client.25730 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.613+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bccbfc6d90 con 0x55bccc06a530 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.614+0000 7f4118c00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc06a530 0x55bccc06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.614+0000 7f4118c00640 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc06a530 0x55bccc06c980 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e629d5f7f0b25fd server_cookie=591a6056c0edc025 in_seq=0 out_seq=0 2024-04-25T02:10:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.614+0000 7f40fa000640 10 client.25730 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f40fa000640 1 -- 172.21.15.137:0/604696662 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bccbfc6d90 con 0x55bccc06a530 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f40fa000640 10 client.25730 handle_command_reply: tid=0 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 client.25730 shutdown 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 msgr2=0x55bccc057710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4100009900 tx=0x7f4100004270 comp rx=0 tx=0).stop 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 shutdown_connections 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc06a530 0x55bccc06c980 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc057c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc057710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f40fa000640 0 client.25730 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 --2- 172.21.15.137:0/604696662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc0571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.615+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 >> 172.21.15.137:0/604696662 conn(0x55bccc04b500 msgr2=0x55bccc04a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.616+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 shutdown_connections 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.616+0000 7f411e3c4740 1 -- 172.21.15.137:0/604696662 wait complete. 2024-04-25T02:10:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.616+0000 7f411e3c4740 20 client.25730 trim_cache size 0 max 16384 2024-04-25T02:10:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 Processor -- start 2024-04-25T02:10:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 -- start start 2024-04-25T02:10:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc05a1d0 0x55bccc051130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41141b1ec0 con 0x55bccc04f1e0 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f41141af790 con 0x55bccc05a1d0 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.634+0000 7f411e3c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ad5e0 con 0x55bccc04fb00 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4118c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45946/0 (socket says 172.21.15.137:45946) 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 -- 172.21.15.137:0/635400911 learned_addr learned my addr 172.21.15.137:0/635400911 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4119600640 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc05a1d0 0x55bccc051130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 -- 172.21.15.137:0/635400911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc05a1d0 msgr2=0x55bccc051130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc05a1d0 0x55bccc051130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 -- 172.21.15.137:0/635400911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 msgr2=0x55bccc04af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.635+0000 7f4113e00640 1 -- 172.21.15.137:0/635400911 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccc04f930 con 0x55bccc04fb00 2024-04-25T02:10:57.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:57 smithi163 ceph-mon[32577]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.636+0000 7f4113e00640 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4100009850 tx=0x7f4100009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=917ab3055715f0dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.636+0000 7f4105200640 1 -- 172.21.15.137:0/635400911 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100059070 con 0x55bccc04fb00 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.636+0000 7f4105200640 1 -- 172.21.15.137:0/635400911 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4100040070 con 0x55bccc04fb00 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.636+0000 7f4105200640 1 -- 172.21.15.137:0/635400911 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100059070 con 0x55bccc04fb00 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 -- 172.21.15.137:0/635400911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 msgr2=0x55bccc065e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4100009850 tx=0x7f4100009230 comp rx=0 tx=0).stop 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 -- 172.21.15.137:0/635400911 shutdown_connections 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc05a1d0 0x55bccc051130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04fb00 0x55bccc065e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 --2- 172.21.15.137:0/635400911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc04f1e0 0x55bccc04af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 -- 172.21.15.137:0/635400911 >> 172.21.15.137:0/635400911 conn(0x55bccc04b500 msgr2=0x55bccc050a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 -- 172.21.15.137:0/635400911 shutdown_connections 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.637+0000 7f411e3c4740 1 -- 172.21.15.137:0/635400911 wait complete. 2024-04-25T02:10:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.638+0000 7f411e3c4740 1 -- start start 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.638+0000 7f411e3c4740 1 Processor -- start 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.638+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.638+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc05e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f411e3c4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f411e3c4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41141adc50 con 0x55bccc05a1d0 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f411e3c4740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f41141af0c0 con 0x55bccc04fb00 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f411e3c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ae320 con 0x55bccc04f1e0 2024-04-25T02:10:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f411e3c4740 10 client.0 _ll_register_callbacks cb 0x7f4100009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45952/0 (socket says 172.21.15.137:45952) 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 -- 172.21.15.137:0/646706169 learned_addr learned my addr 172.21.15.137:0/646706169 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4113e00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc05e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4119600640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 -- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 msgr2=0x55bccc05e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc05e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 -- 172.21.15.137:0/646706169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 msgr2=0x55bccc05e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc05e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4118c00640 1 -- 172.21.15.137:0/646706169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccc0cfac0 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.639+0000 7f4113e00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc05e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f4118c00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41080def30 tx=0x7f41080deec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4948e3ef7bec5c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f40fa000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41080980b0 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f41080d3640 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4100040070 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f410809b770 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f411e3c4740 10 client.25780 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.640+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55bccc0d0d50 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4100040070 con 0x55bccc04f1e0 2024-04-25T02:10:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f4108098480 con 0x55bccc04f1e0 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 10 client.25780 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 10 client.25780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 20 client.25780 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc0d1030 0x55bccc0d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 4 client.25780 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bccbfc0aa0 con 0x55bccc0d1030 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.641+0000 7f4113e00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc0d1030 0x55bccc0d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f4113e00640 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc0d1030 0x55bccc0d3420 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32622a994c2d93da server_cookie=30a1bbc0d1d7d1d in_seq=0 out_seq=0 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f40fa000640 10 client.25780 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f40fa000640 1 -- 172.21.15.137:0/646706169 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bccbfc0aa0 con 0x55bccc0d1030 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f40fa000640 10 client.25780 handle_command_reply: tid=0 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 client.25780 shutdown 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 msgr2=0x55bccc05dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41080def30 tx=0x7f41080deec0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 shutdown_connections 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55bccc0d1030 0x55bccc0d3420 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55bccc05a1d0 0x55bccc05e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bccc04fb00 0x55bccc05e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 --2- 172.21.15.137:0/646706169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bccc04f1e0 0x55bccc05dd40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 >> 172.21.15.137:0/646706169 conn(0x55bccc04b500 msgr2=0x55bccc051200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.642+0000 7f40fa000640 0 client.25780 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 shutdown_connections 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411e3c4740 1 -- 172.21.15.137:0/646706169 wait complete. 2024-04-25T02:10:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411e3c4740 20 client.25780 trim_cache size 0 max 16384 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "effcf7c0-1266-448f-8c07-067469e351f4": { 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "effcf7c0-1266-448f-8c07-067469e351f4", 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,force" 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:10:57.655 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 msgr2=0x7f40fc0a53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 0x7f40fc0a53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fd0 tx=0x7f410c009500 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 msgr2=0x7f411419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f410800e9f0 tx=0x7f410800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 shutdown_connections 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f40fc0a2f30 0x7f40fc0a53f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f411410bbc0 0x7f411419ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41141030c0 0x7f411419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 --2- 172.21.15.137:0/406422624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41141027a0 0x7f411419a1c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.643+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 >> 172.21.15.137:0/406422624 conn(0x7f41140fbfc0 msgr2=0x7f4114100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.644+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 shutdown_connections 2024-04-25T02:10:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:10:57.644+0000 7f411a000640 1 -- 172.21.15.137:0/406422624 wait complete. 2024-04-25T02:10:57.669 INFO:tasks.cephfs.filesystem:scrub status for tag:effcf7c0-1266-448f-8c07-067469e351f4 - {'path': '/', 'tag': 'effcf7c0-1266-448f-8c07-067469e351f4', 'options': 'recursive,force'} 2024-04-25T02:10:57.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:57 smithi174 ceph-mon[33171]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-25T02:10:58.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:58 smithi137 ceph-mon[28303]: scrub queued for path: / 2024-04-25T02:10:58.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:58 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:58.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:58 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:10:58.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:58 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:58.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:58 smithi163 ceph-mon[32577]: scrub queued for path: / 2024-04-25T02:10:58.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:58 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:58.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:58 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:10:58.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:58 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:58 smithi174 ceph-mon[33171]: scrub queued for path: / 2024-04-25T02:10:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:58 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:58 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:10:58.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:58 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:10:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 -- 172.21.15.137:0/2386714481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84107640 msgr2=0x7f6d84107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 --2- 172.21.15.137:0/2386714481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84107640 0x7f6d84107a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009890 tx=0x7f6d7402a360 comp rx=0 tx=0).stop 2024-04-25T02:10:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 -- 172.21.15.137:0/2386714481 shutdown_connections 2024-04-25T02:10:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 --2- 172.21.15.137:0/2386714481 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84101f40 0x7f6d8410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 --2- 172.21.15.137:0/2386714481 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101580 0x7f6d84101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 --2- 172.21.15.137:0/2386714481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84107640 0x7f6d84107a20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 -- 172.21.15.137:0/2386714481 >> 172.21.15.137:0/2386714481 conn(0x7f6d840fd090 msgr2=0x7f6d840ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 -- 172.21.15.137:0/2386714481 shutdown_connections 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.294+0000 7f6d88a00640 1 -- 172.21.15.137:0/2386714481 wait complete. 2024-04-25T02:10:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.295+0000 7f6d88a00640 1 Processor -- start 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 -- start start 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 0x7f6d8410be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 0x7f6d841aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84075850 con 0x7f6d84107640 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840756d0 con 0x7f6d84101580 2024-04-25T02:10:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d88a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840759d0 con 0x7f6d84101f40 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d83400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d83400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:52510/0 (socket says 172.21.15.137:52510) 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d83400640 1 -- 172.21.15.137:0/4063781804 learned_addr learned my addr 172.21.15.137:0/4063781804 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.296+0000 7f6d83e00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 0x7f6d841aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d82a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 0x7f6d8410be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 -- 172.21.15.137:0/4063781804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 msgr2=0x7f6d8410be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 0x7f6d8410be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 -- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 msgr2=0x7f6d841aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 0x7f6d841aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 -- 172.21.15.137:0/4063781804 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d841aaa60 con 0x7f6d84101580 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d82a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 0x7f6d8410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83e00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 0x7f6d841aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.297+0000 7f6d83400640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d74032470 tx=0x7f6d740324a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.298+0000 7f6d7be00640 1 -- 172.21.15.137:0/4063781804 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74040020 con 0x7f6d84101580 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.298+0000 7f6d7be00640 1 -- 172.21.15.137:0/4063781804 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d74038040 con 0x7f6d84101580 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.298+0000 7f6d7be00640 1 -- 172.21.15.137:0/4063781804 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74037070 con 0x7f6d84101580 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.298+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d841aac30 con 0x7f6d84101580 2024-04-25T02:10:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.299+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d841aafe0 con 0x7f6d84101580 2024-04-25T02:10:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 Processor -- start 2024-04-25T02:10:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 -- start start 2024-04-25T02:10:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d7be00640 1 -- 172.21.15.137:0/4063781804 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f6d74043020 con 0x7f6d84101580 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa25390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa2fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55849f988ab0 con 0x55849fa24fb0 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55849f931640 con 0x55849fa258d0 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.303+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55849f984a70 con 0x55849fa30190 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d83400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa2fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:45990/0 (socket says 172.21.15.137:45990) 2024-04-25T02:10:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 -- 172.21.15.137:0/2705062665 learned_addr learned my addr 172.21.15.137:0/2705062665 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d83e00640 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa25390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 -- 172.21.15.137:0/2705062665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 msgr2=0x55849fa2fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa2fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 -- 172.21.15.137:0/2705062665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 msgr2=0x55849fa25390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa25390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.304+0000 7f6d82a00640 1 -- 172.21.15.137:0/2705062665 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849f69d210 con 0x55849fa30190 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009ce0 tx=0x7f6d700117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad6c05566811f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d6fe00640 1 -- 172.21.15.137:0/2705062665 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70012450 con 0x55849fa30190 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d7be00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 0x7f6d680a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d6fe00640 1 -- 172.21.15.137:0/2705062665 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d70012af0 con 0x55849fa30190 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d6fe00640 1 -- 172.21.15.137:0/2705062665 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000fd20 con 0x55849fa30190 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d7be00640 1 -- 172.21.15.137:0/4063781804 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f6d740eee40 con 0x7f6d84101580 2024-04-25T02:10:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.305+0000 7f6d83e00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 0x7f6d680a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2705062665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 msgr2=0x55849fa32580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009ce0 tx=0x7f6d700117b0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d83e00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 0x7f6d680a5360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c005fd0 tx=0x7f6d7c010040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2705062665 shutdown_connections 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa32580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa2fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2705062665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa25390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2705062665 >> 172.21.15.137:0/2705062665 conn(0x55849fa214c0 msgr2=0x55849fa218a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2705062665 shutdown_connections 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.306+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2705062665 wait complete. 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.307+0000 7f6d8cdfd740 1 -- start start 2024-04-25T02:10:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.307+0000 7f6d8cdfd740 1 Processor -- start 2024-04-25T02:10:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 0x55849fa2d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa30190 0x55849fa2da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55849fa32dc0 con 0x55849fa258d0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55849f944990 con 0x55849fa30190 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55849fa32f40 con 0x55849fa24fb0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d8cdfd740 10 client.0 _ll_register_callbacks cb 0x55849f946950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d83e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa30190 0x55849fa2da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d83400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d82a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 0x55849fa2d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d83400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:46004/0 (socket says 172.21.15.137:46004) 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.308+0000 7f6d83400640 1 -- 172.21.15.137:0/2648752905 learned_addr learned my addr 172.21.15.137:0/2648752905 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 -- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa30190 msgr2=0x55849fa2da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa30190 0x55849fa2da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 -- 172.21.15.137:0/2648752905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 msgr2=0x55849fa2d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 0x55849fa2d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 -- 172.21.15.137:0/2648752905 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849f769620 con 0x55849fa24fb0 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 0x55849fa2d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d83400640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d740baf60 tx=0x7f6d74032840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6805a7ec769242cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d740bada0 con 0x55849fa24fb0 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.309+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f6d740bf190 con 0x55849fa24fb0 2024-04-25T02:10:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d70012af0 con 0x55849fa24fb0 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6d740babc0 con 0x55849fa24fb0 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d8cdfd740 10 client.25792 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55849fa32e20 con 0x55849fa24fb0 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d70012af0 con 0x55849fa24fb0 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f6d740c3a40 con 0x55849fa24fb0 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.310+0000 7f6d8cdfd740 10 client.25792 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d8cdfd740 10 client.25792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d8cdfd740 20 client.25792 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849fa400d0 0x55849fa42500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d8cdfd740 4 client.25792 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:10:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55849f995ff0 con 0x55849fa400d0 2024-04-25T02:10:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.311+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849fa400d0 0x55849fa42500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.312+0000 7f6d82a00640 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849fa400d0 0x55849fa42500 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fd7fbe29a77ae1 server_cookie=a43f9a1f06431fa1 in_seq=0 out_seq=0 2024-04-25T02:10:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.312+0000 7f6d6cc00640 10 client.25792 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.312+0000 7f6d6cc00640 1 -- 172.21.15.137:0/2648752905 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55849f995ff0 con 0x55849fa400d0 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.312+0000 7f6d6cc00640 10 client.25792 handle_command_reply: tid=0 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.312+0000 7f6d8cdfd740 1 client.25792 shutdown 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 msgr2=0x55849fa2cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d740baf60 tx=0x7f6d74032840 comp rx=0 tx=0).stop 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 shutdown_connections 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849fa400d0 0x55849fa42500 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa30190 0x55849fa2da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa258d0 0x55849fa2d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/2648752905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa24fb0 0x55849fa2cfe0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 >> 172.21.15.137:0/2648752905 conn(0x55849fa214c0 msgr2=0x55849fa27240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d6cc00640 0 client.25792 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 shutdown_connections 2024-04-25T02:10:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/2648752905 wait complete. 2024-04-25T02:10:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.313+0000 7f6d8cdfd740 20 client.25792 trim_cache size 0 max 16384 2024-04-25T02:10:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 Processor -- start 2024-04-25T02:10:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 -- start start 2024-04-25T02:10:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 0x55849fa279c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 0x55849fa47db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b6240 con 0x55849fa30190 2024-04-25T02:10:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b3b10 con 0x55849fa24fb0 2024-04-25T02:10:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.329+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b1960 con 0x55849fa258d0 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d83e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 0x55849fa47db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d83e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 0x55849fa47db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33334/0 (socket says 172.21.15.137:33334) 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:46020/0 (socket says 172.21.15.137:46020) 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d83e00640 1 -- 172.21.15.137:0/1543554203 learned_addr learned my addr 172.21.15.137:0/1543554203 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d83400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 0x55849fa279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 -- 172.21.15.137:0/1543554203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 msgr2=0x55849fa279c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 0x55849fa279c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 -- 172.21.15.137:0/1543554203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 msgr2=0x55849fa47db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 0x55849fa47db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d82a00640 1 -- 172.21.15.137:0/1543554203 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55849fa25700 con 0x55849fa258d0 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.330+0000 7f6d83400640 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 0x55849fa279c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.331+0000 7f6d82a00640 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6d70011cb0 tx=0x7f6d700058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7e294b979bebed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.331+0000 7f6d6f400640 1 -- 172.21.15.137:0/1543554203 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70009590 con 0x55849fa258d0 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.331+0000 7f6d6f400640 1 -- 172.21.15.137:0/1543554203 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d70005540 con 0x55849fa258d0 2024-04-25T02:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.331+0000 7f6d6f400640 1 -- 172.21.15.137:0/1543554203 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700048c0 con 0x55849fa258d0 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/1543554203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 msgr2=0x55849fa283d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6d70011cb0 tx=0x7f6d700058e0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/1543554203 shutdown_connections 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa30190 0x55849fa47db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa258d0 0x55849fa283d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/1543554203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa24fb0 0x55849fa279c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/1543554203 >> 172.21.15.137:0/1543554203 conn(0x55849fa214c0 msgr2=0x55849fa20620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/1543554203 shutdown_connections 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/1543554203 wait complete. 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 -- start start 2024-04-25T02:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.332+0000 7f6d8cdfd740 1 Processor -- start 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa33830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa33d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b1fd0 con 0x55849fa24fb0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b3440 con 0x55849fa258d0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841b26a0 con 0x55849fa30190 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d8cdfd740 10 client.0 _ll_register_callbacks cb 0x7f6d74005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d83400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d83400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33344/0 (socket says 172.21.15.137:33344) 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d83400640 1 -- 172.21.15.137:0/3326952310 learned_addr learned my addr 172.21.15.137:0/3326952310 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.333+0000 7f6d82a00640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa33830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83e00640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa33d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 -- 172.21.15.137:0/3326952310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 msgr2=0x55849fa33d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa33d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 -- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 msgr2=0x55849fa33830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa33830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 -- 172.21.15.137:0/3326952310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55849fa344b0 con 0x55849fa24fb0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d83400640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d7402a950 tx=0x7f6d74005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48025254010ba46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.334+0000 7f6d6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d740d3070 con 0x55849fa24fb0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f6d740f25a0 con 0x55849fa24fb0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d70005540 con 0x55849fa24fb0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6d740bada0 con 0x55849fa24fb0 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d8cdfd740 10 client.15681 fetch_fsmap learned FSMap version 23 2024-04-25T02:10:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55849faa6560 con 0x55849fa24fb0 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d7409d080 con 0x55849fa24fb0 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f6d740ba6b0 con 0x55849fa24fb0 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d8cdfd740 10 client.15681 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.335+0000 7f6d8cdfd740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d8cdfd740 20 client.15681 populate_metadata read hostname 'smithi137' 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849faa6a40 0x55849faa8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d8cdfd740 4 client.15681 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55849f990340 con 0x55849faa6a40 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d82a00640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849faa6a40 0x55849faa8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d82a00640 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849faa6a40 0x55849faa8e30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbea8f5b992cf6aa server_cookie=c0998ffa4113e250 in_seq=0 out_seq=0 2024-04-25T02:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.336+0000 7f6d6cc00640 10 client.15681 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.342+0000 7f6d6cc00640 1 -- 172.21.15.137:0/3326952310 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55849f990340 con 0x55849faa6a40 2024-04-25T02:10:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.342+0000 7f6d6cc00640 10 client.15681 handle_command_reply: tid=0 2024-04-25T02:10:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.342+0000 7f6d8cdfd740 1 client.15681 shutdown 2024-04-25T02:10:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 msgr2=0x55849fa38470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d7402a950 tx=0x7f6d74005f90 comp rx=0 tx=0).stop 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 shutdown_connections 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55849faa6a40 0x55849faa8e30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55849fa30190 0x55849fa33d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55849fa258d0 0x55849fa33830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d6cc00640 0 client.15681 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 --2- 172.21.15.137:0/3326952310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55849fa24fb0 0x55849fa38470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 >> 172.21.15.137:0/3326952310 conn(0x55849fa214c0 msgr2=0x55849fa2e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 shutdown_connections 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 1 -- 172.21.15.137:0/3326952310 wait complete. 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.343+0000 7f6d8cdfd740 20 client.15681 trim_cache size 0 max 16384 2024-04-25T02:10:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 msgr2=0x7f6d680a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 0x7f6d680a5360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c005fd0 tx=0x7f6d7c010040 comp rx=0 tx=0).stop 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 msgr2=0x7f6d8410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d74032470 tx=0x7f6d740324a0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 shutdown_connections 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f6d680a2ea0 0x7f6d680a5360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d84107640 0x7f6d841aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6d84101f40 0x7f6d8410be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 --2- 172.21.15.137:0/4063781804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d84101580 0x7f6d8410b8f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:10:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 >> 172.21.15.137:0/4063781804 conn(0x7f6d840fd090 msgr2=0x7f6d840fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:10:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 shutdown_connections 2024-04-25T02:10:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:10:59.344+0000 7f6d88a00640 1 -- 172.21.15.137:0/4063781804 wait complete. 2024-04-25T02:10:59.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:10:59 smithi137 ceph-mon[28303]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T02:10:59.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:10:59 smithi163 ceph-mon[32577]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T02:10:59.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:10:59 smithi174 ceph-mon[33171]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-25T02:11:01.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:01 smithi137 ceph-mon[28303]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-04-25T02:11:01.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:01 smithi163 ceph-mon[32577]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-04-25T02:11:01.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:01 smithi174 ceph-mon[33171]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-04-25T02:11:02.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:02 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:11:02.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:02 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:11:02.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:02 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:11:03.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:03 smithi137 ceph-mon[28303]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T02:11:03.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:03 smithi163 ceph-mon[32577]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T02:11:03.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:03 smithi174 ceph-mon[33171]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-25T02:11:05.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:05 smithi137 ceph-mon[28303]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T02:11:05.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:05 smithi163 ceph-mon[32577]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T02:11:05.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:05 smithi174 ceph-mon[33171]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-25T02:11:07.534 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:07 smithi137 ceph-mon[28303]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-25T02:11:07.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:07 smithi163 ceph-mon[32577]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-25T02:11:07.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:07 smithi174 ceph-mon[33171]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-04-25T02:11:09.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:09 smithi163 ceph-mon[32577]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T02:11:09.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:09 smithi174 ceph-mon[33171]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T02:11:09.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:09 smithi137 ceph-mon[28303]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-25T02:11:10.017 INFO:tasks.workunit.client.0.smithi137.stderr:Updating files: 63% (7988/12492) Updating files: 64% (7995/12492) Updating files: 65% (8120/12492) Updating files: 66% (8245/12492) Updating files: 67% (8370/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 70% (8745/12492) Updating files: 71% (8870/12492) Updating files: 72% (8995/12492) Updating files: 73% (9120/12492) Updating files: 74% (9245/12492) Updating files: 75% (9369/12492) Updating files: 76% (9494/12492) Updating files: 77% (9619/12492) Updating files: 78% (9744/12492) Updating files: 79% (9869/12492) Updating files: 80% (9994/12492) Updating files: 81% (10119/12492) Updating files: 82% (10244/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 85% (10619/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 88% (10993/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T02:11:10.354 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-04-25T02:11:10.355 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T02:11:10.362 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T02:11:10.465 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T02:11:10.474 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:11:10.474 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T02:11:11.425 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T02:11:11.540 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T02:11:11.627 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:11:11.633 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:11:11.633 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T02:11:11.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:11 smithi163 ceph-mon[32577]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-04-25T02:11:11.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:11 smithi174 ceph-mon[33171]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-04-25T02:11:11.714 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:11:11.724 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:11:11.724 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T02:11:11.773 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-04-25T02:11:11.774 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-04-25T02:11:11.774 DEBUG:teuthology.orchestra.run.smithi137:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-04-25T02:11:11.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:11 smithi137 ceph-mon[28303]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-04-25T02:11:11.856 INFO:tasks.workunit.client.0.smithi137.stderr:+ KERNEL=linux-4.0.5 2024-04-25T02:11:11.856 INFO:tasks.workunit.client.0.smithi137.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-04-25T02:11:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 -- 172.21.15.137:0/3619007208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c1125e0 msgr2=0x7f0c0c1149d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 --2- 172.21.15.137:0/3619007208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1149d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009ca0 tx=0x7f0c0402a8b0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 -- 172.21.15.137:0/3619007208 shutdown_connections 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 --2- 172.21.15.137:0/3619007208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1149d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 --2- 172.21.15.137:0/3619007208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c076590 0x7f0c0c1120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 --2- 172.21.15.137:0/3619007208 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c075c70 0x7f0c0c076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 -- 172.21.15.137:0/3619007208 >> 172.21.15.137:0/3619007208 conn(0x7f0c0c0ff470 msgr2=0x7f0c0c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 -- 172.21.15.137:0/3619007208 shutdown_connections 2024-04-25T02:11:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.485+0000 7f0c13600640 1 -- 172.21.15.137:0/3619007208 wait complete. 2024-04-25T02:11:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.486+0000 7f0c13600640 1 Processor -- start 2024-04-25T02:11:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.486+0000 7f0c13600640 1 -- start start 2024-04-25T02:11:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.486+0000 7f0c13600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.486+0000 7f0c13600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c076590 0x7f0c0c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c13600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c13600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1182b0 con 0x7f0c0c075c70 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c13600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c118130 con 0x7f0c0c076590 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c13600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c118430 con 0x7f0c0c1125e0 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60974/0 (socket says 172.21.15.137:60974) 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 -- 172.21.15.137:0/3016283261 learned_addr learned my addr 172.21.15.137:0/3016283261 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c03e00640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c076590 0x7f0c0c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c11600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 -- 172.21.15.137:0/3016283261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 msgr2=0x7f0c0c1a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 -- 172.21.15.137:0/3016283261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c076590 msgr2=0x7f0c0c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c076590 0x7f0c0c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c10c00640 1 -- 172.21.15.137:0/3016283261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0c1a3660 con 0x7f0c0c075c70 2024-04-25T02:11:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.487+0000 7f0c11600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c10c00640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00e9f0 tx=0x7f0bfc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c0a000640 1 -- 172.21.15.137:0/3016283261 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00cd80 con 0x7f0c0c075c70 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c0a000640 1 -- 172.21.15.137:0/3016283261 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0bfc010930 con 0x7f0c0c075c70 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0c1a3950 con 0x7f0c0c075c70 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c0a000640 1 -- 172.21.15.137:0/3016283261 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc018b00 con 0x7f0c0c075c70 2024-04-25T02:11:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.488+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0c1ab1e0 con 0x7f0c0c075c70 2024-04-25T02:11:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.491+0000 7f0c0a000640 1 -- 172.21.15.137:0/3016283261 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 25) ==== 138118+0+0 (secure 0 0 0) 0x7f0bfc018ca0 con 0x7f0c0c075c70 2024-04-25T02:11:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.491+0000 7f0c165a9740 1 Processor -- start 2024-04-25T02:11:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.491+0000 7f0c165a9740 1 -- start start 2024-04-25T02:11:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f920aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56195f879ab0 con 0x56195f916720 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56195f822640 con 0x56195f920fe0 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c165a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56195f875a70 con 0x56195f915e00 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c10c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f920aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c11600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:35374/0 (socket says 172.21.15.137:35374) 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 -- 172.21.15.137:0/1565880327 learned_addr learned my addr 172.21.15.137:0/1565880327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 -- 172.21.15.137:0/1565880327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 msgr2=0x56195f9161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 -- 172.21.15.137:0/1565880327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 msgr2=0x56195f920aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.492+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f920aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c03e00640 1 -- 172.21.15.137:0/1565880327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195f58e210 con 0x56195f920fe0 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c11600640 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009c20 tx=0x7f0bf4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d03f67b4a4f37a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c0a000640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 0x7f0bf00a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c01c00640 1 -- 172.21.15.137:0/1565880327 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4004230 con 0x56195f920fe0 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c01c00640 1 -- 172.21.15.137:0/1565880327 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0bf40043d0 con 0x56195f920fe0 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c0a000640 1 -- 172.21.15.137:0/3016283261 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0bfc0cfb30 con 0x7f0c0c075c70 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c01c00640 1 -- 172.21.15.137:0/1565880327 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4004db0 con 0x56195f920fe0 2024-04-25T02:11:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.493+0000 7f0c11600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 0x7f0bf00a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 -- 172.21.15.137:0/1565880327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 msgr2=0x56195f9233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c11600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 0x7f0bf00a5410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0c04004af0 tx=0x7f0c04004a40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009c20 tx=0x7f0bf4011810 comp rx=0 tx=0).stop 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 -- 172.21.15.137:0/1565880327 shutdown_connections 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f9233d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f920aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1565880327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 -- 172.21.15.137:0/1565880327 >> 172.21.15.137:0/1565880327 conn(0x56195f912310 msgr2=0x56195f9126f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 -- 172.21.15.137:0/1565880327 shutdown_connections 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.494+0000 7f0c165a9740 1 -- 172.21.15.137:0/1565880327 wait complete. 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.495+0000 7f0c165a9740 1 -- start start 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.495+0000 7f0c165a9740 1 Processor -- start 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f91df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f91e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f91e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56195f923c10 con 0x56195f916720 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56195f835990 con 0x56195f920fe0 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56195f923d90 con 0x56195f915e00 2024-04-25T02:11:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c165a9740 10 client.0 _ll_register_callbacks cb 0x56195f837950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c03e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f91e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f91e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c03e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f91e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60988/0 (socket says 172.21.15.137:60988) 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c03e00640 1 -- 172.21.15.137:0/579859211 learned_addr learned my addr 172.21.15.137:0/579859211 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c10c00640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f91df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 -- 172.21.15.137:0/579859211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 msgr2=0x56195f91df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f91df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 -- 172.21.15.137:0/579859211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 msgr2=0x56195f91e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f91e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c11600640 1 -- 172.21.15.137:0/579859211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195f65a620 con 0x56195f920fe0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.496+0000 7f0c10c00640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f91df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0c11600640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f91e9b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c0402add0 tx=0x7f0c0402a8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31b39ee7c83d5d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0bfa000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04030970 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bf40043d0 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0c04030b10 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0c04030d50 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0c165a9740 10 client.25766 fetch_fsmap learned FSMap version 23 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56195f92fae0 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.497+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0bf40043d0 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0c04051070 con 0x56195f920fe0 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 10 client.25766 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 10 client.25766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 20 client.25766 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f930f50 0x56195f933380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 4 client.25766 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56195f886ff0 con 0x56195f930f50 2024-04-25T02:11:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c10c00640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f930f50 0x56195f933380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0c10c00640 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f930f50 0x56195f933380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d4b6546acd6b16 server_cookie=fbaeec7b4396df4 in_seq=0 out_seq=0 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.498+0000 7f0bfa000640 10 client.25766 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.499+0000 7f0bfa000640 1 -- 172.21.15.137:0/579859211 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56195f886ff0 con 0x56195f930f50 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.499+0000 7f0bfa000640 10 client.25766 handle_command_reply: tid=0 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.499+0000 7f0c165a9740 1 client.25766 shutdown 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 msgr2=0x56195f91e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f91e9b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c0402add0 tx=0x7f0c0402a8b0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 shutdown_connections 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f930f50 0x56195f933380 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f91e9b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f91e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 --2- 172.21.15.137:0/579859211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f91df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0bfa000640 0 client.25766 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 >> 172.21.15.137:0/579859211 conn(0x56195f912310 msgr2=0x56195f918090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 shutdown_connections 2024-04-25T02:11:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 1 -- 172.21.15.137:0/579859211 wait complete. 2024-04-25T02:11:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.500+0000 7f0c165a9740 20 client.25766 trim_cache size 0 max 16384 2024-04-25T02:11:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 Processor -- start 2024-04-25T02:11:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 -- start start 2024-04-25T02:11:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f911c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b6370 con 0x56195f916720 2024-04-25T02:11:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b3c40 con 0x56195f920fe0 2024-04-25T02:11:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.522+0000 7f0c165a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b1a90 con 0x56195f915e00 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:35386/0 (socket says 172.21.15.137:35386) 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 -- 172.21.15.137:0/953916774 learned_addr learned my addr 172.21.15.137:0/953916774 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c03e00640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f911c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c10c00640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 -- 172.21.15.137:0/953916774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 msgr2=0x56195f9187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9187c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 -- 172.21.15.137:0/953916774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 msgr2=0x56195f911c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f911c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 -- 172.21.15.137:0/953916774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195f912140 con 0x56195f920fe0 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c10c00640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.523+0000 7f0c11600640 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c04030910 tx=0x7f0c040095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49fe8427a133bc6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.524+0000 7f0c01200640 1 -- 172.21.15.137:0/953916774 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04060020 con 0x56195f920fe0 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.524+0000 7f0c01200640 1 -- 172.21.15.137:0/953916774 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c04036040 con 0x56195f920fe0 2024-04-25T02:11:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.524+0000 7f0c01200640 1 -- 172.21.15.137:0/953916774 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040309b0 con 0x56195f920fe0 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.524+0000 7f0c165a9740 1 -- 172.21.15.137:0/953916774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 msgr2=0x56195f938c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.524+0000 7f0c165a9740 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c04030910 tx=0x7f0c040095a0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 -- 172.21.15.137:0/953916774 shutdown_connections 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f920fe0 0x56195f938c90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f916720 0x56195f911c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 --2- 172.21.15.137:0/953916774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f915e00 0x56195f9187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 -- 172.21.15.137:0/953916774 >> 172.21.15.137:0/953916774 conn(0x56195f912310 msgr2=0x56195f91e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 -- 172.21.15.137:0/953916774 shutdown_connections 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 -- 172.21.15.137:0/953916774 wait complete. 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 -- start start 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.525+0000 7f0c165a9740 1 Processor -- start 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f916720 0x56195f924ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f920fe0 0x56195f9253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b2100 con 0x56195f920fe0 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b3570 con 0x56195f915e00 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1b27d0 con 0x56195f916720 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c165a9740 10 client.0 _ll_register_callbacks cb 0x7f0bf4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c11600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f920fe0 0x56195f9253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c10c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c10c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:35400/0 (socket says 172.21.15.137:35400) 2024-04-25T02:11:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c10c00640 1 -- 172.21.15.137:0/1261625362 learned_addr learned my addr 172.21.15.137:0/1261625362 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.526+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f916720 0x56195f924ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 -- 172.21.15.137:0/1261625362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f916720 msgr2=0x56195f924ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f916720 0x56195f924ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 -- 172.21.15.137:0/1261625362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f920fe0 msgr2=0x56195f9253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f920fe0 0x56195f9253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 -- 172.21.15.137:0/1261625362 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195f996500 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c10c00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc09bb40 tx=0x7f0bfc005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3a5a783b2c3b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0bfa000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc09e070 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f0bfc010ae0 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c04036040 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0bfc0b8030 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c165a9740 10 client.25772 fetch_fsmap learned FSMap version 23 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.527+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56195f997750 con 0x56195f915e00 2024-04-25T02:11:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c04036040 con 0x56195f915e00 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0bfc09b290 con 0x56195f915e00 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 10 client.25772 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 20 client.25772 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f997dd0 0x56195f99a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 4 client.25772 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56195f881340 con 0x56195f997dd0 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.528+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f997dd0 0x56195f99a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.529+0000 7f0c03e00640 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f997dd0 0x56195f99a1f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2582363c7966951 server_cookie=2abd8d1bda00cd3c in_seq=0 out_seq=0 2024-04-25T02:11:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.529+0000 7f0bfa000640 10 client.25772 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0bfa000640 1 -- 172.21.15.137:0/1261625362 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56195f881340 con 0x56195f997dd0 2024-04-25T02:11:12.545 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0bfa000640 10 client.25772 handle_command_reply: tid=0 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 client.25772 shutdown 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 msgr2=0x56195f924960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc09bb40 tx=0x7f0bfc005f10 comp rx=0 tx=0).stop 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 shutdown_connections 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56195f997dd0 0x56195f99a1f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56195f920fe0 0x56195f9253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56195f916720 0x56195f924ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 --2- 172.21.15.137:0/1261625362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56195f915e00 0x56195f924960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0bfa000640 0 client.25772 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 >> 172.21.15.137:0/1261625362 conn(0x56195f912310 msgr2=0x56195f91f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 shutdown_connections 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.538+0000 7f0c165a9740 1 -- 172.21.15.137:0/1261625362 wait complete. 2024-04-25T02:11:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c165a9740 20 client.25772 trim_cache size 0 max 16384 2024-04-25T02:11:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:11:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:11:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:11:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 msgr2=0x7f0bf00a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 0x7f0bf00a5410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0c04004af0 tx=0x7f0c04004a40 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 msgr2=0x7f0c0c19e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00e9f0 tx=0x7f0bfc00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 shutdown_connections 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f0bf00a2f50 0x7f0bf00a5410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c0c1125e0 0x7f0c0c1a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c0c076590 0x7f0c0c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 --2- 172.21.15.137:0/3016283261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c0c075c70 0x7f0c0c19e670 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.539+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 >> 172.21.15.137:0/3016283261 conn(0x7f0c0c0ff470 msgr2=0x7f0c0c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.540+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 shutdown_connections 2024-04-25T02:11:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:12.540+0000 7f0c13600640 1 -- 172.21.15.137:0/3016283261 wait complete. 2024-04-25T02:11:13.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:13 smithi163 ceph-mon[32577]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:11:13.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:13 smithi174 ceph-mon[33171]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:11:13.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:13 smithi137 ceph-mon[28303]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:11:15.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:15 smithi163 ceph-mon[32577]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 27 op/s 2024-04-25T02:11:15.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:15 smithi163 ceph-mon[32577]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-25T02:11:15.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:15 smithi174 ceph-mon[33171]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 27 op/s 2024-04-25T02:11:15.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:15 smithi174 ceph-mon[33171]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-25T02:11:15.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:15 smithi137 ceph-mon[28303]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 27 op/s 2024-04-25T02:11:15.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:15 smithi137 ceph-mon[28303]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-25T02:11:17.638 INFO:tasks.workunit.client.0.smithi137.stderr:+ mkdir untar_tar 2024-04-25T02:11:17.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:17 smithi163 ceph-mon[32577]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-04-25T02:11:17.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ cd untar_tar 2024-04-25T02:11:17.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-04-25T02:11:17.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ 2024-04-25T02:11:17.673 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/00-INDEX 2024-04-25T02:11:17.675 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/ 2024-04-25T02:11:17.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/README 2024-04-25T02:11:17.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:17 smithi174 ceph-mon[33171]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-04-25T02:11:17.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-04-25T02:11:17.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-04-25T02:11:17.680 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-04-25T02:11:17.682 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-04-25T02:11:17.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-04-25T02:11:17.685 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-04-25T02:11:17.686 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-04-25T02:11:17.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-04-25T02:11:17.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-04-25T02:11:17.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-04-25T02:11:17.692 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-04-25T02:11:17.693 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-04-25T02:11:17.695 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-04-25T02:11:17.697 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-04-25T02:11:17.698 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-04-25T02:11:17.700 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-04-25T02:11:17.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-04-25T02:11:17.703 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-04-25T02:11:17.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-04-25T02:11:17.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-04-25T02:11:17.708 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-04-25T02:11:17.710 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-04-25T02:11:17.712 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-04-25T02:11:17.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-04-25T02:11:17.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-04-25T02:11:17.717 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-04-25T02:11:17.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-04-25T02:11:17.720 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-04-25T02:11:17.721 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-04-25T02:11:17.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-04-25T02:11:17.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-04-25T02:11:17.727 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-04-25T02:11:17.729 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-04-25T02:11:17.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-04-25T02:11:17.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-04-25T02:11:17.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-04-25T02:11:17.735 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-04-25T02:11:17.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-04-25T02:11:17.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-04-25T02:11:17.740 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-04-25T02:11:17.742 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-04-25T02:11:17.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-04-25T02:11:17.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-04-25T02:11:17.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-04-25T02:11:17.748 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-04-25T02:11:17.750 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-04-25T02:11:17.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-04-25T02:11:17.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-04-25T02:11:17.755 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-04-25T02:11:17.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-04-25T02:11:17.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-04-25T02:11:17.761 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-04-25T02:11:17.762 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-04-25T02:11:17.764 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-04-25T02:11:17.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-04-25T02:11:17.767 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-04-25T02:11:17.769 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-04-25T02:11:17.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-04-25T02:11:17.772 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-04-25T02:11:17.773 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-04-25T02:11:17.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-04-25T02:11:17.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-04-25T02:11:17.778 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-04-25T02:11:17.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:17 smithi137 ceph-mon[28303]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.9 KiB/s wr, 9 op/s 2024-04-25T02:11:17.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-04-25T02:11:17.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-04-25T02:11:17.788 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-04-25T02:11:17.790 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-04-25T02:11:17.791 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-04-25T02:11:17.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-04-25T02:11:17.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-04-25T02:11:17.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-04-25T02:11:17.798 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-04-25T02:11:17.800 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-04-25T02:11:17.802 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-04-25T02:11:17.804 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-04-25T02:11:17.805 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-04-25T02:11:17.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-04-25T02:11:17.809 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-04-25T02:11:17.811 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-04-25T02:11:17.813 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-04-25T02:11:17.814 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-04-25T02:11:17.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-04-25T02:11:17.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-04-25T02:11:17.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-04-25T02:11:17.821 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-04-25T02:11:17.823 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-04-25T02:11:17.825 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-04-25T02:11:17.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-04-25T02:11:17.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-04-25T02:11:17.830 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-04-25T02:11:17.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-04-25T02:11:17.833 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-04-25T02:11:17.835 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-04-25T02:11:17.836 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-04-25T02:11:17.838 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-04-25T02:11:17.840 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-04-25T02:11:17.841 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-04-25T02:11:17.843 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-04-25T02:11:17.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-04-25T02:11:17.846 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-04-25T02:11:17.848 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-04-25T02:11:17.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-04-25T02:11:17.851 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-04-25T02:11:17.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-04-25T02:11:17.854 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-04-25T02:11:17.856 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-04-25T02:11:17.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-04-25T02:11:17.859 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-04-25T02:11:17.861 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-04-25T02:11:17.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-04-25T02:11:17.864 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-04-25T02:11:17.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-04-25T02:11:17.868 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-04-25T02:11:17.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-04-25T02:11:17.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-04-25T02:11:17.873 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-04-25T02:11:17.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-04-25T02:11:17.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-04-25T02:11:17.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-04-25T02:11:17.879 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-04-25T02:11:17.881 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-04-25T02:11:17.882 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-04-25T02:11:17.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-04-25T02:11:17.885 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-04-25T02:11:17.887 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-04-25T02:11:17.888 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-04-25T02:11:17.890 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-04-25T02:11:17.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-04-25T02:11:17.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-04-25T02:11:17.895 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-04-25T02:11:17.897 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-04-25T02:11:17.898 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-04-25T02:11:17.900 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-04-25T02:11:17.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-04-25T02:11:17.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-04-25T02:11:17.905 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-04-25T02:11:17.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-04-25T02:11:17.908 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-04-25T02:11:17.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-04-25T02:11:17.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-04-25T02:11:17.913 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-04-25T02:11:17.915 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-04-25T02:11:17.916 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-04-25T02:11:17.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-04-25T02:11:17.919 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-04-25T02:11:17.921 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-04-25T02:11:17.923 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-04-25T02:11:17.924 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-04-25T02:11:17.926 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-04-25T02:11:17.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-04-25T02:11:17.929 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-04-25T02:11:17.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-04-25T02:11:17.933 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-04-25T02:11:17.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-04-25T02:11:17.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-04-25T02:11:17.938 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-04-25T02:11:17.939 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-04-25T02:11:17.941 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-04-25T02:11:17.943 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-04-25T02:11:17.944 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-04-25T02:11:17.946 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-04-25T02:11:17.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-04-25T02:11:17.949 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-04-25T02:11:17.951 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-04-25T02:11:17.952 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-04-25T02:11:17.954 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-04-25T02:11:17.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-04-25T02:11:17.957 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-04-25T02:11:17.959 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-04-25T02:11:17.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-04-25T02:11:17.962 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-04-25T02:11:17.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-04-25T02:11:17.965 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-04-25T02:11:17.967 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-04-25T02:11:17.968 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-04-25T02:11:17.970 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-04-25T02:11:17.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-04-25T02:11:17.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-04-25T02:11:17.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-04-25T02:11:17.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-04-25T02:11:17.978 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-04-25T02:11:17.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-04-25T02:11:17.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-04-25T02:11:17.983 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-04-25T02:11:17.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-04-25T02:11:17.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-04-25T02:11:17.988 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-04-25T02:11:17.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-04-25T02:11:17.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-04-25T02:11:17.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-04-25T02:11:17.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-04-25T02:11:17.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-04-25T02:11:17.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-04-25T02:11:17.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-04-25T02:11:18.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-04-25T02:11:19.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:19 smithi163 ceph-mon[32577]: pgmap v51: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-25T02:11:19.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:19 smithi174 ceph-mon[33171]: pgmap v51: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-25T02:11:19.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:19 smithi137 ceph-mon[28303]: pgmap v51: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 MiB/s wr, 13 op/s 2024-04-25T02:11:21.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:21 smithi163 ceph-mon[32577]: pgmap v52: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:21.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:21 smithi174 ceph-mon[33171]: pgmap v52: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:21.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:21 smithi137 ceph-mon[28303]: pgmap v52: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:21.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-04-25T02:11:21.941 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-04-25T02:11:21.943 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-04-25T02:11:21.945 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-04-25T02:11:21.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-04-25T02:11:21.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-04-25T02:11:21.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-04-25T02:11:21.952 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-04-25T02:11:21.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-04-25T02:11:21.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-04-25T02:11:21.957 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-04-25T02:11:21.959 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-04-25T02:11:21.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-04-25T02:11:21.962 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-04-25T02:11:21.964 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-04-25T02:11:21.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-04-25T02:11:21.967 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-04-25T02:11:21.969 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-04-25T02:11:21.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-04-25T02:11:21.972 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-04-25T02:11:21.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-04-25T02:11:21.975 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-04-25T02:11:21.977 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-04-25T02:11:21.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-04-25T02:11:21.980 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-04-25T02:11:21.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-04-25T02:11:21.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-04-25T02:11:21.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-04-25T02:11:21.987 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-04-25T02:11:21.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-04-25T02:11:21.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-04-25T02:11:21.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-04-25T02:11:21.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-04-25T02:11:21.995 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-04-25T02:11:21.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-04-25T02:11:21.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-04-25T02:11:22.000 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-04-25T02:11:22.002 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-04-25T02:11:22.004 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-04-25T02:11:22.005 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-04-25T02:11:22.007 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-04-25T02:11:22.009 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-04-25T02:11:22.010 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-04-25T02:11:22.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-04-25T02:11:22.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-04-25T02:11:22.015 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-04-25T02:11:22.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-04-25T02:11:22.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-04-25T02:11:22.020 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-04-25T02:11:22.022 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-04-25T02:11:22.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-04-25T02:11:22.025 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-04-25T02:11:22.027 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-04-25T02:11:22.029 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-04-25T02:11:22.030 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-04-25T02:11:22.032 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-04-25T02:11:22.034 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-04-25T02:11:22.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-04-25T02:11:22.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-04-25T02:11:22.039 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-04-25T02:11:22.040 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-04-25T02:11:22.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-04-25T02:11:22.044 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-04-25T02:11:22.046 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/Changes 2024-04-25T02:11:22.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-04-25T02:11:22.049 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/CodingStyle 2024-04-25T02:11:22.051 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-04-25T02:11:22.054 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-04-25T02:11:22.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-04-25T02:11:22.057 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-04-25T02:11:22.059 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/ 2024-04-25T02:11:22.061 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-04-25T02:11:22.062 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-04-25T02:11:22.064 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-04-25T02:11:22.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-04-25T02:11:22.067 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-04-25T02:11:22.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-04-25T02:11:22.070 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-04-25T02:11:22.072 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-04-25T02:11:22.075 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-04-25T02:11:22.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-04-25T02:11:22.081 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-04-25T02:11:22.083 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-04-25T02:11:22.085 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-04-25T02:11:22.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-04-25T02:11:22.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-04-25T02:11:22.090 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-04-25T02:11:22.092 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-04-25T02:11:22.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-04-25T02:11:22.096 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-04-25T02:11:22.098 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-04-25T02:11:22.099 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-04-25T02:11:22.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-04-25T02:11:22.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-04-25T02:11:22.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-04-25T02:11:22.105 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-04-25T02:11:22.107 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-04-25T02:11:22.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-04-25T02:11:22.110 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-04-25T02:11:22.112 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-04-25T02:11:22.114 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-04-25T02:11:22.115 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-04-25T02:11:22.117 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-04-25T02:11:22.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-04-25T02:11:22.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-04-25T02:11:22.123 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-04-25T02:11:22.125 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-04-25T02:11:22.127 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-04-25T02:11:22.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-04-25T02:11:22.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-04-25T02:11:22.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-04-25T02:11:22.141 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-04-25T02:11:22.145 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-04-25T02:11:22.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-04-25T02:11:22.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-04-25T02:11:22.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-04-25T02:11:22.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-04-25T02:11:22.153 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-04-25T02:11:22.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-04-25T02:11:22.156 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-04-25T02:11:22.158 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-04-25T02:11:22.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-04-25T02:11:22.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-04-25T02:11:22.170 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-04-25T02:11:22.172 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-04-25T02:11:22.174 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-04-25T02:11:22.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-04-25T02:11:22.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-04-25T02:11:22.178 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-04-25T02:11:22.180 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-04-25T02:11:22.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-04-25T02:11:22.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-04-25T02:11:22.185 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-04-25T02:11:22.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-04-25T02:11:22.188 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-04-25T02:11:22.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-04-25T02:11:22.192 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-04-25T02:11:22.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-04-25T02:11:22.195 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-04-25T02:11:22.197 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-04-25T02:11:22.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-04-25T02:11:22.200 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-04-25T02:11:22.202 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-04-25T02:11:22.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-04-25T02:11:22.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-04-25T02:11:22.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-04-25T02:11:22.209 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-04-25T02:11:22.210 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-04-25T02:11:22.212 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-04-25T02:11:22.214 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-04-25T02:11:22.215 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-04-25T02:11:22.217 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-04-25T02:11:22.218 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-04-25T02:11:22.221 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-04-25T02:11:22.222 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-04-25T02:11:22.224 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-04-25T02:11:22.226 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-04-25T02:11:22.227 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-04-25T02:11:22.229 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-04-25T02:11:22.231 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-04-25T02:11:22.232 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-04-25T02:11:22.234 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-04-25T02:11:22.236 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-04-25T02:11:22.237 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-04-25T02:11:22.239 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-04-25T02:11:22.241 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-04-25T02:11:22.242 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-04-25T02:11:22.244 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-04-25T02:11:22.246 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-04-25T02:11:22.247 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-04-25T02:11:22.249 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-04-25T02:11:22.250 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-04-25T02:11:22.252 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-04-25T02:11:22.254 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-04-25T02:11:22.256 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-04-25T02:11:22.257 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-04-25T02:11:22.259 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-04-25T02:11:22.261 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-04-25T02:11:22.263 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-04-25T02:11:22.264 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-04-25T02:11:22.266 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-04-25T02:11:22.268 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-04-25T02:11:22.269 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-04-25T02:11:22.271 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-04-25T02:11:22.272 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-04-25T02:11:22.274 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-04-25T02:11:22.276 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-04-25T02:11:22.278 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-04-25T02:11:22.279 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-04-25T02:11:22.281 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-04-25T02:11:22.282 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-04-25T02:11:22.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-04-25T02:11:22.286 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-04-25T02:11:22.288 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-04-25T02:11:22.289 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-04-25T02:11:22.291 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-04-25T02:11:22.292 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-04-25T02:11:22.294 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-04-25T02:11:22.296 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-04-25T02:11:22.297 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-04-25T02:11:22.299 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-04-25T02:11:22.301 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-04-25T02:11:22.303 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-04-25T02:11:22.304 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-04-25T02:11:22.306 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-04-25T02:11:22.308 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-04-25T02:11:22.309 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-04-25T02:11:22.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-04-25T02:11:22.313 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-04-25T02:11:22.315 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-04-25T02:11:22.317 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-04-25T02:11:22.318 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-04-25T02:11:22.321 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-04-25T02:11:22.323 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-04-25T02:11:22.325 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-04-25T02:11:22.327 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-04-25T02:11:22.329 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-04-25T02:11:22.331 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-04-25T02:11:22.333 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-04-25T02:11:22.335 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-04-25T02:11:22.337 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-04-25T02:11:22.339 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-04-25T02:11:22.341 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-04-25T02:11:22.342 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-04-25T02:11:22.347 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-04-25T02:11:22.347 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-04-25T02:11:22.347 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-04-25T02:11:22.349 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-04-25T02:11:22.351 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-04-25T02:11:22.353 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-04-25T02:11:22.354 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-04-25T02:11:22.356 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-04-25T02:11:22.358 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-04-25T02:11:22.359 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-04-25T02:11:22.361 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-04-25T02:11:22.363 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-04-25T02:11:22.365 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-04-25T02:11:22.366 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-04-25T02:11:22.368 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-04-25T02:11:22.370 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-04-25T02:11:22.371 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-04-25T02:11:22.373 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-04-25T02:11:22.375 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-04-25T02:11:22.376 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-04-25T02:11:22.378 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-04-25T02:11:22.380 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-04-25T02:11:22.381 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-04-25T02:11:22.383 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-04-25T02:11:22.385 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-04-25T02:11:22.386 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-04-25T02:11:22.388 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-04-25T02:11:22.390 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-04-25T02:11:22.392 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-04-25T02:11:22.393 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-04-25T02:11:22.395 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-04-25T02:11:22.397 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-04-25T02:11:22.398 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-04-25T02:11:22.400 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-04-25T02:11:22.402 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-04-25T02:11:22.403 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-04-25T02:11:22.405 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-04-25T02:11:22.407 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-04-25T02:11:22.408 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-04-25T02:11:22.410 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-04-25T02:11:22.412 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-04-25T02:11:22.414 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-04-25T02:11:22.416 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-04-25T02:11:22.418 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-04-25T02:11:22.419 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-04-25T02:11:23.353 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-04-25T02:11:23.354 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-04-25T02:11:23.356 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-04-25T02:11:23.358 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-04-25T02:11:23.361 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-04-25T02:11:23.363 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-04-25T02:11:23.365 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-04-25T02:11:23.367 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-04-25T02:11:23.370 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-04-25T02:11:23.372 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-04-25T02:11:23.375 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-04-25T02:11:23.377 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-04-25T02:11:23.379 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-04-25T02:11:23.380 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-04-25T02:11:23.382 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-04-25T02:11:23.384 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-04-25T02:11:23.385 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-04-25T02:11:23.387 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-04-25T02:11:23.389 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-04-25T02:11:23.391 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-04-25T02:11:23.392 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-04-25T02:11:23.394 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-04-25T02:11:23.396 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-04-25T02:11:23.398 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-04-25T02:11:23.399 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-04-25T02:11:23.401 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-04-25T02:11:23.403 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-04-25T02:11:23.405 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-04-25T02:11:23.408 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-04-25T02:11:23.410 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-04-25T02:11:23.412 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-04-25T02:11:23.420 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-04-25T02:11:23.422 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-04-25T02:11:23.424 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-04-25T02:11:23.427 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/ 2024-04-25T02:11:23.428 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-04-25T02:11:23.430 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-04-25T02:11:23.432 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-04-25T02:11:23.434 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-04-25T02:11:23.436 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-04-25T02:11:23.438 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-04-25T02:11:23.440 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-04-25T02:11:23.442 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-04-25T02:11:23.444 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-04-25T02:11:23.447 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/EDID/hex 2024-04-25T02:11:23.449 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/HOWTO 2024-04-25T02:11:23.451 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-04-25T02:11:23.453 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-04-25T02:11:23.456 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-04-25T02:11:23.458 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-04-25T02:11:23.460 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-04-25T02:11:23.462 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/Makefile 2024-04-25T02:11:23.464 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-04-25T02:11:23.466 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/ 2024-04-25T02:11:23.468 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-04-25T02:11:23.470 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-04-25T02:11:23.473 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-04-25T02:11:23.475 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-04-25T02:11:23.477 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-04-25T02:11:23.479 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-04-25T02:11:23.481 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-04-25T02:11:23.483 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/ 2024-04-25T02:11:23.485 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-04-25T02:11:23.487 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-04-25T02:11:23.489 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-04-25T02:11:23.492 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-04-25T02:11:23.494 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-04-25T02:11:23.496 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-04-25T02:11:23.498 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-04-25T02:11:23.500 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-04-25T02:11:23.502 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-04-25T02:11:23.505 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-04-25T02:11:23.506 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-04-25T02:11:23.509 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-04-25T02:11:23.511 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-04-25T02:11:23.512 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-04-25T02:11:23.514 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-04-25T02:11:23.515 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-04-25T02:11:23.517 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-04-25T02:11:23.518 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-04-25T02:11:23.520 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SAK.txt 2024-04-25T02:11:23.522 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SM501.txt 2024-04-25T02:11:23.524 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-04-25T02:11:23.525 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-04-25T02:11:23.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-04-25T02:11:23.528 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-04-25T02:11:23.530 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-04-25T02:11:23.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/ 2024-04-25T02:11:23.533 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-04-25T02:11:23.535 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-04-25T02:11:23.536 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-04-25T02:11:23.538 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-04-25T02:11:23.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-04-25T02:11:23.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-04-25T02:11:23.543 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-04-25T02:11:23.545 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/ 2024-04-25T02:11:23.546 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-04-25T02:11:23.548 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-04-25T02:11:23.549 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-04-25T02:11:23.551 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-04-25T02:11:23.553 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-04-25T02:11:23.554 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-04-25T02:11:23.556 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-04-25T02:11:23.557 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-04-25T02:11:23.559 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-04-25T02:11:23.560 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-04-25T02:11:23.562 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-04-25T02:11:23.564 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-04-25T02:11:23.565 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-04-25T02:11:23.567 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/ 2024-04-25T02:11:23.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-04-25T02:11:23.570 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-04-25T02:11:23.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-04-25T02:11:23.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-04-25T02:11:23.574 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-04-25T02:11:23.576 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-04-25T02:11:23.577 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-04-25T02:11:23.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/ 2024-04-25T02:11:23.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-04-25T02:11:23.582 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-04-25T02:11:23.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-04-25T02:11:23.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Booting 2024-04-25T02:11:23.587 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-04-25T02:11:23.589 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-04-25T02:11:23.591 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-04-25T02:11:23.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-04-25T02:11:23.594 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-04-25T02:11:23.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-04-25T02:11:23.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-04-25T02:11:23.599 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-04-25T02:11:23.600 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-04-25T02:11:23.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-04-25T02:11:23.603 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Porting 2024-04-25T02:11:23.605 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/README 2024-04-25T02:11:23.606 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-04-25T02:11:23.608 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-04-25T02:11:23.609 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-04-25T02:11:23.611 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-04-25T02:11:23.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-04-25T02:11:23.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-04-25T02:11:23.616 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-04-25T02:11:23.617 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-04-25T02:11:23.619 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-04-25T02:11:23.620 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-04-25T02:11:23.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-04-25T02:11:23.624 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-04-25T02:11:23.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-04-25T02:11:23.627 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-04-25T02:11:23.629 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-04-25T02:11:23.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-04-25T02:11:23.632 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-04-25T02:11:23.633 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-04-25T02:11:23.635 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-04-25T02:11:23.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-04-25T02:11:23.638 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-04-25T02:11:23.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-04-25T02:11:23.641 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-04-25T02:11:23.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:23 smithi163 ceph-mon[32577]: pgmap v53: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:23.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-04-25T02:11:23.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-04-25T02:11:23.646 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-04-25T02:11:23.647 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-04-25T02:11:23.649 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-04-25T02:11:23.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-04-25T02:11:23.651 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-04-25T02:11:23.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-04-25T02:11:23.655 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-04-25T02:11:23.656 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-04-25T02:11:23.658 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-04-25T02:11:23.660 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-04-25T02:11:23.661 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-04-25T02:11:23.663 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-04-25T02:11:23.665 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-04-25T02:11:23.666 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-04-25T02:11:23.668 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-04-25T02:11:23.670 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-04-25T02:11:23.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-04-25T02:11:23.673 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-04-25T02:11:23.674 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/Setup 2024-04-25T02:11:23.676 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-04-25T02:11:23.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-04-25T02:11:23.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:23 smithi174 ceph-mon[33171]: pgmap v53: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:23.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-04-25T02:11:23.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-04-25T02:11:23.682 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-04-25T02:11:23.684 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-04-25T02:11:23.686 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-04-25T02:11:23.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-04-25T02:11:23.689 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-04-25T02:11:23.691 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-04-25T02:11:23.692 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-04-25T02:11:23.694 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-04-25T02:11:23.695 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-04-25T02:11:23.697 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-04-25T02:11:23.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-04-25T02:11:23.700 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-04-25T02:11:23.702 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-04-25T02:11:23.703 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-04-25T02:11:23.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-04-25T02:11:23.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-04-25T02:11:23.708 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-04-25T02:11:23.710 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-04-25T02:11:23.712 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-04-25T02:11:23.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-04-25T02:11:23.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-04-25T02:11:23.716 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-04-25T02:11:23.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-04-25T02:11:23.720 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-04-25T02:11:23.721 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-04-25T02:11:23.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-04-25T02:11:23.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm64/ 2024-04-25T02:11:23.726 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-04-25T02:11:23.728 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-04-25T02:11:23.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-04-25T02:11:23.731 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-04-25T02:11:23.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-04-25T02:11:23.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-04-25T02:11:23.736 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-04-25T02:11:23.738 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-04-25T02:11:23.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-04-25T02:11:23.741 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-04-25T02:11:23.743 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-04-25T02:11:23.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-04-25T02:11:23.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/backlight/ 2024-04-25T02:11:23.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-04-25T02:11:23.749 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-04-25T02:11:23.751 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-04-25T02:11:23.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bcache.txt 2024-04-25T02:11:23.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-04-25T02:11:23.756 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/ 2024-04-25T02:11:23.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-04-25T02:11:23.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-04-25T02:11:23.760 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-04-25T02:11:23.762 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-04-25T02:11:23.763 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-04-25T02:11:23.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/ 2024-04-25T02:11:23.767 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-04-25T02:11:23.768 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-04-25T02:11:23.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-04-25T02:11:23.774 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-04-25T02:11:23.774 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-04-25T02:11:23.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-04-25T02:11:23.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-04-25T02:11:23.778 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-04-25T02:11:23.780 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-04-25T02:11:23.783 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-04-25T02:11:23.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:23 smithi137 ceph-mon[28303]: pgmap v53: 97 pgs: 97 active+clean; 53 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.3 MiB/s wr, 11 op/s 2024-04-25T02:11:23.785 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-04-25T02:11:23.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/request.txt 2024-04-25T02:11:23.788 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-04-25T02:11:23.789 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-04-25T02:11:23.791 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-04-25T02:11:23.792 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/ 2024-04-25T02:11:23.794 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-04-25T02:11:23.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-04-25T02:11:23.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-04-25T02:11:23.799 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-04-25T02:11:23.800 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-04-25T02:11:23.802 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-04-25T02:11:23.803 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-04-25T02:11:23.805 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-04-25T02:11:23.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-04-25T02:11:23.808 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-04-25T02:11:23.810 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-04-25T02:11:23.812 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-04-25T02:11:23.813 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-04-25T02:11:23.815 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-04-25T02:11:23.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-04-25T02:11:23.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-04-25T02:11:23.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-04-25T02:11:23.821 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-04-25T02:11:23.823 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-04-25T02:11:23.824 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-04-25T02:11:23.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-04-25T02:11:23.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-04-25T02:11:23.830 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-04-25T02:11:23.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-04-25T02:11:23.832 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-04-25T02:11:23.834 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-04-25T02:11:23.836 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/ 2024-04-25T02:11:23.837 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-04-25T02:11:23.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-04-25T02:11:23.840 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-04-25T02:11:23.842 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-04-25T02:11:23.844 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-04-25T02:11:23.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/ 2024-04-25T02:11:23.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-04-25T02:11:23.848 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-04-25T02:11:23.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-04-25T02:11:23.852 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-04-25T02:11:23.854 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-04-25T02:11:23.855 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-04-25T02:11:23.857 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-04-25T02:11:23.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-04-25T02:11:23.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-04-25T02:11:23.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-04-25T02:11:23.863 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-04-25T02:11:23.865 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-04-25T02:11:23.867 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-04-25T02:11:23.868 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-04-25T02:11:23.870 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/clk.txt 2024-04-25T02:11:23.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-04-25T02:11:23.873 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/ 2024-04-25T02:11:23.875 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-04-25T02:11:23.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-04-25T02:11:23.878 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-04-25T02:11:23.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-04-25T02:11:23.881 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-04-25T02:11:23.883 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/console/ 2024-04-25T02:11:23.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/console/console.txt 2024-04-25T02:11:23.886 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-04-25T02:11:23.887 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-04-25T02:11:23.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-04-25T02:11:23.891 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-04-25T02:11:23.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-04-25T02:11:23.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-04-25T02:11:23.896 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-04-25T02:11:23.897 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-04-25T02:11:23.899 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-04-25T02:11:23.900 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-04-25T02:11:23.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-04-25T02:11:23.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-04-25T02:11:23.905 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-04-25T02:11:23.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-04-25T02:11:23.909 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-04-25T02:11:23.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-04-25T02:11:23.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-04-25T02:11:23.913 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-04-25T02:11:23.915 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-04-25T02:11:23.917 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-04-25T02:11:23.919 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crc32.txt 2024-04-25T02:11:23.920 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cris/ 2024-04-25T02:11:23.922 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/cris/README 2024-04-25T02:11:23.923 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/ 2024-04-25T02:11:23.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-04-25T02:11:23.927 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-04-25T02:11:23.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-04-25T02:11:23.930 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-04-25T02:11:23.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-04-25T02:11:23.933 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-04-25T02:11:23.935 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-04-25T02:11:23.937 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-04-25T02:11:23.938 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-04-25T02:11:23.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/ 2024-04-25T02:11:23.941 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-04-25T02:11:23.943 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-04-25T02:11:23.945 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-04-25T02:11:23.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-04-25T02:11:23.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-04-25T02:11:23.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-04-25T02:11:23.952 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-04-25T02:11:23.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-04-25T02:11:23.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-04-25T02:11:23.956 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-04-25T02:11:23.958 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-04-25T02:11:23.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-04-25T02:11:23.961 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-04-25T02:11:23.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-04-25T02:11:23.964 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-04-25T02:11:23.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-04-25T02:11:23.968 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-04-25T02:11:23.970 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-04-25T02:11:23.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-04-25T02:11:23.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-04-25T02:11:23.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-04-25T02:11:23.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-04-25T02:11:23.977 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-04-25T02:11:23.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-04-25T02:11:23.980 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-04-25T02:11:23.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-04-25T02:11:23.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-04-25T02:11:23.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-04-25T02:11:23.987 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-04-25T02:11:23.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-04-25T02:11:23.990 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-04-25T02:11:23.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devices.txt 2024-04-25T02:11:23.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/ 2024-04-25T02:11:23.998 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-04-25T02:11:24.000 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-04-25T02:11:24.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-04-25T02:11:24.003 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-04-25T02:11:24.004 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-04-25T02:11:24.006 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-04-25T02:11:24.008 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-04-25T02:11:24.009 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-04-25T02:11:24.011 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-04-25T02:11:24.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-04-25T02:11:24.013 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-04-25T02:11:24.015 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-04-25T02:11:24.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-04-25T02:11:24.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-04-25T02:11:24.020 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-04-25T02:11:24.022 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-04-25T02:11:24.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-04-25T02:11:24.025 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-04-25T02:11:24.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-04-25T02:11:24.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-04-25T02:11:24.030 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-04-25T02:11:24.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-04-25T02:11:24.033 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-04-25T02:11:24.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-04-25T02:11:24.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-04-25T02:11:24.038 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-04-25T02:11:24.040 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-04-25T02:11:24.041 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-04-25T02:11:24.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-04-25T02:11:24.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-04-25T02:11:24.046 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-04-25T02:11:24.048 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-04-25T02:11:24.049 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-04-25T02:11:24.051 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-04-25T02:11:24.053 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-04-25T02:11:24.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-04-25T02:11:24.056 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-04-25T02:11:24.058 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-04-25T02:11:24.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-04-25T02:11:24.061 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-04-25T02:11:24.063 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-04-25T02:11:24.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-04-25T02:11:24.066 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-04-25T02:11:24.068 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-04-25T02:11:24.070 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-04-25T02:11:24.071 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-04-25T02:11:24.073 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-04-25T02:11:24.075 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-04-25T02:11:24.076 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-04-25T02:11:24.078 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-04-25T02:11:24.079 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-04-25T02:11:24.081 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-04-25T02:11:24.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-04-25T02:11:24.084 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-04-25T02:11:24.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-04-25T02:11:24.087 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-04-25T02:11:24.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-04-25T02:11:24.090 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-04-25T02:11:24.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-04-25T02:11:24.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-04-25T02:11:24.095 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-04-25T02:11:24.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-04-25T02:11:24.098 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-04-25T02:11:24.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-04-25T02:11:24.101 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-04-25T02:11:24.103 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-04-25T02:11:24.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-04-25T02:11:24.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-04-25T02:11:24.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-04-25T02:11:24.109 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-04-25T02:11:24.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-04-25T02:11:24.112 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-04-25T02:11:24.114 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-04-25T02:11:24.116 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-04-25T02:11:24.117 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-04-25T02:11:24.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-04-25T02:11:24.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-04-25T02:11:24.122 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-04-25T02:11:24.124 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-04-25T02:11:24.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-04-25T02:11:24.127 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-04-25T02:11:24.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-04-25T02:11:24.130 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-04-25T02:11:24.132 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-04-25T02:11:24.134 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-04-25T02:11:24.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-04-25T02:11:24.137 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-04-25T02:11:24.139 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-04-25T02:11:24.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-04-25T02:11:24.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-04-25T02:11:24.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-04-25T02:11:24.145 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-04-25T02:11:24.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-04-25T02:11:24.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-04-25T02:11:24.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-04-25T02:11:24.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-04-25T02:11:24.153 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-04-25T02:11:24.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-04-25T02:11:24.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-04-25T02:11:24.158 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-04-25T02:11:24.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-04-25T02:11:24.162 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-04-25T02:11:24.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-04-25T02:11:24.165 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-04-25T02:11:24.167 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-04-25T02:11:24.168 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-04-25T02:11:24.170 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-04-25T02:11:24.172 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-04-25T02:11:24.173 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-04-25T02:11:24.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-04-25T02:11:24.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-04-25T02:11:24.178 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-04-25T02:11:24.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-04-25T02:11:24.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-04-25T02:11:24.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-04-25T02:11:24.185 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-04-25T02:11:24.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-04-25T02:11:24.188 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-04-25T02:11:24.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-04-25T02:11:24.192 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-04-25T02:11:24.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-04-25T02:11:24.195 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-04-25T02:11:24.196 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-04-25T02:11:24.198 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-04-25T02:11:24.200 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-04-25T02:11:24.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-04-25T02:11:24.203 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-04-25T02:11:24.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-04-25T02:11:24.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-04-25T02:11:24.208 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-04-25T02:11:24.210 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-04-25T02:11:24.212 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-04-25T02:11:24.213 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-04-25T02:11:24.215 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-04-25T02:11:24.217 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-04-25T02:11:24.219 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-04-25T02:11:24.220 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-04-25T02:11:24.222 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-04-25T02:11:24.224 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-04-25T02:11:24.225 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-04-25T02:11:24.226 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-04-25T02:11:24.228 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-04-25T02:11:24.230 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-04-25T02:11:24.232 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-04-25T02:11:24.233 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-04-25T02:11:24.235 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-04-25T02:11:24.237 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-04-25T02:11:24.238 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-04-25T02:11:24.240 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-04-25T02:11:24.241 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-04-25T02:11:24.243 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-04-25T02:11:24.245 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-04-25T02:11:24.246 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-04-25T02:11:24.248 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-04-25T02:11:24.250 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-04-25T02:11:24.251 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-04-25T02:11:24.253 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-04-25T02:11:24.255 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-04-25T02:11:24.466 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-04-25T02:11:24.467 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-04-25T02:11:24.469 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-04-25T02:11:24.471 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-04-25T02:11:24.472 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-04-25T02:11:24.474 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-04-25T02:11:24.475 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-04-25T02:11:24.477 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-04-25T02:11:24.479 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-04-25T02:11:24.481 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-04-25T02:11:24.483 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-04-25T02:11:24.484 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-04-25T02:11:24.486 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-04-25T02:11:24.487 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-04-25T02:11:24.489 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-04-25T02:11:24.491 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-04-25T02:11:24.492 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-04-25T02:11:24.494 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-04-25T02:11:24.496 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-04-25T02:11:24.498 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-04-25T02:11:24.500 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-04-25T02:11:24.501 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-04-25T02:11:24.503 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-04-25T02:11:24.504 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-04-25T02:11:24.506 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-04-25T02:11:24.508 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-04-25T02:11:24.509 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-04-25T02:11:24.511 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-04-25T02:11:24.512 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-04-25T02:11:24.514 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-04-25T02:11:24.516 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-04-25T02:11:24.517 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-04-25T02:11:24.519 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-04-25T02:11:24.521 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-04-25T02:11:24.522 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-04-25T02:11:24.524 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-04-25T02:11:24.526 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-04-25T02:11:24.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-04-25T02:11:24.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-04-25T02:11:24.530 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-04-25T02:11:24.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-04-25T02:11:24.534 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-04-25T02:11:24.535 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-04-25T02:11:24.537 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-04-25T02:11:24.538 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-04-25T02:11:24.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-04-25T02:11:24.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-04-25T02:11:24.544 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-04-25T02:11:24.546 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-04-25T02:11:24.547 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-04-25T02:11:24.549 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-04-25T02:11:24.551 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-04-25T02:11:24.553 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-04-25T02:11:24.554 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-04-25T02:11:24.556 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-04-25T02:11:24.558 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-04-25T02:11:24.560 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-04-25T02:11:24.562 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-04-25T02:11:24.563 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-04-25T02:11:24.565 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-04-25T02:11:24.567 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-04-25T02:11:24.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-04-25T02:11:24.570 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-04-25T02:11:24.572 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-04-25T02:11:24.574 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-04-25T02:11:24.575 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-04-25T02:11:24.577 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-04-25T02:11:24.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-04-25T02:11:24.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-04-25T02:11:24.582 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-04-25T02:11:24.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-04-25T02:11:24.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-04-25T02:11:24.590 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-04-25T02:11:24.590 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-04-25T02:11:24.591 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-04-25T02:11:24.593 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-04-25T02:11:24.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-04-25T02:11:24.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-04-25T02:11:24.598 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-04-25T02:11:24.600 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-04-25T02:11:24.602 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-04-25T02:11:24.604 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-04-25T02:11:24.606 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-04-25T02:11:24.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-04-25T02:11:24.609 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-04-25T02:11:24.611 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-04-25T02:11:24.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-04-25T02:11:24.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-04-25T02:11:24.616 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-04-25T02:11:24.618 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-04-25T02:11:24.620 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-04-25T02:11:24.621 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-04-25T02:11:24.623 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-04-25T02:11:24.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-04-25T02:11:24.626 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-04-25T02:11:24.628 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-04-25T02:11:24.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-04-25T02:11:24.632 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-04-25T02:11:24.634 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-04-25T02:11:24.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-04-25T02:11:24.638 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-04-25T02:11:24.640 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-04-25T02:11:24.642 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-04-25T02:11:24.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-04-25T02:11:24.645 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-04-25T02:11:24.647 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-04-25T02:11:24.649 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-04-25T02:11:24.651 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-04-25T02:11:24.652 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-04-25T02:11:24.654 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-04-25T02:11:24.656 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-04-25T02:11:24.658 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-04-25T02:11:24.659 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-04-25T02:11:24.661 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-04-25T02:11:24.663 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-04-25T02:11:24.665 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-04-25T02:11:24.666 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-04-25T02:11:24.668 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-04-25T02:11:24.670 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-04-25T02:11:24.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-04-25T02:11:24.673 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-04-25T02:11:24.675 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-04-25T02:11:24.676 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-04-25T02:11:24.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-04-25T02:11:24.680 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-04-25T02:11:24.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-04-25T02:11:24.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-04-25T02:11:24.685 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-04-25T02:11:24.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-04-25T02:11:24.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-04-25T02:11:24.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-04-25T02:11:24.692 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-04-25T02:11:24.694 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-04-25T02:11:24.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-04-25T02:11:24.697 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-04-25T02:11:24.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-04-25T02:11:24.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-04-25T02:11:24.702 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-04-25T02:11:24.704 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-04-25T02:11:24.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-04-25T02:11:24.707 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-04-25T02:11:24.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-04-25T02:11:24.711 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-04-25T02:11:24.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-04-25T02:11:24.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-04-25T02:11:24.717 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-04-25T02:11:24.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-04-25T02:11:24.720 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-04-25T02:11:24.722 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-04-25T02:11:24.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-04-25T02:11:24.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-04-25T02:11:24.727 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-04-25T02:11:24.728 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-04-25T02:11:24.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-04-25T02:11:24.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-04-25T02:11:24.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-04-25T02:11:24.735 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-04-25T02:11:24.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-04-25T02:11:24.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-04-25T02:11:24.740 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-04-25T02:11:24.742 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-04-25T02:11:24.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-04-25T02:11:24.745 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-04-25T02:11:24.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-04-25T02:11:24.749 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-04-25T02:11:24.751 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-04-25T02:11:24.753 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-04-25T02:11:24.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-04-25T02:11:24.756 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-04-25T02:11:24.758 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-04-25T02:11:24.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-04-25T02:11:24.761 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-04-25T02:11:24.763 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-04-25T02:11:24.764 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-04-25T02:11:24.766 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-04-25T02:11:24.769 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-04-25T02:11:24.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-04-25T02:11:24.772 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-04-25T02:11:24.774 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-04-25T02:11:24.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-04-25T02:11:24.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-04-25T02:11:24.779 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-04-25T02:11:24.780 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-04-25T02:11:24.782 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-04-25T02:11:24.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-04-25T02:11:24.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-04-25T02:11:24.788 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-04-25T02:11:24.789 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-04-25T02:11:24.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-04-25T02:11:24.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-04-25T02:11:24.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-04-25T02:11:24.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-04-25T02:11:24.798 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-04-25T02:11:24.800 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-04-25T02:11:24.802 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-04-25T02:11:24.804 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-04-25T02:11:24.805 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-04-25T02:11:24.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-04-25T02:11:24.809 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-04-25T02:11:24.810 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-04-25T02:11:24.812 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-04-25T02:11:24.814 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-04-25T02:11:24.815 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-04-25T02:11:24.817 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-04-25T02:11:24.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-04-25T02:11:24.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-04-25T02:11:24.822 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-04-25T02:11:24.823 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-04-25T02:11:24.825 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-04-25T02:11:24.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-04-25T02:11:24.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-04-25T02:11:24.829 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-04-25T02:11:24.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-04-25T02:11:24.832 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-04-25T02:11:24.834 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-04-25T02:11:24.836 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-04-25T02:11:24.837 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-04-25T02:11:24.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-04-25T02:11:24.840 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-04-25T02:11:24.842 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-04-25T02:11:24.843 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-04-25T02:11:24.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-04-25T02:11:24.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-04-25T02:11:24.849 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-04-25T02:11:24.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-04-25T02:11:24.852 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-04-25T02:11:24.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-04-25T02:11:24.855 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-04-25T02:11:24.856 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-04-25T02:11:24.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-04-25T02:11:24.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-04-25T02:11:24.861 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-04-25T02:11:24.863 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-04-25T02:11:24.864 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-04-25T02:11:24.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-04-25T02:11:24.868 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-04-25T02:11:24.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-04-25T02:11:24.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-04-25T02:11:24.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-04-25T02:11:24.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-04-25T02:11:24.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-04-25T02:11:24.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-04-25T02:11:24.879 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-04-25T02:11:24.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-04-25T02:11:24.882 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-04-25T02:11:24.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-04-25T02:11:24.886 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-04-25T02:11:24.888 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-04-25T02:11:24.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-04-25T02:11:24.890 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-04-25T02:11:24.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-04-25T02:11:24.893 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-04-25T02:11:24.895 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-04-25T02:11:24.897 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-04-25T02:11:24.898 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-04-25T02:11:24.900 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-04-25T02:11:24.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-04-25T02:11:24.903 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-04-25T02:11:24.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-04-25T02:11:24.906 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-04-25T02:11:24.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-04-25T02:11:24.909 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-04-25T02:11:24.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-04-25T02:11:24.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-04-25T02:11:24.914 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-04-25T02:11:24.915 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-04-25T02:11:24.917 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-04-25T02:11:24.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-04-25T02:11:24.920 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-04-25T02:11:24.922 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-04-25T02:11:24.923 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-04-25T02:11:24.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-04-25T02:11:24.926 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-04-25T02:11:24.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-04-25T02:11:24.929 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-04-25T02:11:24.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-04-25T02:11:24.932 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-04-25T02:11:24.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-04-25T02:11:24.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-04-25T02:11:24.937 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-04-25T02:11:24.939 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-04-25T02:11:24.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-04-25T02:11:24.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-04-25T02:11:24.943 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-04-25T02:11:24.945 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-04-25T02:11:24.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-04-25T02:11:24.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-04-25T02:11:24.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-04-25T02:11:24.951 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-04-25T02:11:24.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-04-25T02:11:24.954 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-04-25T02:11:24.956 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-04-25T02:11:24.957 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-04-25T02:11:24.959 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-04-25T02:11:24.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-04-25T02:11:24.962 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-04-25T02:11:24.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-04-25T02:11:24.965 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-04-25T02:11:24.967 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-04-25T02:11:24.969 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-04-25T02:11:24.970 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-04-25T02:11:24.972 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-04-25T02:11:24.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-04-25T02:11:24.975 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-04-25T02:11:24.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-04-25T02:11:24.978 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-04-25T02:11:24.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-04-25T02:11:24.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-04-25T02:11:24.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-04-25T02:11:24.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-04-25T02:11:24.985 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-04-25T02:11:24.987 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-04-25T02:11:24.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-04-25T02:11:24.990 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-04-25T02:11:24.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-04-25T02:11:24.993 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-04-25T02:11:24.995 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-04-25T02:11:24.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-04-25T02:11:24.998 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-04-25T02:11:24.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-04-25T02:11:25.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-04-25T02:11:25.002 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-04-25T02:11:25.005 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-04-25T02:11:25.006 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-04-25T02:11:25.008 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-04-25T02:11:25.010 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-04-25T02:11:25.011 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-04-25T02:11:25.013 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-04-25T02:11:25.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-04-25T02:11:25.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-04-25T02:11:25.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-04-25T02:11:25.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-04-25T02:11:25.021 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-04-25T02:11:25.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-04-25T02:11:25.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-04-25T02:11:25.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-04-25T02:11:25.027 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-04-25T02:11:25.029 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-04-25T02:11:25.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-04-25T02:11:25.032 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-04-25T02:11:25.034 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-04-25T02:11:25.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-04-25T02:11:25.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-04-25T02:11:25.038 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-04-25T02:11:25.040 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-04-25T02:11:25.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-04-25T02:11:25.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-04-25T02:11:25.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-04-25T02:11:25.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-04-25T02:11:25.048 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-04-25T02:11:25.050 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-04-25T02:11:25.051 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-04-25T02:11:25.053 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-04-25T02:11:25.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-04-25T02:11:25.056 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-04-25T02:11:25.058 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-04-25T02:11:25.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-04-25T02:11:25.061 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-04-25T02:11:25.063 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-04-25T02:11:25.064 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-04-25T02:11:25.066 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-04-25T02:11:25.068 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-04-25T02:11:25.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-04-25T02:11:25.071 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-04-25T02:11:25.072 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-04-25T02:11:25.074 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-04-25T02:11:25.076 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-04-25T02:11:25.077 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-04-25T02:11:25.079 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-04-25T02:11:25.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-04-25T02:11:25.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-04-25T02:11:25.084 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-04-25T02:11:25.085 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-04-25T02:11:25.087 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-04-25T02:11:25.089 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-04-25T02:11:25.090 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-04-25T02:11:25.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-04-25T02:11:25.093 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-04-25T02:11:25.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-04-25T02:11:25.096 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-04-25T02:11:25.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-04-25T02:11:25.099 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-04-25T02:11:25.101 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-04-25T02:11:25.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-04-25T02:11:25.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-04-25T02:11:25.105 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-04-25T02:11:25.107 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-04-25T02:11:25.109 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-04-25T02:11:25.110 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-04-25T02:11:25.112 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-04-25T02:11:25.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-04-25T02:11:25.115 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-04-25T02:11:25.116 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-04-25T02:11:25.118 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-04-25T02:11:25.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-04-25T02:11:25.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-04-25T02:11:25.123 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-04-25T02:11:25.124 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-04-25T02:11:25.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-04-25T02:11:25.127 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-04-25T02:11:25.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-04-25T02:11:25.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-04-25T02:11:25.132 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-04-25T02:11:25.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-04-25T02:11:25.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-04-25T02:11:25.136 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-04-25T02:11:25.138 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-04-25T02:11:25.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-04-25T02:11:25.141 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-04-25T02:11:25.143 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-04-25T02:11:25.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-04-25T02:11:25.146 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-04-25T02:11:25.148 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-04-25T02:11:25.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-04-25T02:11:25.151 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-04-25T02:11:25.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-04-25T02:11:25.154 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-04-25T02:11:25.156 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-04-25T02:11:25.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-04-25T02:11:25.159 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-04-25T02:11:25.161 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-04-25T02:11:25.162 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-04-25T02:11:25.164 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-04-25T02:11:25.165 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-04-25T02:11:25.167 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-04-25T02:11:25.169 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-04-25T02:11:25.170 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-04-25T02:11:25.172 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-04-25T02:11:25.174 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-04-25T02:11:25.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-04-25T02:11:25.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-04-25T02:11:25.178 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-04-25T02:11:25.180 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-04-25T02:11:25.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-04-25T02:11:25.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-04-25T02:11:25.185 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-04-25T02:11:25.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-04-25T02:11:25.188 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-04-25T02:11:25.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-04-25T02:11:25.191 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-04-25T02:11:25.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-04-25T02:11:25.195 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-04-25T02:11:25.196 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-04-25T02:11:25.198 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-04-25T02:11:25.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-04-25T02:11:25.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-04-25T02:11:25.203 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-04-25T02:11:25.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-04-25T02:11:25.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-04-25T02:11:25.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-04-25T02:11:25.209 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-04-25T02:11:25.210 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-04-25T02:11:25.212 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-04-25T02:11:25.214 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-04-25T02:11:25.215 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-04-25T02:11:25.217 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-04-25T02:11:25.219 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-04-25T02:11:25.220 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-04-25T02:11:25.222 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-04-25T02:11:25.224 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-04-25T02:11:25.225 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-04-25T02:11:25.227 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-04-25T02:11:25.229 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-04-25T02:11:25.230 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-04-25T02:11:25.232 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-04-25T02:11:25.234 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-04-25T02:11:25.235 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-04-25T02:11:25.237 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-04-25T02:11:25.238 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-04-25T02:11:25.240 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-04-25T02:11:25.242 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-04-25T02:11:25.243 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-04-25T02:11:25.245 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-04-25T02:11:25.247 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-04-25T02:11:25.248 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-04-25T02:11:25.250 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-04-25T02:11:25.251 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-04-25T02:11:25.253 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-04-25T02:11:25.255 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-04-25T02:11:25.256 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-04-25T02:11:25.258 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-04-25T02:11:25.259 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-04-25T02:11:25.261 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-04-25T02:11:25.263 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-04-25T02:11:25.265 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-04-25T02:11:25.266 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-04-25T02:11:25.268 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-04-25T02:11:25.269 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-04-25T02:11:25.271 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-04-25T02:11:25.272 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-04-25T02:11:25.274 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-04-25T02:11:25.276 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-04-25T02:11:25.277 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-04-25T02:11:25.279 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-04-25T02:11:25.281 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-04-25T02:11:25.282 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-04-25T02:11:25.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-04-25T02:11:25.286 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-04-25T02:11:25.287 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-04-25T02:11:25.289 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-04-25T02:11:25.290 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-04-25T02:11:25.292 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-04-25T02:11:25.515 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-04-25T02:11:25.516 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-04-25T02:11:25.518 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-04-25T02:11:25.520 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-04-25T02:11:25.521 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-04-25T02:11:25.523 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-04-25T02:11:25.524 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-04-25T02:11:25.526 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-04-25T02:11:25.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-04-25T02:11:25.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-04-25T02:11:25.531 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-04-25T02:11:25.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-04-25T02:11:25.534 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-04-25T02:11:25.535 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-04-25T02:11:25.537 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-04-25T02:11:25.539 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-04-25T02:11:25.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-04-25T02:11:25.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-04-25T02:11:25.544 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-04-25T02:11:25.545 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-04-25T02:11:25.547 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-04-25T02:11:25.548 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-04-25T02:11:25.550 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-04-25T02:11:25.551 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-04-25T02:11:25.553 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-04-25T02:11:25.555 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-04-25T02:11:25.556 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-04-25T02:11:25.558 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-04-25T02:11:25.559 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-04-25T02:11:25.561 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-04-25T02:11:25.563 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-04-25T02:11:25.564 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-04-25T02:11:25.566 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-04-25T02:11:25.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-04-25T02:11:25.569 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-04-25T02:11:25.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-04-25T02:11:25.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-04-25T02:11:25.574 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-04-25T02:11:25.576 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-04-25T02:11:25.578 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-04-25T02:11:25.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-04-25T02:11:25.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-04-25T02:11:25.583 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-04-25T02:11:25.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-04-25T02:11:25.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-04-25T02:11:25.587 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-04-25T02:11:25.589 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-04-25T02:11:25.590 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-04-25T02:11:25.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-04-25T02:11:25.593 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-04-25T02:11:25.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-04-25T02:11:25.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-04-25T02:11:25.598 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-04-25T02:11:25.600 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-04-25T02:11:25.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-04-25T02:11:25.603 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-04-25T02:11:25.604 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-04-25T02:11:25.606 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-04-25T02:11:25.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-04-25T02:11:25.609 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-04-25T02:11:25.610 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-04-25T02:11:25.612 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-04-25T02:11:25.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-04-25T02:11:25.615 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-04-25T02:11:25.616 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-04-25T02:11:25.618 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-04-25T02:11:25.619 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-04-25T02:11:25.621 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-04-25T02:11:25.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-04-25T02:11:25.624 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-04-25T02:11:25.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-04-25T02:11:25.627 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-04-25T02:11:25.629 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-04-25T02:11:25.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-04-25T02:11:25.632 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-04-25T02:11:25.633 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-04-25T02:11:25.635 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-04-25T02:11:25.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-04-25T02:11:25.638 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-04-25T02:11:25.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-04-25T02:11:25.641 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-04-25T02:11:25.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:25 smithi163 ceph-mon[32577]: pgmap v54: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-25T02:11:25.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-04-25T02:11:25.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-04-25T02:11:25.645 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-04-25T02:11:25.647 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-04-25T02:11:25.648 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-04-25T02:11:25.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-04-25T02:11:25.651 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-04-25T02:11:25.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-04-25T02:11:25.654 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-04-25T02:11:25.656 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-04-25T02:11:25.657 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-04-25T02:11:25.659 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-04-25T02:11:25.660 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-04-25T02:11:25.662 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-04-25T02:11:25.663 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-04-25T02:11:25.665 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-04-25T02:11:25.666 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-04-25T02:11:25.668 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-04-25T02:11:25.669 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-04-25T02:11:25.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-04-25T02:11:25.672 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-04-25T02:11:25.674 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-04-25T02:11:25.676 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-04-25T02:11:25.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-04-25T02:11:25.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:25 smithi174 ceph-mon[33171]: pgmap v54: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-25T02:11:25.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-04-25T02:11:25.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-04-25T02:11:25.682 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-04-25T02:11:25.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-04-25T02:11:25.684 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-04-25T02:11:25.685 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-04-25T02:11:25.686 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-04-25T02:11:25.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-04-25T02:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 -- 172.21.15.137:0/1276413737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 msgr2=0x7fc974110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 --2- 172.21.15.137:0/1276413737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc974110910 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009cd0 tx=0x7fc96c02a8f0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.689 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-04-25T02:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 -- 172.21.15.137:0/1276413737 shutdown_connections 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 --2- 172.21.15.137:0/1276413737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc974110910 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 --2- 172.21.15.137:0/1276413737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc974100430 0x7fc974109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 --2- 172.21.15.137:0/1276413737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 0x7fc9740ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 -- 172.21.15.137:0/1276413737 >> 172.21.15.137:0/1276413737 conn(0x7fc974076740 msgr2=0x7fc9740fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 -- 172.21.15.137:0/1276413737 shutdown_connections 2024-04-25T02:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.682+0000 7fc97ae00640 1 -- 172.21.15.137:0/1276413737 wait complete. 2024-04-25T02:11:25.691 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-04-25T02:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 Processor -- start 2024-04-25T02:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 -- start start 2024-04-25T02:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 0x7fc97419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.692 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-04-25T02:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97419eac0 0x7fc97419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc974113ee0 con 0x7fc9740ffa80 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc974113d60 con 0x7fc974109f90 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.683+0000 7fc97ae00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc974114060 con 0x7fc97419eac0 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 0x7fc97419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53630/0 (socket says 172.21.15.137:53630) 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 -- 172.21.15.137:0/953478850 learned_addr learned my addr 172.21.15.137:0/953478850 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc978e00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97419eac0 0x7fc97419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 -- 172.21.15.137:0/953478850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97419eac0 msgr2=0x7fc97419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97419eac0 0x7fc97419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 -- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 msgr2=0x7fc97419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 0x7fc97419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 -- 172.21.15.137:0/953478850 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97419f5b0 con 0x7fc974109f90 2024-04-25T02:11:25.695 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.684+0000 7fc973400640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e9c0 tx=0x7fc96000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.695 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-04-25T02:11:25.695 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.685+0000 7fc970c00640 1 -- 172.21.15.137:0/953478850 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96000ccc0 con 0x7fc974109f90 2024-04-25T02:11:25.696 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.685+0000 7fc970c00640 1 -- 172.21.15.137:0/953478850 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc960005520 con 0x7fc974109f90 2024-04-25T02:11:25.696 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.685+0000 7fc970c00640 1 -- 172.21.15.137:0/953478850 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960010690 con 0x7fc974109f90 2024-04-25T02:11:25.696 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.685+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97419f8a0 con 0x7fc974109f90 2024-04-25T02:11:25.696 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.685+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741a7090 con 0x7fc974109f90 2024-04-25T02:11:25.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-04-25T02:11:25.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-04-25T02:11:25.697 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.688+0000 7fc97db96740 1 Processor -- start 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 -- start start 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc970c00640 1 -- 172.21.15.137:0/953478850 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fc9600046c0 con 0x7fc974109f90 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 0x56413b283aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b283fe0 0x56413b2863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56413b1dcab0 con 0x56413b279720 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56413b185640 con 0x56413b283fe0 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc97db96740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56413b1d8a70 con 0x56413b278e00 2024-04-25T02:11:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc978e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b283fe0 0x56413b2863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc978e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48876/0 (socket says 172.21.15.137:48876) 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc978e00640 1 -- 172.21.15.137:0/2688387359 learned_addr learned my addr 172.21.15.137:0/2688387359 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.689+0000 7fc973e00640 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 0x56413b283aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 -- 172.21.15.137:0/2688387359 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b283fe0 msgr2=0x56413b2863d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b283fe0 0x56413b2863d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 -- 172.21.15.137:0/2688387359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 msgr2=0x56413b283aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 0x56413b283aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 -- 172.21.15.137:0/2688387359 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413aef1210 con 0x56413b278e00 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc973e00640 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 0x56413b283aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc978e00640 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc96c035000 tx=0x7fc96c0303a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9880148b9fb859a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc970c00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 0x7fc9580a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc969600640 1 -- 172.21.15.137:0/2688387359 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c030740 con 0x56413b278e00 2024-04-25T02:11:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc969600640 1 -- 172.21.15.137:0/2688387359 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc96c036040 con 0x56413b278e00 2024-04-25T02:11:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc969600640 1 -- 172.21.15.137:0/2688387359 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c004440 con 0x56413b278e00 2024-04-25T02:11:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.690+0000 7fc970c00640 1 -- 172.21.15.137:0/953478850 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc9600cf7c0 con 0x7fc974109f90 2024-04-25T02:11:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc973e00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 0x7fc9580a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-04-25T02:11:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 -- 172.21.15.137:0/2688387359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 msgr2=0x56413b2791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc96c035000 tx=0x7fc96c0303a0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 -- 172.21.15.137:0/2688387359 shutdown_connections 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b283fe0 0x56413b2863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b279720 0x56413b283aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 --2- 172.21.15.137:0/2688387359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b2791e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 -- 172.21.15.137:0/2688387359 >> 172.21.15.137:0/2688387359 conn(0x56413b275310 msgr2=0x56413b2756f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 -- 172.21.15.137:0/2688387359 shutdown_connections 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc97db96740 1 -- 172.21.15.137:0/2688387359 wait complete. 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.691+0000 7fc973e00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 0x7fc9580a52e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56413b27a3a0 tx=0x7fc964005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 -- start start 2024-04-25T02:11:25.703 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 Processor -- start 2024-04-25T02:11:25.704 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b280f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b2814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b281a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56413b286bb0 con 0x56413b278e00 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x56413b198990 con 0x56413b279720 2024-04-25T02:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.692+0000 7fc97db96740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56413b286d30 con 0x56413b283fe0 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc97db96740 10 client.0 _ll_register_callbacks cb 0x56413b19a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b280f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b2814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b280f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59572/0 (socket says 172.21.15.137:59572) 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973e00640 1 -- 172.21.15.137:0/2300038349 learned_addr learned my addr 172.21.15.137:0/2300038349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc978e00640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b281a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 -- 172.21.15.137:0/2300038349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 msgr2=0x56413b281a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b281a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 -- 172.21.15.137:0/2300038349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 msgr2=0x56413b280f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b280f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 -- 172.21.15.137:0/2300038349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413afbd620 con 0x56413b279720 2024-04-25T02:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc973400640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b2814c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ccf20 tx=0x7fc96000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5584cd56ad783e78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc95e000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:25.707 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-04-25T02:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96009b830 con 0x56413b279720 2024-04-25T02:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.693+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc9600a46d0 con 0x56413b279720 2024-04-25T02:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c036040 con 0x56413b279720 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc9600cd3b0 con 0x56413b279720 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 10 client.25784 fetch_fsmap learned FSMap version 23 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56413b292b40 con 0x56413b279720 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc96c036040 con 0x56413b279720 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fc9600b3080 con 0x56413b279720 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 10 client.25784 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 10 client.25784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 20 client.25784 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b294230 0x56413b296620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 4 client.25784 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.694+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56413b1e9ff0 con 0x56413b294230 2024-04-25T02:11:25.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-04-25T02:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.695+0000 7fc973e00640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b294230 0x56413b296620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.695+0000 7fc973e00640 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b294230 0x56413b296620 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a37d61326b8f0c server_cookie=4173b0859ec6a0d3 in_seq=0 out_seq=0 2024-04-25T02:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.695+0000 7fc95e000640 10 client.25784 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:25.710 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-04-25T02:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc95e000640 1 -- 172.21.15.137:0/2300038349 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56413b1e9ff0 con 0x56413b294230 2024-04-25T02:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc95e000640 10 client.25784 handle_command_reply: tid=0 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 client.25784 shutdown 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 msgr2=0x56413b2814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b2814c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ccf20 tx=0x7fc96000ce60 comp rx=0 tx=0).stop 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 shutdown_connections 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b294230 0x56413b296620 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b281a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b2814c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 --2- 172.21.15.137:0/2300038349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b280f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc95e000640 0 client.25784 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.696+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 >> 172.21.15.137:0/2300038349 conn(0x56413b275310 msgr2=0x56413b27b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.697+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 shutdown_connections 2024-04-25T02:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.697+0000 7fc97db96740 1 -- 172.21.15.137:0/2300038349 wait complete. 2024-04-25T02:11:25.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-04-25T02:11:25.713 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.697+0000 7fc97db96740 20 client.25784 trim_cache size 0 max 16384 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-04-25T02:11:25.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-04-25T02:11:25.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-04-25T02:11:25.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-04-25T02:11:25.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-04-25T02:11:25.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-04-25T02:11:25.717 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-04-25T02:11:25.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-04-25T02:11:25.719 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-04-25T02:11:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 Processor -- start 2024-04-25T02:11:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 -- start start 2024-04-25T02:11:25.720 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b283750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b280f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741b1f50 con 0x56413b278e00 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741af820 con 0x56413b279720 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc97db96740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ad670 con 0x56413b283fe0 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc973e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b283750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.713+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53654/0 (socket says 172.21.15.137:53654) 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 -- 172.21.15.137:0/479845235 learned_addr learned my addr 172.21.15.137:0/479845235 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc978e00640 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b280f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 -- 172.21.15.137:0/479845235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 msgr2=0x56413b280f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b280f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 -- 172.21.15.137:0/479845235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 msgr2=0x56413b283750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b283750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 -- 172.21.15.137:0/479845235 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413b27ffb0 con 0x56413b279720 2024-04-25T02:11:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc978e00640 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b280f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:25.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-04-25T02:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc973400640 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc96009b450 tx=0x7fc960004ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a71f83c77313cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc968c00640 1 -- 172.21.15.137:0/479845235 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96007e070 con 0x56413b279720 2024-04-25T02:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc968c00640 1 -- 172.21.15.137:0/479845235 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9600a00a0 con 0x56413b279720 2024-04-25T02:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.714+0000 7fc968c00640 1 -- 172.21.15.137:0/479845235 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96009b650 con 0x56413b279720 2024-04-25T02:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 -- 172.21.15.137:0/479845235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 msgr2=0x56413b28fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc96009b450 tx=0x7fc960004ba0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 -- 172.21.15.137:0/479845235 shutdown_connections 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b283fe0 0x56413b280f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28fa70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 --2- 172.21.15.137:0/479845235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b278e00 0x56413b283750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 -- 172.21.15.137:0/479845235 >> 172.21.15.137:0/479845235 conn(0x56413b275310 msgr2=0x56413b283040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 -- 172.21.15.137:0/479845235 shutdown_connections 2024-04-25T02:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.715+0000 7fc97db96740 1 -- 172.21.15.137:0/479845235 wait complete. 2024-04-25T02:11:25.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-04-25T02:11:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 -- start start 2024-04-25T02:11:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 Processor -- start 2024-04-25T02:11:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b28bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 0x56413b2890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741adce0 con 0x56413b283fe0 2024-04-25T02:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741af150 con 0x56413b279720 2024-04-25T02:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ae3b0 con 0x56413b278e00 2024-04-25T02:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.716+0000 7fc97db96740 10 client.0 _ll_register_callbacks cb 0x7fc9600056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:25.727 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-04-25T02:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b28bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc978e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 0x56413b2890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b28bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:48904/0 (socket says 172.21.15.137:48904) 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53664/0 (socket says 172.21.15.137:53664) 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973e00640 1 -- 172.21.15.137:0/2376596927 learned_addr learned my addr 172.21.15.137:0/2376596927 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 -- 172.21.15.137:0/2376596927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 msgr2=0x56413b28bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b28bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 -- 172.21.15.137:0/2376596927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 msgr2=0x56413b2890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 0x56413b2890b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 -- 172.21.15.137:0/2376596927 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413b2898e0 con 0x56413b279720 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc978e00640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 0x56413b2890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc973400640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc960098150 tx=0x7fc9600cd000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63694cef1ed0384d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc95e000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96007e050 con 0x56413b279720 2024-04-25T02:11:25.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc96009ae80 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.717+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56413b1e4340 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc96009b650 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 10 client.25790 fetch_fsmap learned FSMap version 23 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x56413b2898e0 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x56413b1e4340 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fc9600a6ce0 con 0x56413b279720 2024-04-25T02:11:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 10 client.25790 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 10 client.25790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 20 client.25790 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b2fb5e0 0x56413b2fda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 4 client.25790 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56413b1627a0 con 0x56413b2fb5e0 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.718+0000 7fc973e00640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b2fb5e0 0x56413b2fda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:25.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-04-25T02:11:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.719+0000 7fc973e00640 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b2fb5e0 0x56413b2fda00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361dc2a25f342548 server_cookie=a7fcdd04f4342bf3 in_seq=0 out_seq=0 2024-04-25T02:11:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:25.719+0000 7fc95e000640 10 client.25790 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:25.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-04-25T02:11:25.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-04-25T02:11:25.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-04-25T02:11:25.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-04-25T02:11:25.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-04-25T02:11:25.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-04-25T02:11:25.735 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-04-25T02:11:25.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-04-25T02:11:25.738 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-04-25T02:11:25.740 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-04-25T02:11:25.741 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-04-25T02:11:25.743 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-04-25T02:11:25.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-04-25T02:11:25.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-04-25T02:11:25.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-04-25T02:11:25.748 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-04-25T02:11:25.750 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-04-25T02:11:25.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-04-25T02:11:25.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-04-25T02:11:25.755 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-04-25T02:11:25.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-04-25T02:11:25.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-04-25T02:11:25.760 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-04-25T02:11:25.762 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-04-25T02:11:25.764 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-04-25T02:11:25.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-04-25T02:11:25.767 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-04-25T02:11:25.769 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-04-25T02:11:25.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-04-25T02:11:25.772 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-04-25T02:11:25.774 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-04-25T02:11:25.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-04-25T02:11:25.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-04-25T02:11:25.779 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-04-25T02:11:25.781 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-04-25T02:11:25.782 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-04-25T02:11:25.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:25 smithi137 ceph-mon[28303]: pgmap v54: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.7 MiB/s wr, 15 op/s 2024-04-25T02:11:25.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-04-25T02:11:25.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-04-25T02:11:25.788 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-04-25T02:11:25.790 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-04-25T02:11:25.791 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-04-25T02:11:25.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-04-25T02:11:25.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-04-25T02:11:25.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-04-25T02:11:25.799 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-04-25T02:11:25.801 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-04-25T02:11:25.803 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-04-25T02:11:25.805 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-04-25T02:11:25.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-04-25T02:11:25.809 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-04-25T02:11:25.811 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-04-25T02:11:25.813 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-04-25T02:11:25.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-04-25T02:11:25.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-04-25T02:11:25.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-04-25T02:11:25.822 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-04-25T02:11:25.824 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-04-25T02:11:25.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-04-25T02:11:25.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-04-25T02:11:25.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-04-25T02:11:25.833 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-04-25T02:11:25.835 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-04-25T02:11:25.837 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-04-25T02:11:25.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-04-25T02:11:25.842 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-04-25T02:11:25.844 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-04-25T02:11:25.846 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-04-25T02:11:25.848 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-04-25T02:11:25.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-04-25T02:11:25.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-04-25T02:11:25.855 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-04-25T02:11:25.857 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-04-25T02:11:25.859 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-04-25T02:11:25.861 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-04-25T02:11:25.863 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-04-25T02:11:25.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-04-25T02:11:25.867 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-04-25T02:11:25.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-04-25T02:11:25.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-04-25T02:11:25.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-04-25T02:11:25.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-04-25T02:11:25.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-04-25T02:11:25.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-04-25T02:11:25.879 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-04-25T02:11:25.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-04-25T02:11:25.882 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-04-25T02:11:25.883 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-04-25T02:11:25.885 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-04-25T02:11:25.887 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-04-25T02:11:25.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-04-25T02:11:25.890 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-04-25T02:11:25.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-04-25T02:11:25.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-04-25T02:11:25.895 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-04-25T02:11:25.897 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-04-25T02:11:25.899 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-04-25T02:11:25.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-04-25T02:11:25.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-04-25T02:11:25.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-04-25T02:11:25.906 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-04-25T02:11:25.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-04-25T02:11:25.909 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-04-25T02:11:25.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-04-25T02:11:25.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-04-25T02:11:25.913 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-04-25T02:11:25.915 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-04-25T02:11:25.917 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-04-25T02:11:25.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-04-25T02:11:25.920 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-04-25T02:11:25.922 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-04-25T02:11:25.923 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-04-25T02:11:25.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-04-25T02:11:25.926 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-04-25T02:11:25.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-04-25T02:11:25.930 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-04-25T02:11:25.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-04-25T02:11:25.933 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-04-25T02:11:25.935 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-04-25T02:11:25.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-04-25T02:11:25.937 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-04-25T02:11:25.939 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-04-25T02:11:25.941 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-04-25T02:11:25.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-04-25T02:11:25.944 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-04-25T02:11:25.945 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-04-25T02:11:25.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-04-25T02:11:25.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-04-25T02:11:25.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-04-25T02:11:25.952 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-04-25T02:11:25.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-04-25T02:11:25.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-04-25T02:11:25.956 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-04-25T02:11:25.958 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-04-25T02:11:25.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-04-25T02:11:25.961 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-04-25T02:11:25.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-04-25T02:11:25.965 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-04-25T02:11:25.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-04-25T02:11:25.968 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-04-25T02:11:25.970 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-04-25T02:11:25.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-04-25T02:11:25.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-04-25T02:11:25.975 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-04-25T02:11:25.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-04-25T02:11:25.978 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-04-25T02:11:25.980 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-04-25T02:11:25.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-04-25T02:11:25.983 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-04-25T02:11:25.985 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-04-25T02:11:25.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-04-25T02:11:25.988 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-04-25T02:11:25.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-04-25T02:11:25.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-04-25T02:11:25.993 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-04-25T02:11:25.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-04-25T02:11:25.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-04-25T02:11:25.998 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-04-25T02:11:25.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-04-25T02:11:26.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-04-25T02:11:26.002 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-04-25T02:11:26.004 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-04-25T02:11:26.006 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-04-25T02:11:26.007 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-04-25T02:11:26.009 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-04-25T02:11:26.011 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-04-25T02:11:26.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-04-25T02:11:26.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-04-25T02:11:26.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-04-25T02:11:26.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-04-25T02:11:26.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-04-25T02:11:26.021 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-04-25T02:11:26.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-04-25T02:11:26.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-04-25T02:11:26.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-04-25T02:11:26.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-04-25T02:11:26.030 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-04-25T02:11:26.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-04-25T02:11:26.033 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-04-25T02:11:26.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-04-25T02:11:26.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-04-25T02:11:26.039 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-04-25T02:11:26.041 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-04-25T02:11:26.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-04-25T02:11:26.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-04-25T02:11:26.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-04-25T02:11:26.049 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-04-25T02:11:26.051 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-04-25T02:11:26.054 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-04-25T02:11:26.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-04-25T02:11:26.057 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-04-25T02:11:26.059 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-04-25T02:11:26.061 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-04-25T02:11:26.063 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-04-25T02:11:26.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-04-25T02:11:26.067 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-04-25T02:11:26.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-04-25T02:11:26.071 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-04-25T02:11:26.073 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-04-25T02:11:26.076 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-04-25T02:11:26.077 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-04-25T02:11:26.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-04-25T02:11:26.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-04-25T02:11:26.084 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-04-25T02:11:26.087 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-04-25T02:11:26.089 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-04-25T02:11:26.092 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-04-25T02:11:26.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-04-25T02:11:26.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-04-25T02:11:26.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-04-25T02:11:26.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-04-25T02:11:26.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-04-25T02:11:26.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-04-25T02:11:26.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-04-25T02:11:26.109 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-04-25T02:11:26.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-04-25T02:11:26.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-04-25T02:11:26.115 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-04-25T02:11:26.118 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-04-25T02:11:26.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-04-25T02:11:26.123 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-04-25T02:11:26.125 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-04-25T02:11:26.127 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-04-25T02:11:26.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-04-25T02:11:26.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-04-25T02:11:26.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-04-25T02:11:26.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-04-25T02:11:26.137 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-04-25T02:11:26.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-04-25T02:11:26.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-04-25T02:11:26.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-04-25T02:11:26.146 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-04-25T02:11:26.148 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-04-25T02:11:26.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-04-25T02:11:26.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-04-25T02:11:26.154 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-04-25T02:11:26.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-04-25T02:11:26.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-04-25T02:11:26.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-04-25T02:11:26.165 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-04-25T02:11:26.167 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-04-25T02:11:26.169 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-04-25T02:11:26.171 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-04-25T02:11:26.173 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-04-25T02:11:26.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-04-25T02:11:26.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-04-25T02:11:26.179 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-04-25T02:11:26.181 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-04-25T02:11:26.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-04-25T02:11:26.184 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-04-25T02:11:26.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-04-25T02:11:26.189 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-04-25T02:11:26.191 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-04-25T02:11:26.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-04-25T02:11:26.195 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-04-25T02:11:26.198 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-04-25T02:11:26.200 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-04-25T02:11:26.202 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-04-25T02:11:26.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-04-25T02:11:26.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-04-25T02:11:26.209 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-04-25T02:11:26.211 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-04-25T02:11:26.214 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-04-25T02:11:26.216 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-04-25T02:11:26.218 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-04-25T02:11:26.220 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-04-25T02:11:26.295 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-04-25T02:11:26.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-04-25T02:11:26.316 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-04-25T02:11:26.323 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-04-25T02:11:26.329 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-04-25T02:11:26.338 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-04-25T02:11:26.345 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-04-25T02:11:26.354 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-04-25T02:11:26.361 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-04-25T02:11:26.365 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-04-25T02:11:26.370 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-04-25T02:11:26.372 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-04-25T02:11:26.375 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-04-25T02:11:26.380 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-04-25T02:11:26.388 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-04-25T02:11:26.394 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-04-25T02:11:26.398 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-04-25T02:11:26.401 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-04-25T02:11:26.411 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-04-25T02:11:26.416 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-04-25T02:11:26.419 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-04-25T02:11:26.423 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-04-25T02:11:26.427 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-04-25T02:11:26.432 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-04-25T02:11:26.435 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-04-25T02:11:26.440 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-04-25T02:11:26.443 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-04-25T02:11:26.447 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-04-25T02:11:26.448 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-04-25T02:11:26.452 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-04-25T02:11:26.454 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-04-25T02:11:26.457 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-04-25T02:11:26.459 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-04-25T02:11:26.463 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-04-25T02:11:26.465 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-04-25T02:11:26.467 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-04-25T02:11:26.469 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-04-25T02:11:26.472 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-04-25T02:11:26.474 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-04-25T02:11:26.475 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-04-25T02:11:26.477 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-04-25T02:11:26.478 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-04-25T02:11:26.480 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-04-25T02:11:26.481 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-04-25T02:11:26.484 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-04-25T02:11:26.488 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-04-25T02:11:26.491 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-04-25T02:11:26.492 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-04-25T02:11:26.495 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-04-25T02:11:26.496 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-04-25T02:11:26.497 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-04-25T02:11:26.499 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-04-25T02:11:26.503 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-04-25T02:11:26.504 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-04-25T02:11:26.508 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-04-25T02:11:26.510 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-04-25T02:11:26.511 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-04-25T02:11:26.514 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-04-25T02:11:26.515 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-04-25T02:11:26.517 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-04-25T02:11:26.518 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-04-25T02:11:26.521 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-04-25T02:11:26.522 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-04-25T02:11:26.524 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-04-25T02:11:26.525 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-04-25T02:11:26.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-04-25T02:11:26.528 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-04-25T02:11:26.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-04-25T02:11:26.531 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-04-25T02:11:26.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-04-25T02:11:26.533 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-04-25T02:11:26.535 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-04-25T02:11:26.536 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-04-25T02:11:26.537 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-04-25T02:11:26.539 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-04-25T02:11:26.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-04-25T02:11:26.541 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-04-25T02:11:26.552 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-04-25T02:11:26.559 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-04-25T02:11:26.560 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-04-25T02:11:26.562 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-04-25T02:11:26.564 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-04-25T02:11:26.565 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-04-25T02:11:26.567 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-04-25T02:11:26.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-04-25T02:11:26.570 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-04-25T02:11:26.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-04-25T02:11:26.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-04-25T02:11:26.575 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-04-25T02:11:26.576 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-04-25T02:11:26.578 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-04-25T02:11:26.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-04-25T02:11:26.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-04-25T02:11:26.582 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-04-25T02:11:26.583 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-04-25T02:11:26.585 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-04-25T02:11:26.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-04-25T02:11:26.588 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-04-25T02:11:26.589 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-04-25T02:11:26.591 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-04-25T02:11:26.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-04-25T02:11:26.593 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-04-25T02:11:26.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-04-25T02:11:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.589+0000 7fc95e000640 1 -- 172.21.15.137:0/2376596927 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56413b1627a0 con 0x56413b2fb5e0 2024-04-25T02:11:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.589+0000 7fc95e000640 10 client.25790 handle_command_reply: tid=0 2024-04-25T02:11:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 client.25790 shutdown 2024-04-25T02:11:26.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 msgr2=0x56413b28c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc960098150 tx=0x7fc9600cd000 comp rx=0 tx=0).stop 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 shutdown_connections 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x56413b2fb5e0 0x56413b2fda00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56413b283fe0 0x56413b2890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56413b279720 0x56413b28c4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 --2- 172.21.15.137:0/2376596927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56413b278e00 0x56413b28bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc95e000640 0 client.25790 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 >> 172.21.15.137:0/2376596927 conn(0x56413b275310 msgr2=0x56413b283040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 shutdown_connections 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 1 -- 172.21.15.137:0/2376596927 wait complete. 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.590+0000 7fc97db96740 20 client.25790 trim_cache size 0 max 16384 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:11:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:11:26.599 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 msgr2=0x7fc9580a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 0x7fc9580a52e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56413b27a3a0 tx=0x7fc964005f90 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 msgr2=0x7fc97419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc96000e9c0 tx=0x7fc96000ee80 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 shutdown_connections 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc9580a2e20 0x7fc9580a52e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc97419eac0 0x7fc97419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc974109f90 0x7fc97419a740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 --2- 172.21.15.137:0/953478850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9740ffa80 0x7fc97419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.591+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 >> 172.21.15.137:0/953478850 conn(0x7fc974076740 msgr2=0x7fc974109620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.592+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 shutdown_connections 2024-04-25T02:11:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:26.592+0000 7fc97ae00640 1 -- 172.21.15.137:0/953478850 wait complete. 2024-04-25T02:11:26.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-04-25T02:11:26.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-04-25T02:11:26.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-04-25T02:11:26.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-04-25T02:11:26.603 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-04-25T02:11:26.603 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-04-25T02:11:26.605 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-04-25T02:11:26.606 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-04-25T02:11:26.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-04-25T02:11:26.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-04-25T02:11:26.609 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-04-25T02:11:26.609 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-04-25T02:11:26.610 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-04-25T02:11:26.611 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-04-25T02:11:26.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-04-25T02:11:26.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-04-25T02:11:26.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-04-25T02:11:26.615 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-04-25T02:11:26.617 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-04-25T02:11:26.617 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-04-25T02:11:26.619 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-04-25T02:11:26.620 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-04-25T02:11:26.621 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-04-25T02:11:26.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-04-25T02:11:26.624 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-04-25T02:11:26.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-04-25T02:11:26.626 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-04-25T02:11:26.627 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-04-25T02:11:26.629 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-04-25T02:11:26.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-04-25T02:11:26.631 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-04-25T02:11:26.633 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-04-25T02:11:26.634 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-04-25T02:11:26.635 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-04-25T02:11:26.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-04-25T02:11:26.638 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-04-25T02:11:26.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-04-25T02:11:26.640 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-04-25T02:11:26.642 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-04-25T02:11:26.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-04-25T02:11:26.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-04-25T02:11:26.645 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-04-25T02:11:26.646 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-04-25T02:11:26.648 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-04-25T02:11:26.649 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-04-25T02:11:26.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-04-25T02:11:26.651 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-04-25T02:11:26.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-04-25T02:11:26.654 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-04-25T02:11:26.656 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-04-25T02:11:26.658 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-04-25T02:11:26.659 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-04-25T02:11:26.660 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-04-25T02:11:26.661 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-04-25T02:11:26.663 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-04-25T02:11:26.664 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-04-25T02:11:26.666 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-04-25T02:11:26.667 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-04-25T02:11:26.668 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-04-25T02:11:26.670 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-04-25T02:11:26.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-04-25T02:11:26.672 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-04-25T02:11:26.674 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-04-25T02:11:26.676 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-04-25T02:11:26.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-04-25T02:11:26.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-04-25T02:11:26.680 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-04-25T02:11:26.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-04-25T02:11:26.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-04-25T02:11:26.684 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-04-25T02:11:26.686 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-04-25T02:11:26.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-04-25T02:11:26.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-04-25T02:11:26.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-04-25T02:11:26.691 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-04-25T02:11:26.693 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-04-25T02:11:26.695 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-04-25T02:11:26.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-04-25T02:11:26.697 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-04-25T02:11:26.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-04-25T02:11:26.700 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-04-25T02:11:26.702 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-04-25T02:11:26.704 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-04-25T02:11:26.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-04-25T02:11:26.707 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-04-25T02:11:26.708 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-04-25T02:11:26.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-04-25T02:11:26.711 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-04-25T02:11:26.712 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-04-25T02:11:26.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-04-25T02:11:26.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-04-25T02:11:26.717 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-04-25T02:11:26.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-04-25T02:11:26.720 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-04-25T02:11:26.722 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-04-25T02:11:26.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-04-25T02:11:26.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-04-25T02:11:26.726 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-04-25T02:11:26.728 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-04-25T02:11:26.729 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-04-25T02:11:26.731 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-04-25T02:11:26.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-04-25T02:11:26.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-04-25T02:11:26.736 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-04-25T02:11:26.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-04-25T02:11:26.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-04-25T02:11:26.741 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-04-25T02:11:26.742 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-04-25T02:11:26.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-04-25T02:11:26.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-04-25T02:11:26.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-04-25T02:11:26.749 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-04-25T02:11:26.750 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-04-25T02:11:26.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-04-25T02:11:26.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-04-25T02:11:26.755 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-04-25T02:11:26.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-04-25T02:11:26.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-04-25T02:11:26.760 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-04-25T02:11:26.762 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-04-25T02:11:26.763 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-04-25T02:11:26.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-04-25T02:11:26.767 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-04-25T02:11:26.768 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-04-25T02:11:26.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-04-25T02:11:26.772 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-04-25T02:11:26.773 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-04-25T02:11:26.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-04-25T02:11:26.776 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-04-25T02:11:26.778 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-04-25T02:11:26.779 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-04-25T02:11:26.781 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-04-25T02:11:26.782 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-04-25T02:11:26.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-04-25T02:11:26.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-04-25T02:11:26.787 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-04-25T02:11:26.789 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-04-25T02:11:26.790 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-04-25T02:11:26.792 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-04-25T02:11:26.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-04-25T02:11:26.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-04-25T02:11:26.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-04-25T02:11:26.798 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-04-25T02:11:26.800 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-04-25T02:11:26.801 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-04-25T02:11:26.803 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-04-25T02:11:26.804 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-04-25T02:11:26.806 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-04-25T02:11:26.808 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-04-25T02:11:26.809 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-04-25T02:11:26.811 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-04-25T02:11:26.812 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-04-25T02:11:26.814 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-04-25T02:11:26.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-04-25T02:11:26.817 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-04-25T02:11:26.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-04-25T02:11:26.822 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-04-25T02:11:26.824 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-04-25T02:11:26.827 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-04-25T02:11:26.829 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-04-25T02:11:26.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-04-25T02:11:26.833 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-04-25T02:11:26.835 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-04-25T02:11:26.837 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-04-25T02:11:26.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-04-25T02:11:26.841 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-04-25T02:11:26.843 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-04-25T02:11:26.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-04-25T02:11:26.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-04-25T02:11:26.849 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-04-25T02:11:26.851 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-04-25T02:11:26.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-04-25T02:11:26.855 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-04-25T02:11:26.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-04-25T02:11:26.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-04-25T02:11:26.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-04-25T02:11:26.864 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-04-25T02:11:26.865 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-04-25T02:11:26.867 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-04-25T02:11:26.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-04-25T02:11:26.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-04-25T02:11:26.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-04-25T02:11:26.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-04-25T02:11:26.878 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-04-25T02:11:26.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-04-25T02:11:26.883 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-04-25T02:11:26.885 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-04-25T02:11:26.887 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-04-25T02:11:26.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-04-25T02:11:26.891 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-04-25T02:11:26.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-04-25T02:11:26.896 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-04-25T02:11:26.899 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-04-25T02:11:26.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-04-25T02:11:26.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-04-25T02:11:26.906 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-04-25T02:11:26.908 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-04-25T02:11:26.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-04-25T02:11:26.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-04-25T02:11:26.914 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-04-25T02:11:26.917 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-04-25T02:11:26.919 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-04-25T02:11:26.921 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-04-25T02:11:26.923 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-04-25T02:11:26.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-04-25T02:11:26.927 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-04-25T02:11:26.929 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-04-25T02:11:26.932 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-04-25T02:11:26.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-04-25T02:11:26.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-04-25T02:11:26.938 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-04-25T02:11:26.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-04-25T02:11:26.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-04-25T02:11:26.944 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-04-25T02:11:26.946 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-04-25T02:11:26.949 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-04-25T02:11:26.951 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-04-25T02:11:26.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-04-25T02:11:26.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-04-25T02:11:26.958 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-04-25T02:11:26.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-04-25T02:11:26.962 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-04-25T02:11:26.964 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-04-25T02:11:26.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-04-25T02:11:26.969 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-04-25T02:11:26.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-04-25T02:11:26.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-04-25T02:11:26.975 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-04-25T02:11:26.977 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-04-25T02:11:26.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-04-25T02:11:26.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-04-25T02:11:26.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-04-25T02:11:26.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-04-25T02:11:26.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-04-25T02:11:26.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-04-25T02:11:26.993 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-04-25T02:11:26.995 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-04-25T02:11:26.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-04-25T02:11:26.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-04-25T02:11:27.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-04-25T02:11:27.003 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-04-25T02:11:27.005 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-04-25T02:11:27.007 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-04-25T02:11:27.009 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-04-25T02:11:27.011 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-04-25T02:11:27.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-04-25T02:11:27.015 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-04-25T02:11:27.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-04-25T02:11:27.020 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-04-25T02:11:27.022 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-04-25T02:11:27.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-04-25T02:11:27.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-04-25T02:11:27.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-04-25T02:11:27.029 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-04-25T02:11:27.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-04-25T02:11:27.033 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-04-25T02:11:27.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-04-25T02:11:27.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-04-25T02:11:27.039 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-04-25T02:11:27.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-04-25T02:11:27.044 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-04-25T02:11:27.046 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-04-25T02:11:27.048 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-04-25T02:11:27.051 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-04-25T02:11:27.053 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-04-25T02:11:27.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-04-25T02:11:27.058 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-04-25T02:11:27.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-04-25T02:11:27.062 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-04-25T02:11:27.064 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-04-25T02:11:27.067 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-04-25T02:11:27.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-04-25T02:11:27.071 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-04-25T02:11:27.073 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-04-25T02:11:27.075 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-04-25T02:11:27.077 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-04-25T02:11:27.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-04-25T02:11:27.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-04-25T02:11:27.084 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-04-25T02:11:27.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-04-25T02:11:27.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-04-25T02:11:27.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-04-25T02:11:27.093 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-04-25T02:11:27.095 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-04-25T02:11:27.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-04-25T02:11:27.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-04-25T02:11:27.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-04-25T02:11:27.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-04-25T02:11:27.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-04-25T02:11:27.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-04-25T02:11:27.110 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-04-25T02:11:27.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-04-25T02:11:27.115 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-04-25T02:11:27.117 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-04-25T02:11:27.120 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-04-25T02:11:27.122 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-04-25T02:11:27.124 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-04-25T02:11:27.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-04-25T02:11:27.128 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-04-25T02:11:27.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-04-25T02:11:27.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-04-25T02:11:27.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-04-25T02:11:27.138 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-04-25T02:11:27.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-04-25T02:11:27.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-04-25T02:11:27.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-04-25T02:11:27.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-04-25T02:11:27.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-04-25T02:11:27.151 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-04-25T02:11:27.153 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-04-25T02:11:27.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-04-25T02:11:27.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-04-25T02:11:27.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-04-25T02:11:27.162 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-04-25T02:11:27.164 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-04-25T02:11:27.166 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-04-25T02:11:27.169 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-04-25T02:11:27.171 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-04-25T02:11:27.173 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-04-25T02:11:27.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-04-25T02:11:27.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-04-25T02:11:27.179 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-04-25T02:11:27.181 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-04-25T02:11:27.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-04-25T02:11:27.186 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-04-25T02:11:27.188 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-04-25T02:11:27.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-04-25T02:11:27.192 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-04-25T02:11:27.194 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-04-25T02:11:27.196 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-04-25T02:11:27.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-04-25T02:11:27.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-04-25T02:11:27.203 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-04-25T02:11:27.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-04-25T02:11:27.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-04-25T02:11:27.209 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-04-25T02:11:27.211 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-04-25T02:11:27.213 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-04-25T02:11:27.216 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-04-25T02:11:27.218 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-04-25T02:11:27.220 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-04-25T02:11:27.222 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-04-25T02:11:27.224 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-04-25T02:11:27.226 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-04-25T02:11:27.228 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-04-25T02:11:27.230 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-04-25T02:11:27.233 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-04-25T02:11:27.235 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-04-25T02:11:27.237 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-04-25T02:11:27.239 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-04-25T02:11:27.241 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-04-25T02:11:27.243 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-04-25T02:11:27.245 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-04-25T02:11:27.248 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-04-25T02:11:27.249 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-04-25T02:11:27.252 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-04-25T02:11:27.254 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-04-25T02:11:27.255 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-04-25T02:11:27.257 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-04-25T02:11:27.258 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-04-25T02:11:27.260 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-04-25T02:11:27.261 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-04-25T02:11:27.263 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-04-25T02:11:27.265 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-04-25T02:11:27.266 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-04-25T02:11:27.268 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-04-25T02:11:27.269 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-04-25T02:11:27.271 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-04-25T02:11:27.272 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-04-25T02:11:27.274 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-04-25T02:11:27.276 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-04-25T02:11:27.277 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-04-25T02:11:27.279 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-04-25T02:11:27.281 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-04-25T02:11:27.282 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-04-25T02:11:27.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-04-25T02:11:27.286 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-04-25T02:11:27.287 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-04-25T02:11:27.289 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-04-25T02:11:27.290 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-04-25T02:11:27.292 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-04-25T02:11:27.294 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-04-25T02:11:27.295 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-04-25T02:11:27.297 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-04-25T02:11:27.298 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-04-25T02:11:27.300 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-04-25T02:11:27.302 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-04-25T02:11:27.303 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-04-25T02:11:27.305 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-04-25T02:11:27.307 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-04-25T02:11:27.308 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-04-25T02:11:27.310 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-04-25T02:11:27.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-04-25T02:11:27.313 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-04-25T02:11:27.314 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-04-25T02:11:27.316 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-04-25T02:11:27.318 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-04-25T02:11:27.319 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-04-25T02:11:27.321 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-04-25T02:11:27.323 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-04-25T02:11:27.324 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-04-25T02:11:27.326 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-04-25T02:11:27.328 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-04-25T02:11:27.329 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-04-25T02:11:27.331 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-04-25T02:11:27.332 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-04-25T02:11:27.334 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-04-25T02:11:27.336 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-04-25T02:11:27.337 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-04-25T02:11:27.339 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-04-25T02:11:27.340 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-04-25T02:11:27.342 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-04-25T02:11:27.344 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-04-25T02:11:27.345 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-04-25T02:11:27.347 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-04-25T02:11:27.349 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-04-25T02:11:27.350 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-04-25T02:11:27.352 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-04-25T02:11:27.353 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-04-25T02:11:27.355 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-04-25T02:11:27.357 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-04-25T02:11:27.358 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-04-25T02:11:27.360 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-04-25T02:11:27.364 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-04-25T02:11:27.385 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-04-25T02:11:27.399 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-04-25T02:11:27.408 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-04-25T02:11:27.411 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-04-25T02:11:27.414 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-04-25T02:11:27.416 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-04-25T02:11:27.418 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-04-25T02:11:27.420 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-04-25T02:11:27.422 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-04-25T02:11:27.424 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-04-25T02:11:27.426 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-04-25T02:11:27.428 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-04-25T02:11:27.430 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-04-25T02:11:27.432 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-04-25T02:11:27.434 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-04-25T02:11:27.435 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-04-25T02:11:27.437 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-04-25T02:11:27.439 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-04-25T02:11:27.441 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-04-25T02:11:27.443 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-04-25T02:11:27.445 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-04-25T02:11:27.447 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-04-25T02:11:27.450 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-04-25T02:11:27.454 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-04-25T02:11:27.455 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-04-25T02:11:27.457 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-04-25T02:11:27.459 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-04-25T02:11:27.462 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-04-25T02:11:27.465 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-04-25T02:11:27.467 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-04-25T02:11:27.469 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-04-25T02:11:27.472 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-04-25T02:11:27.474 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-04-25T02:11:27.477 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-04-25T02:11:27.479 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-04-25T02:11:27.481 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-04-25T02:11:27.483 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-04-25T02:11:27.485 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-04-25T02:11:27.487 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-04-25T02:11:27.489 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-04-25T02:11:27.491 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-04-25T02:11:27.493 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-04-25T02:11:27.495 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-04-25T02:11:27.497 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-04-25T02:11:27.499 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-04-25T02:11:27.501 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-04-25T02:11:27.504 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-04-25T02:11:27.506 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-04-25T02:11:27.508 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-04-25T02:11:27.510 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-04-25T02:11:27.512 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-04-25T02:11:27.514 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-04-25T02:11:27.516 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-04-25T02:11:27.518 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-04-25T02:11:27.519 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-04-25T02:11:27.523 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-04-25T02:11:27.525 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-04-25T02:11:27.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-04-25T02:11:27.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-04-25T02:11:27.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-04-25T02:11:27.534 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-04-25T02:11:27.536 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-04-25T02:11:27.538 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-04-25T02:11:27.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-04-25T02:11:27.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-04-25T02:11:27.544 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-04-25T02:11:27.546 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-04-25T02:11:27.548 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-04-25T02:11:27.550 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-04-25T02:11:27.552 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-04-25T02:11:27.555 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-04-25T02:11:27.557 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-04-25T02:11:27.559 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-04-25T02:11:27.561 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-04-25T02:11:27.563 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-04-25T02:11:27.565 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-04-25T02:11:27.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-04-25T02:11:27.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-04-25T02:11:27.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-04-25T02:11:27.576 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-04-25T02:11:27.583 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-04-25T02:11:27.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-04-25T02:11:27.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-04-25T02:11:27.588 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-04-25T02:11:27.590 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-04-25T02:11:27.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-04-25T02:11:27.593 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-04-25T02:11:27.594 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-04-25T02:11:27.596 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-04-25T02:11:27.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-04-25T02:11:27.599 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-04-25T02:11:27.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-04-25T02:11:27.602 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-04-25T02:11:27.604 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-04-25T02:11:27.605 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-04-25T02:11:27.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-04-25T02:11:27.608 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-04-25T02:11:27.610 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-04-25T02:11:27.612 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-04-25T02:11:27.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-04-25T02:11:27.615 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-04-25T02:11:27.617 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-04-25T02:11:27.618 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-04-25T02:11:27.620 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-04-25T02:11:27.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-04-25T02:11:27.623 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-04-25T02:11:27.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-04-25T02:11:27.626 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-04-25T02:11:27.628 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-04-25T02:11:27.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-04-25T02:11:27.632 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-04-25T02:11:27.633 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-04-25T02:11:27.635 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-04-25T02:11:27.637 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-04-25T02:11:27.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-04-25T02:11:27.640 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-04-25T02:11:27.642 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-04-25T02:11:27.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:27 smithi163 ceph-mon[32577]: pgmap v55: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-04-25T02:11:27.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-04-25T02:11:27.645 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-04-25T02:11:27.647 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-04-25T02:11:27.648 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-04-25T02:11:27.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-04-25T02:11:27.652 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-04-25T02:11:27.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-04-25T02:11:27.655 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-04-25T02:11:27.657 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-04-25T02:11:27.658 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-04-25T02:11:27.661 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-04-25T02:11:27.662 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-04-25T02:11:27.664 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-04-25T02:11:27.666 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-04-25T02:11:27.667 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-04-25T02:11:27.669 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-04-25T02:11:27.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:11:27.670 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:11:27.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/digsig.txt 2024-04-25T02:11:27.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-04-25T02:11:27.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-04-25T02:11:27.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-04-25T02:11:27.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-04-25T02:11:27.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:27 smithi174 ceph-mon[33171]: pgmap v55: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-04-25T02:11:27.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-04-25T02:11:27.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-04-25T02:11:27.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dontdiff 2024-04-25T02:11:27.685 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/ 2024-04-25T02:11:27.686 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-04-25T02:11:27.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-04-25T02:11:27.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-04-25T02:11:27.691 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-04-25T02:11:27.693 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-04-25T02:11:27.695 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-04-25T02:11:27.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-04-25T02:11:27.698 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-04-25T02:11:27.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-04-25T02:11:27.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-04-25T02:11:27.703 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/ 2024-04-25T02:11:27.704 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-04-25T02:11:27.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-04-25T02:11:27.708 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-04-25T02:11:27.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-04-25T02:11:27.711 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-04-25T02:11:27.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-04-25T02:11:27.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-04-25T02:11:27.716 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-04-25T02:11:27.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-04-25T02:11:27.719 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-04-25T02:11:27.721 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-04-25T02:11:27.722 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-04-25T02:11:27.724 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-04-25T02:11:27.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-04-25T02:11:27.727 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-04-25T02:11:27.728 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-04-25T02:11:27.729 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-04-25T02:11:27.731 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-04-25T02:11:27.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/edac.txt 2024-04-25T02:11:27.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-04-25T02:11:27.735 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/eisa.txt 2024-04-25T02:11:27.736 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-04-25T02:11:27.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/extcon/ 2024-04-25T02:11:27.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-04-25T02:11:27.740 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-04-25T02:11:27.741 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-04-25T02:11:27.743 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-04-25T02:11:27.743 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:27 smithi137 ceph-mon[28303]: pgmap v55: 97 pgs: 97 active+clean; 58 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.7 MiB/s wr, 9 op/s 2024-04-25T02:11:27.744 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-04-25T02:11:27.745 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/ 2024-04-25T02:11:27.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-04-25T02:11:27.747 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-04-25T02:11:27.749 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-04-25T02:11:27.750 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-04-25T02:11:27.751 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-04-25T02:11:27.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-04-25T02:11:27.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-04-25T02:11:27.755 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-04-25T02:11:27.756 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-04-25T02:11:27.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-04-25T02:11:27.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-04-25T02:11:27.761 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-04-25T02:11:27.763 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-04-25T02:11:27.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-04-25T02:11:27.766 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-04-25T02:11:27.768 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-04-25T02:11:27.770 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-04-25T02:11:27.771 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-04-25T02:11:27.773 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-04-25T02:11:27.774 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-04-25T02:11:27.776 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-04-25T02:11:27.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-04-25T02:11:27.779 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-04-25T02:11:27.781 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-04-25T02:11:27.782 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-04-25T02:11:27.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-04-25T02:11:27.786 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-04-25T02:11:27.787 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-04-25T02:11:27.789 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-04-25T02:11:27.790 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-04-25T02:11:27.792 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-04-25T02:11:27.794 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-04-25T02:11:27.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-04-25T02:11:27.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-04-25T02:11:27.798 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-04-25T02:11:27.800 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ 2024-04-25T02:11:27.801 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-04-25T02:11:27.803 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-04-25T02:11:27.804 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-04-25T02:11:27.806 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-04-25T02:11:27.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-04-25T02:11:27.809 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-04-25T02:11:27.811 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-04-25T02:11:27.812 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-04-25T02:11:27.814 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-04-25T02:11:27.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-04-25T02:11:27.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-04-25T02:11:27.819 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-04-25T02:11:27.821 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-04-25T02:11:27.823 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-04-25T02:11:27.825 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-04-25T02:11:27.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-04-25T02:11:27.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-04-25T02:11:27.830 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-04-25T02:11:27.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-04-25T02:11:27.833 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-04-25T02:11:27.835 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-04-25T02:11:27.836 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-04-25T02:11:27.838 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-04-25T02:11:27.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-04-25T02:11:27.840 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-04-25T02:11:27.842 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-04-25T02:11:27.844 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-04-25T02:11:27.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-04-25T02:11:27.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-04-25T02:11:27.848 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-04-25T02:11:27.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-04-25T02:11:27.851 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-04-25T02:11:27.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-04-25T02:11:27.854 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-04-25T02:11:27.856 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-04-25T02:11:27.857 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-04-25T02:11:27.859 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-04-25T02:11:27.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-04-25T02:11:27.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-04-25T02:11:27.863 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-04-25T02:11:27.865 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-04-25T02:11:27.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-04-25T02:11:27.868 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-04-25T02:11:27.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-04-25T02:11:27.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-04-25T02:11:27.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-04-25T02:11:27.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-04-25T02:11:27.875 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-04-25T02:11:27.876 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-04-25T02:11:27.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 -- 172.21.15.137:0/1976044762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21881020d0 msgr2=0x7f218810e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 --2- 172.21.15.137:0/1976044762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21881020d0 0x7f218810e5e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2180009900 tx=0x7f218002a410 comp rx=0 tx=0).stop 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 -- 172.21.15.137:0/1976044762 shutdown_connections 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 --2- 172.21.15.137:0/1976044762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f21881020d0 0x7f218810e5e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 --2- 172.21.15.137:0/1976044762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188101710 0x7f2188101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 --2- 172.21.15.137:0/1976044762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2188107720 0x7f2188107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.871+0000 7f2190400640 1 -- 172.21.15.137:0/1976044762 >> 172.21.15.137:0/1976044762 conn(0x7f2188078b90 msgr2=0x7f2188078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.872+0000 7f2190400640 1 -- 172.21.15.137:0/1976044762 shutdown_connections 2024-04-25T02:11:27.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.872+0000 7f2190400640 1 -- 172.21.15.137:0/1976044762 wait complete. 2024-04-25T02:11:27.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-04-25T02:11:27.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 Processor -- start 2024-04-25T02:11:27.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 -- start start 2024-04-25T02:11:27.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-04-25T02:11:27.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21881020d0 0x7f218819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188107720 0x7f218819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2188111ca0 con 0x7f21881020d0 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2188111b20 con 0x7f2188101710 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f2190400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2188111e20 con 0x7f2188107720 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.873+0000 7f218da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53680/0 (socket says 172.21.15.137:53680) 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 -- 172.21.15.137:0/3856884474 learned_addr learned my addr 172.21.15.137:0/3856884474 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218d000640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21881020d0 0x7f218819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218e400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188107720 0x7f218819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 -- 172.21.15.137:0/3856884474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188107720 msgr2=0x7f218819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188107720 0x7f218819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 -- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21881020d0 msgr2=0x7f218819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21881020d0 0x7f218819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 -- 172.21.15.137:0/3856884474 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218819f260 con 0x7f2188101710 2024-04-25T02:11:27.883 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f218da00640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ebc0 tx=0x7f217c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.874+0000 7f2186000640 1 -- 172.21.15.137:0/3856884474 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c010630 con 0x7f2188101710 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.875+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218819f550 con 0x7f2188101710 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.875+0000 7f2186000640 1 -- 172.21.15.137:0/3856884474 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f217c010cd0 con 0x7f2188101710 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.875+0000 7f2186000640 1 -- 172.21.15.137:0/3856884474 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c018cf0 con 0x7f2188101710 2024-04-25T02:11:27.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.875+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21881a6de0 con 0x7f2188101710 2024-04-25T02:11:27.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-04-25T02:11:27.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-04-25T02:11:27.885 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-04-25T02:11:27.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f2186000640 1 -- 172.21.15.137:0/3856884474 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f217c0107d0 con 0x7f2188101710 2024-04-25T02:11:27.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 Processor -- start 2024-04-25T02:11:27.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 -- start start 2024-04-25T02:11:27.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.886 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-04-25T02:11:27.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e9e8524560 con 0x55e9e85caff0 2024-04-25T02:11:27.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e9e84cc930 con 0x55e9e85c0000 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f21931b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e9e8520520 con 0x55e9e85c0920 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f218e400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f218e400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53682/0 (socket says 172.21.15.137:53682) 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f218d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f218da00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.879+0000 7f218e400640 1 -- 172.21.15.137:0/646219970 learned_addr learned my addr 172.21.15.137:0/646219970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 -- 172.21.15.137:0/646219970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 msgr2=0x55e9e85caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 -- 172.21.15.137:0/646219970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 msgr2=0x55e9e85cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 -- 172.21.15.137:0/646219970 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e83027d0 con 0x55e9e85c0000 2024-04-25T02:11:27.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218d000640 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:27.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f218e400640 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f218002aa00 tx=0x7f2180005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8715d0fd3a19a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.880+0000 7f2186000640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 0x7f21700a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f2186000640 1 -- 172.21.15.137:0/3856884474 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f217c0cfa70 con 0x7f2188101710 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f217aa00640 1 -- 172.21.15.137:0/646219970 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180040070 con 0x55e9e85c0000 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f217aa00640 1 -- 172.21.15.137:0/646219970 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2180004380 con 0x55e9e85c0000 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f217aa00640 1 -- 172.21.15.137:0/646219970 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180035040 con 0x55e9e85c0000 2024-04-25T02:11:27.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f218da00640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 0x7f21700a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.890 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f21931b1740 1 -- 172.21.15.137:0/646219970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 msgr2=0x55e9e85c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f218da00640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 0x7f21700a51c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e9e85c15c0 tx=0x7f217c0d3560 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.881+0000 7f21931b1740 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f218002aa00 tx=0x7f2180005c00 comp rx=0 tx=0).stop 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 -- 172.21.15.137:0/646219970 shutdown_connections 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 --2- 172.21.15.137:0/646219970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85c03e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 -- 172.21.15.137:0/646219970 >> 172.21.15.137:0/646219970 conn(0x55e9e85bc320 msgr2=0x55e9e85bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 -- 172.21.15.137:0/646219970 shutdown_connections 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 -- 172.21.15.137:0/646219970 wait complete. 2024-04-25T02:11:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 -- start start 2024-04-25T02:11:27.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.882+0000 7f21931b1740 1 Processor -- start 2024-04-25T02:11:27.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85caff0 0x55e9e85c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e9e85cdd80 con 0x55e9e85c0000 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e9e84dfd90 con 0x55e9e85caff0 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e9e85cdf00 con 0x55e9e85c0920 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f21931b1740 10 client.0 _ll_register_callbacks cb 0x55e9e84df780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f218e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f218e400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59616/0 (socket says 172.21.15.137:59616) 2024-04-25T02:11:27.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f218e400640 1 -- 172.21.15.137:0/133659815 learned_addr learned my addr 172.21.15.137:0/133659815 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:27.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f218e400640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85caff0 0x55e9e85c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.883+0000 7f218d000640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 -- 172.21.15.137:0/133659815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 msgr2=0x55e9e85c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 -- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85caff0 msgr2=0x55e9e85c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85caff0 0x55e9e85c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 -- 172.21.15.137:0/133659815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e82383f0 con 0x55e9e85c0000 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218d000640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f218e400640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2180003760 tx=0x7f2180003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1a258ad4c7cb5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f216f400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180035070 con 0x55e9e85c0000 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2180003da0 con 0x55e9e85c0000 2024-04-25T02:11:27.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.884+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2180004380 con 0x55e9e85c0000 2024-04-25T02:11:27.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2180040070 con 0x55e9e85c0000 2024-04-25T02:11:27.896 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 10 client.15729 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e9e81f80f0 con 0x55e9e85c0000 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2180004380 con 0x55e9e85c0000 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f21800457d0 con 0x55e9e85c0000 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 10 client.15729 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 20 client.15729 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e85db180 0x55e9e85dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 4 client.15729 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.885+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9e8537d90 con 0x55e9e85db180 2024-04-25T02:11:27.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.886+0000 7f218d000640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e85db180 0x55e9e85dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.898 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-04-25T02:11:27.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.886+0000 7f218d000640 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e85db180 0x55e9e85dd570 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc1fc3e52283dfa server_cookie=aa371cbfe7a74b4a in_seq=0 out_seq=0 2024-04-25T02:11:27.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.886+0000 7f216f400640 10 client.15729 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:27.898 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-04-25T02:11:27.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.887+0000 7f216f400640 1 -- 172.21.15.137:0/133659815 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9e8537d90 con 0x55e9e85db180 2024-04-25T02:11:27.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.887+0000 7f216f400640 10 client.15729 handle_command_reply: tid=0 2024-04-25T02:11:27.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 client.15729 shutdown 2024-04-25T02:11:27.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 msgr2=0x55e9e85c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2180003760 tx=0x7f2180003860 comp rx=0 tx=0).stop 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 shutdown_connections 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e85db180 0x55e9e85dd570 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85caff0 0x55e9e85c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 --2- 172.21.15.137:0/133659815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85c0000 0x55e9e85c7f70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 >> 172.21.15.137:0/133659815 conn(0x55e9e85bc320 msgr2=0x55e9e85c2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f216f400640 0 client.15729 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:27.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 shutdown_connections 2024-04-25T02:11:27.900 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-04-25T02:11:27.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 1 -- 172.21.15.137:0/133659815 wait complete. 2024-04-25T02:11:27.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.888+0000 7f21931b1740 20 client.15729 trim_cache size 0 max 16384 2024-04-25T02:11:27.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-04-25T02:11:27.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-04-25T02:11:27.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-04-25T02:11:27.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-04-25T02:11:27.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-04-25T02:11:27.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-04-25T02:11:27.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-04-25T02:11:27.903 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-04-25T02:11:27.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-04-25T02:11:27.905 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-04-25T02:11:27.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-04-25T02:11:27.908 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-04-25T02:11:27.909 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-04-25T02:11:27.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-04-25T02:11:27.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-04-25T02:11:27.913 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-04-25T02:11:27.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 Processor -- start 2024-04-25T02:11:27.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 -- start start 2024-04-25T02:11:27.915 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-04-25T02:11:27.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f21881b1ef0 con 0x55e9e85caff0 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f21881af7c0 con 0x55e9e85c0000 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.908+0000 7f21931b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f21881ad610 con 0x55e9e85c0920 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53700/0 (socket says 172.21.15.137:53700) 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 -- 172.21.15.137:0/3768263321 learned_addr learned my addr 172.21.15.137:0/3768263321 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218d000640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 -- 172.21.15.137:0/3768263321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 msgr2=0x55e9e85e2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85e2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 -- 172.21.15.137:0/3768263321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 msgr2=0x55e9e85e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218e400640 1 -- 172.21.15.137:0/3768263321 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e85bd0b0 con 0x55e9e85c0000 2024-04-25T02:11:27.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.909+0000 7f218d000640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:27.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.910+0000 7f218e400640 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f218002a450 tx=0x7f2180005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9cd276a30b93bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.910+0000 7f217a000640 1 -- 172.21.15.137:0/3768263321 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218005f040 con 0x55e9e85c0000 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.910+0000 7f217a000640 1 -- 172.21.15.137:0/3768263321 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2180045960 con 0x55e9e85c0000 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.910+0000 7f217a000640 1 -- 172.21.15.137:0/3768263321 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180035040 con 0x55e9e85c0000 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- 172.21.15.137:0/3768263321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 msgr2=0x55e9e85d6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f218002a450 tx=0x7f2180005c00 comp rx=0 tx=0).stop 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- 172.21.15.137:0/3768263321 shutdown_connections 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0920 0x55e9e85e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 --2- 172.21.15.137:0/3768263321 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0000 0x55e9e85d6c40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- 172.21.15.137:0/3768263321 >> 172.21.15.137:0/3768263321 conn(0x55e9e85bc320 msgr2=0x55e9e85c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- 172.21.15.137:0/3768263321 shutdown_connections 2024-04-25T02:11:27.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- 172.21.15.137:0/3768263321 wait complete. 2024-04-25T02:11:27.920 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 -- start start 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.911+0000 7f21931b1740 1 Processor -- start 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 0x55e9e8639720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f21881adc80 con 0x55e9e85caff0 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f21881af0f0 con 0x55e9e85c0920 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f21881ae350 con 0x55e9e85c0000 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f21931b1740 10 client.0 _ll_register_callbacks cb 0x7f2180004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:27.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.921 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53714/0 (socket says 172.21.15.137:53714) 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 -- 172.21.15.137:0/3201240267 learned_addr learned my addr 172.21.15.137:0/3201240267 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218e400640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 0x55e9e8639720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218e400640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 -- 172.21.15.137:0/3201240267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 msgr2=0x55e9e8639720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 0x55e9e8639720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 -- 172.21.15.137:0/3201240267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 msgr2=0x55e9e85ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218d000640 1 -- 172.21.15.137:0/3201240267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e85cebc0 con 0x55e9e85c0920 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.912+0000 7f218e400640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 0x55e9e8639720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f218d000640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e9e85c77d0 tx=0x7f217400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad9569442210f8e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f216f400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740200e0 con 0x55e9e85c0920 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2174020280 con 0x55e9e85c0920 2024-04-25T02:11:27.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2180045960 con 0x55e9e85c0920 2024-04-25T02:11:27.924 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2174030050 con 0x55e9e85c0920 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f21931b1740 10 client.25808 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.913+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e9e8640f60 con 0x55e9e85c0920 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2180045960 con 0x55e9e85c0920 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f217401e400 con 0x55e9e85c0920 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 10 client.25808 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 10 client.25808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 20 client.25808 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e8641770 0x55e9e8643b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 4 client.25808 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e9e8531aa0 con 0x55e9e8641770 2024-04-25T02:11:27.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.914+0000 7f218e400640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e8641770 0x55e9e8643b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:27.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-04-25T02:11:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.915+0000 7f218e400640 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e8641770 0x55e9e8643b90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=317dfac6c5bf0897 server_cookie=a0c4a8589b00a52e in_seq=0 out_seq=0 2024-04-25T02:11:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.915+0000 7f216f400640 10 client.25808 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.915+0000 7f216f400640 1 -- 172.21.15.137:0/3201240267 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e9e8531aa0 con 0x55e9e8641770 2024-04-25T02:11:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.915+0000 7f216f400640 10 client.25808 handle_command_reply: tid=0 2024-04-25T02:11:27.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.915+0000 7f21931b1740 1 client.25808 shutdown 2024-04-25T02:11:27.927 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-04-25T02:11:27.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 msgr2=0x55e9e8639c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e9e85c77d0 tx=0x7f217400bf40 comp rx=0 tx=0).stop 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 shutdown_connections 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e9e8641770 0x55e9e8643b90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e9e85caff0 0x55e9e85ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e9e85c0920 0x55e9e8639c60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f216f400640 0 client.25808 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 --2- 172.21.15.137:0/3201240267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e9e85c0000 0x55e9e8639720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 >> 172.21.15.137:0/3201240267 conn(0x55e9e85bc320 msgr2=0x55e9e85c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 shutdown_connections 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 1 -- 172.21.15.137:0/3201240267 wait complete. 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.916+0000 7f21931b1740 20 client.25808 trim_cache size 0 max 16384 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:11:27.928 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-25T02:11:27.929 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-25T02:11:27.929 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:11:27.929 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-04-25T02:11:27.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 msgr2=0x7f21700a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 0x7f21700a51c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e9e85c15c0 tx=0x7f217c0d3560 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 msgr2=0x7f218819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ebc0 tx=0x7f217c00c6a0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 shutdown_connections 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21700a2d00 0x7f21700a51c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2188107720 0x7f218819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f21881020d0 0x7f218819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 --2- 172.21.15.137:0/3856884474 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2188101710 0x7f218819a270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 >> 172.21.15.137:0/3856884474 conn(0x7f2188078b90 msgr2=0x7f218810ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 shutdown_connections 2024-04-25T02:11:27.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:27.917+0000 7f2190400640 1 -- 172.21.15.137:0/3856884474 wait complete. 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-04-25T02:11:27.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-04-25T02:11:27.932 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-04-25T02:11:27.933 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-04-25T02:11:27.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-04-25T02:11:27.935 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-04-25T02:11:27.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-04-25T02:11:27.937 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-04-25T02:11:27.939 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-04-25T02:11:27.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-04-25T02:11:27.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:11:27.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:11:27.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-04-25T02:11:27.943 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-04-25T02:11:27.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-04-25T02:11:27.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-04-25T02:11:27.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-04-25T02:11:27.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-04-25T02:11:27.949 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-04-25T02:11:27.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-04-25T02:11:27.951 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-04-25T02:11:27.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-04-25T02:11:27.954 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-04-25T02:11:27.958 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-04-25T02:11:27.959 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-04-25T02:11:27.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-04-25T02:11:27.961 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-04-25T02:11:27.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/ 2024-04-25T02:11:27.964 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-04-25T02:11:27.965 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-04-25T02:11:27.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-04-25T02:11:27.967 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-04-25T02:11:27.968 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-04-25T02:11:27.969 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-04-25T02:11:27.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-04-25T02:11:27.972 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-04-25T02:11:27.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-04-25T02:11:27.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-04-25T02:11:27.975 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-04-25T02:11:27.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/ 2024-04-25T02:11:27.977 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-04-25T02:11:27.978 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-04-25T02:11:27.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-04-25T02:11:27.980 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-04-25T02:11:27.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-04-25T02:11:27.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-04-25T02:11:27.983 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-04-25T02:11:27.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-04-25T02:11:27.985 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-04-25T02:11:27.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-04-25T02:11:27.988 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-04-25T02:11:27.988 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gcov.txt 2024-04-25T02:11:27.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-04-25T02:11:27.990 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/ 2024-04-25T02:11:27.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-04-25T02:11:27.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-04-25T02:11:27.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-04-25T02:11:27.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-04-25T02:11:27.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-04-25T02:11:27.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-04-25T02:11:27.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-04-25T02:11:27.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/ 2024-04-25T02:11:28.000 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-04-25T02:11:28.002 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-04-25T02:11:28.003 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-04-25T02:11:28.005 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-04-25T02:11:28.007 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-04-25T02:11:28.010 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/highuid.txt 2024-04-25T02:11:28.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hsi.txt 2024-04-25T02:11:28.013 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-04-25T02:11:28.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ 2024-04-25T02:11:28.015 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-04-25T02:11:28.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-04-25T02:11:28.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-04-25T02:11:28.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-04-25T02:11:28.020 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-04-25T02:11:28.021 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-04-25T02:11:28.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-04-25T02:11:28.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-04-25T02:11:28.025 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-04-25T02:11:28.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-04-25T02:11:28.027 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-04-25T02:11:28.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-04-25T02:11:28.030 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-04-25T02:11:28.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-04-25T02:11:28.032 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-04-25T02:11:28.034 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-04-25T02:11:28.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-04-25T02:11:28.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-04-25T02:11:28.039 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-04-25T02:11:28.041 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-04-25T02:11:28.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-04-25T02:11:28.044 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-04-25T02:11:28.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-04-25T02:11:28.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-04-25T02:11:28.048 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-04-25T02:11:28.050 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-04-25T02:11:28.052 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-04-25T02:11:28.053 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-04-25T02:11:28.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-04-25T02:11:28.056 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-04-25T02:11:28.058 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-04-25T02:11:28.059 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-04-25T02:11:28.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-04-25T02:11:28.062 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-04-25T02:11:28.064 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-04-25T02:11:28.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-04-25T02:11:28.067 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-04-25T02:11:28.068 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-04-25T02:11:28.070 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-04-25T02:11:28.072 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-04-25T02:11:28.073 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-04-25T02:11:28.074 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-04-25T02:11:28.076 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-04-25T02:11:28.078 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-04-25T02:11:28.079 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-04-25T02:11:28.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-04-25T02:11:28.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-04-25T02:11:28.083 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-04-25T02:11:28.085 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-04-25T02:11:28.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-04-25T02:11:28.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-04-25T02:11:28.089 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-04-25T02:11:28.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-04-25T02:11:28.092 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-04-25T02:11:28.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-04-25T02:11:28.095 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-04-25T02:11:28.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-04-25T02:11:28.098 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-04-25T02:11:28.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-04-25T02:11:28.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-04-25T02:11:28.103 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-04-25T02:11:28.105 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-04-25T02:11:28.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-04-25T02:11:28.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-04-25T02:11:28.110 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-04-25T02:11:28.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-04-25T02:11:28.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-04-25T02:11:28.114 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-04-25T02:11:28.116 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-04-25T02:11:28.117 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-04-25T02:11:28.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-04-25T02:11:28.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-04-25T02:11:28.122 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-04-25T02:11:28.124 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-04-25T02:11:28.125 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-04-25T02:11:28.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-04-25T02:11:28.128 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-04-25T02:11:28.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-04-25T02:11:28.130 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-04-25T02:11:28.132 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-04-25T02:11:28.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-04-25T02:11:28.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-04-25T02:11:28.137 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-04-25T02:11:28.138 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-04-25T02:11:28.139 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-04-25T02:11:28.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 -- 172.21.15.137:0/3920369668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635810dc50 msgr2=0x7f635810e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 --2- 172.21.15.137:0/3920369668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635810dc50 0x7f635810e030 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6350009900 tx=0x7f635002a480 comp rx=0 tx=0).stop 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 -- 172.21.15.137:0/3920369668 shutdown_connections 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 --2- 172.21.15.137:0/3920369668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6358108580 0x7f63581149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 --2- 172.21.15.137:0/3920369668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 0x7f6358108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 --2- 172.21.15.137:0/3920369668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f635810dc50 0x7f635810e030 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 -- 172.21.15.137:0/3920369668 >> 172.21.15.137:0/3920369668 conn(0x7f63580772c0 msgr2=0x7f63580796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 -- 172.21.15.137:0/3920369668 shutdown_connections 2024-04-25T02:11:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.134+0000 7f6357e00640 1 -- 172.21.15.137:0/3920369668 wait complete. 2024-04-25T02:11:28.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 Processor -- start 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 -- start start 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 0x7f635819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 0x7f635819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63581180a0 con 0x7f6358107be0 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f6358117f20 con 0x7f635810dc50 2024-04-25T02:11:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.135+0000 7f6357e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6358118220 con 0x7f6358108580 2024-04-25T02:11:28.143 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6356a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 0x7f635819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53734/0 (socket says 172.21.15.137:53734) 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 -- 172.21.15.137:0/1672236097 learned_addr learned my addr 172.21.15.137:0/1672236097 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6356000640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 0x7f635819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 -- 172.21.15.137:0/1672236097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 msgr2=0x7f635819e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 0x7f635819e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 -- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 msgr2=0x7f635819e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 0x7f635819e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 -- 172.21.15.137:0/1672236097 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63581a3470 con 0x7f635810dc50 2024-04-25T02:11:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6356000640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 0x7f635819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.136+0000 7f6357400640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f634800efd0 tx=0x7f634800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.145 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.137+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348003b70 con 0x7f635810dc50 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.137+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6348003d10 con 0x7f635810dc50 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.137+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63581a3760 con 0x7f635810dc50 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.137+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348010a90 con 0x7f635810dc50 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.137+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63581aaff0 con 0x7f635810dc50 2024-04-25T02:11:28.146 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-04-25T02:11:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.138+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63580688d0 con 0x7f635810dc50 2024-04-25T02:11:28.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-04-25T02:11:28.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-04-25T02:11:28.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.140+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f6348004020 con 0x7f635810dc50 2024-04-25T02:11:28.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-04-25T02:11:28.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.141+0000 7f634f400640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 0x7f633c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.148 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-04-25T02:11:28.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.142+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f63480cf820 con 0x7f635810dc50 2024-04-25T02:11:28.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.142+0000 7f6356a00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 0x7f633c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.142+0000 7f6356a00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 0x7f633c0a5240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f6350005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-04-25T02:11:28.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-04-25T02:11:28.151 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-04-25T02:11:28.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-04-25T02:11:28.154 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-04-25T02:11:28.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.148+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f634809c410 con 0x7f635810dc50 2024-04-25T02:11:28.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-04-25T02:11:28.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-04-25T02:11:28.158 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-04-25T02:11:28.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-04-25T02:11:28.161 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-04-25T02:11:28.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-04-25T02:11:28.165 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-04-25T02:11:28.166 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-04-25T02:11:28.168 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-04-25T02:11:28.169 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-04-25T02:11:28.171 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-04-25T02:11:28.173 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-04-25T02:11:28.174 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-04-25T02:11:28.176 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-04-25T02:11:28.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-04-25T02:11:28.179 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-04-25T02:11:28.180 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-04-25T02:11:28.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-04-25T02:11:28.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-04-25T02:11:28.184 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-04-25T02:11:28.185 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-04-25T02:11:28.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-04-25T02:11:28.189 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-04-25T02:11:28.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-04-25T02:11:28.191 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-04-25T02:11:28.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-04-25T02:11:28.194 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-04-25T02:11:28.195 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-04-25T02:11:28.197 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-04-25T02:11:28.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-04-25T02:11:28.200 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-04-25T02:11:28.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-04-25T02:11:28.202 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-04-25T02:11:28.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-04-25T02:11:28.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-04-25T02:11:28.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-04-25T02:11:28.208 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-04-25T02:11:28.209 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-04-25T02:11:28.211 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/ 2024-04-25T02:11:28.212 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-04-25T02:11:28.214 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-04-25T02:11:28.215 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-04-25T02:11:28.216 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-04-25T02:11:28.218 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-04-25T02:11:28.219 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-04-25T02:11:28.221 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-04-25T02:11:28.223 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-04-25T02:11:28.224 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-04-25T02:11:28.226 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-04-25T02:11:28.227 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-04-25T02:11:28.229 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-04-25T02:11:28.230 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-04-25T02:11:28.232 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-04-25T02:11:28.233 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-04-25T02:11:28.235 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-04-25T02:11:28.236 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-04-25T02:11:28.238 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-04-25T02:11:28.239 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-04-25T02:11:28.241 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-04-25T02:11:28.242 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-04-25T02:11:28.243 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-04-25T02:11:28.245 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-04-25T02:11:28.246 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-04-25T02:11:28.248 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-04-25T02:11:28.249 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-04-25T02:11:28.251 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-04-25T02:11:28.253 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-04-25T02:11:28.254 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-04-25T02:11:28.256 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-04-25T02:11:28.257 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-04-25T02:11:28.259 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-04-25T02:11:28.260 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/summary 2024-04-25T02:11:28.262 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-04-25T02:11:28.263 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-04-25T02:11:28.265 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-04-25T02:11:28.267 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2o/ 2024-04-25T02:11:28.268 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2o/README 2024-04-25T02:11:28.269 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-04-25T02:11:28.271 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/ 2024-04-25T02:11:28.272 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-04-25T02:11:28.274 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-04-25T02:11:28.275 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-04-25T02:11:28.277 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/README 2024-04-25T02:11:28.278 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-04-25T02:11:28.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.399+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63581ab2f0 con 0x7f635810dc50 2024-04-25T02:11:28.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.400+0000 7f634f400640 1 -- 172.21.15.137:0/1672236097 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11887 (secure 0 0 0) 0x7f634809bd10 con 0x7f635810dc50 2024-04-25T02:11:28.408 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:11:28.408 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:11:26.813850+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:11:28.408 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 24 2024-04-25T02:11:28.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 msgr2=0x7f633c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 0x7f633c0a5240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f6350005e80 comp rx=0 tx=0).stop 2024-04-25T02:11:28.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 msgr2=0x7f63581a2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f634800efd0 tx=0x7f634800c6a0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 shutdown_connections 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f633c0a2d80 0x7f633c0a5240 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f635810dc50 0x7f63581a2d40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6358108580 0x7f635819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 --2- 172.21.15.137:0/1672236097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6358107be0 0x7f635819e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.403+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 >> 172.21.15.137:0/1672236097 conn(0x7f63580772c0 msgr2=0x7f6358078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.404+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 shutdown_connections 2024-04-25T02:11:28.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.404+0000 7f6357e00640 1 -- 172.21.15.137:0/1672236097 wait complete. 2024-04-25T02:11:28.429 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T02:11:28.490 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-04-25T02:11:28.491 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-04-25T02:11:28.493 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-04-25T02:11:28.495 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-04-25T02:11:28.497 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-04-25T02:11:28.499 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-04-25T02:11:28.500 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-04-25T02:11:28.502 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ 2024-04-25T02:11:28.503 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-04-25T02:11:28.505 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-04-25T02:11:28.507 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-04-25T02:11:28.508 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-04-25T02:11:28.509 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-04-25T02:11:28.511 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-04-25T02:11:28.512 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-04-25T02:11:28.513 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/ 2024-04-25T02:11:28.515 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-04-25T02:11:28.516 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-04-25T02:11:28.517 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-04-25T02:11:28.519 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-04-25T02:11:28.520 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-04-25T02:11:28.521 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/init.txt 2024-04-25T02:11:28.522 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/initrd.txt 2024-04-25T02:11:28.524 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/ 2024-04-25T02:11:28.525 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-04-25T02:11:28.526 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-04-25T02:11:28.527 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-04-25T02:11:28.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-04-25T02:11:28.530 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-04-25T02:11:28.531 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-04-25T02:11:28.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-04-25T02:11:28.534 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-04-25T02:11:28.535 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-04-25T02:11:28.536 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-04-25T02:11:28.537 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-04-25T02:11:28.538 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-04-25T02:11:28.539 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-04-25T02:11:28.541 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-04-25T02:11:28.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-04-25T02:11:28.544 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-04-25T02:11:28.545 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-04-25T02:11:28.547 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/input.txt 2024-04-25T02:11:28.548 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-04-25T02:11:28.550 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-04-25T02:11:28.551 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-04-25T02:11:28.552 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-04-25T02:11:28.554 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-04-25T02:11:28.555 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-04-25T02:11:28.556 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-04-25T02:11:28.557 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-04-25T02:11:28.559 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-04-25T02:11:28.560 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-04-25T02:11:28.564 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-04-25T02:11:28.566 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-04-25T02:11:28.567 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-04-25T02:11:28.568 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-04-25T02:11:28.570 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-04-25T02:11:28.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-04-25T02:11:28.572 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/ 2024-04-25T02:11:28.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-04-25T02:11:28.574 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-04-25T02:11:28.575 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-04-25T02:11:28.577 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-04-25T02:11:28.578 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-04-25T02:11:28.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-04-25T02:11:28.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/iostats.txt 2024-04-25T02:11:28.582 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-04-25T02:11:28.583 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-04-25T02:11:28.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/ 2024-04-25T02:11:28.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-04-25T02:11:28.587 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-04-25T02:11:28.588 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-04-25T02:11:28.589 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-04-25T02:11:28.591 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-04-25T02:11:28.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-04-25T02:11:28.594 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README 2024-04-25T02:11:28.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-04-25T02:11:28.596 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-04-25T02:11:28.598 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-04-25T02:11:28.599 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-04-25T02:11:28.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-04-25T02:11:28.602 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-04-25T02:11:28.604 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-04-25T02:11:28.605 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-04-25T02:11:28.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-04-25T02:11:28.608 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-04-25T02:11:28.610 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-04-25T02:11:28.611 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-04-25T02:11:28.613 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-04-25T02:11:28.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-04-25T02:11:28.616 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-04-25T02:11:28.617 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-04-25T02:11:28.619 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-04-25T02:11:28.620 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-04-25T02:11:28.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-04-25T02:11:28.623 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-04-25T02:11:28.625 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-04-25T02:11:28.627 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-04-25T02:11:28.628 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-04-25T02:11:28.630 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-04-25T02:11:28.632 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/java.txt 2024-04-25T02:11:28.634 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kasan.txt 2024-04-25T02:11:28.635 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/ 2024-04-25T02:11:28.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-04-25T02:11:28.638 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-04-25T02:11:28.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-04-25T02:11:28.641 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-04-25T02:11:28.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:28 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:28.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-04-25T02:11:28.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-04-25T02:11:28.646 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-04-25T02:11:28.647 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kdump/ 2024-04-25T02:11:28.648 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-04-25T02:11:28.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-04-25T02:11:28.651 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-04-25T02:11:28.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-04-25T02:11:28.655 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-04-25T02:11:28.660 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-04-25T02:11:28.663 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-04-25T02:11:28.669 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-04-25T02:11:28.670 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-04-25T02:11:28.672 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-04-25T02:11:28.673 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-04-25T02:11:28.674 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kobject.txt 2024-04-25T02:11:28.676 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-04-25T02:11:28.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kref.txt 2024-04-25T02:11:28.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:28 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:28.678 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-04-25T02:11:28.680 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/ 2024-04-25T02:11:28.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-04-25T02:11:28.682 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-04-25T02:11:28.683 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-04-25T02:11:28.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 -- 172.21.15.137:0/1085485592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c1015e0 msgr2=0x7fda0c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 --2- 172.21.15.137:0/1085485592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c1015e0 0x7fda0c101a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009ca0 tx=0x7fd9f402a8c0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 -- 172.21.15.137:0/1085485592 shutdown_connections 2024-04-25T02:11:28.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 --2- 172.21.15.137:0/1085485592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c101fa0 0x7fda0c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 --2- 172.21.15.137:0/1085485592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c1015e0 0x7fda0c101a60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 --2- 172.21.15.137:0/1085485592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c107680 0x7fda0c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 -- 172.21.15.137:0/1085485592 >> 172.21.15.137:0/1085485592 conn(0x7fda0c0fd110 msgr2=0x7fda0c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 -- 172.21.15.137:0/1085485592 shutdown_connections 2024-04-25T02:11:28.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.677+0000 7fda11e00640 1 -- 172.21.15.137:0/1085485592 wait complete. 2024-04-25T02:11:28.685 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.678+0000 7fda11e00640 1 Processor -- start 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.678+0000 7fda11e00640 1 -- start start 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.678+0000 7fda11e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c1015e0 0x7fda0c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 0x7fda0c0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111b70 con 0x7fda0c1015e0 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1119f0 con 0x7fda0c101fa0 2024-04-25T02:11:28.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c111cf0 con 0x7fda0c107680 2024-04-25T02:11:28.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-04-25T02:11:28.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda10a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c1015e0 0x7fda0c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53746/0 (socket says 172.21.15.137:53746) 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 -- 172.21.15.137:0/315994809 learned_addr learned my addr 172.21.15.137:0/315994809 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11400640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 0x7fda0c0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 -- 172.21.15.137:0/315994809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 msgr2=0x7fda0c0744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 0x7fda0c0744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 -- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c1015e0 msgr2=0x7fda0c073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c1015e0 0x7fda0c073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda0be00640 1 -- 172.21.15.137:0/315994809 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c1a6450 con 0x7fda0c101fa0 2024-04-25T02:11:28.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.679+0000 7fda11400640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 0x7fda0c0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:28.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-04-25T02:11:28.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda0be00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005e30 tx=0x7fd9f4003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda09600640 1 -- 172.21.15.137:0/315994809 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4031650 con 0x7fda0c101fa0 2024-04-25T02:11:28.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda09600640 1 -- 172.21.15.137:0/315994809 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9f40317f0 con 0x7fda0c101fa0 2024-04-25T02:11:28.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c1a66e0 con 0x7fda0c101fa0 2024-04-25T02:11:28.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda09600640 1 -- 172.21.15.137:0/315994809 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f402fb50 con 0x7fda0c101fa0 2024-04-25T02:11:28.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.680+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c1a6c80 con 0x7fda0c101fa0 2024-04-25T02:11:28.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-04-25T02:11:28.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-04-25T02:11:28.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-04-25T02:11:28.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.683+0000 7fda09600640 1 -- 172.21.15.137:0/315994809 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fd9f402fcf0 con 0x7fda0c101fa0 2024-04-25T02:11:28.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.683+0000 7fda1624d740 1 Processor -- start 2024-04-25T02:11:28.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 -- start start 2024-04-25T02:11:28.691 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-04-25T02:11:28.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef6db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef7ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb3eed24e0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55fb3ee7aa70 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda1624d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb3eece4a0 con 0x55fb3ef78790 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda10a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda10a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53762/0 (socket says 172.21.15.137:53762) 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda10a00640 1 -- 172.21.15.137:0/1635705560 learned_addr learned my addr 172.21.15.137:0/1635705560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda11400640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef6db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.684+0000 7fda0be00640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef7ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 -- 172.21.15.137:0/1635705560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 msgr2=0x55fb3ef7ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef7ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 -- 172.21.15.137:0/1635705560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 msgr2=0x55fb3ef6db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef6db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 -- 172.21.15.137:0/1635705560 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3ebe63f0 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda0be00640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef7ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:28.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda09600640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 0x7fd9ec0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda10a00640 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009c20 tx=0x7fd9fc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63491092169b2e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.694 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda09600640 1 -- 172.21.15.137:0/315994809 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd9f40f06d0 con 0x7fda0c101fa0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda01c00640 1 -- 172.21.15.137:0/1635705560 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc004220 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda01c00640 1 -- 172.21.15.137:0/1635705560 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9fc0043c0 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda01c00640 1 -- 172.21.15.137:0/1635705560 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc019860 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.685+0000 7fda11400640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 0x7fd9ec0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 -- 172.21.15.137:0/1635705560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 msgr2=0x55fb3ef78250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009c20 tx=0x7fd9fc011810 comp rx=0 tx=0).stop 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda11400640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 0x7fd9ec0a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda04009d30 tx=0x7fda04005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 -- 172.21.15.137:0/1635705560 shutdown_connections 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef7ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef78250 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 --2- 172.21.15.137:0/1635705560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef6db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 -- 172.21.15.137:0/1635705560 >> 172.21.15.137:0/1635705560 conn(0x55fb3ef69ac0 msgr2=0x55fb3ef69ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 -- 172.21.15.137:0/1635705560 shutdown_connections 2024-04-25T02:11:28.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.686+0000 7fda1624d740 1 -- 172.21.15.137:0/1635705560 wait complete. 2024-04-25T02:11:28.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-04-25T02:11:28.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.687+0000 7fda1624d740 1 -- start start 2024-04-25T02:11:28.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.687+0000 7fda1624d740 1 Processor -- start 2024-04-25T02:11:28.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ldm.txt 2024-04-25T02:11:28.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef75c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55fb3ef7b580 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55fb3ee8dec0 con 0x55fb3ef78790 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb3ef7b700 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda1624d740 10 client.0 _ll_register_callbacks cb 0x55fb3eeca3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda11400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda10a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda11400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53764/0 (socket says 172.21.15.137:53764) 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda0be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef75c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.688+0000 7fda11400640 1 -- 172.21.15.137:0/1936988683 learned_addr learned my addr 172.21.15.137:0/1936988683 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 -- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 msgr2=0x55fb3ef75c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef75c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 -- 172.21.15.137:0/1936988683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 msgr2=0x55fb3ef756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 -- 172.21.15.137:0/1936988683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3ecb07d0 con 0x55fb3ef78790 2024-04-25T02:11:28.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda0be00640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef75c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:28.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/ 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda11400640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda040209c0 tx=0x7fda04004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0d090687684e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fd9fa000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0402d060 con 0x55fb3ef78790 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9fc0043c0 con 0x55fb3ef78790 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fda04018030 con 0x55fb3ef78790 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fda040119c0 con 0x55fb3ef78790 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda1624d740 10 client.25826 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.689+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fb3ef878b0 con 0x55fb3ef78790 2024-04-25T02:11:28.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9fc0043c0 con 0x55fb3ef78790 2024-04-25T02:11:28.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-04-25T02:11:28.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fda0401d3f0 con 0x55fb3ef78790 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 10 client.25826 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 10 client.25826 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 20 client.25826 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3ef88cc0 0x55fb3ef8b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 4 client.25826 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb3eedfa20 con 0x55fb3ef88cc0 2024-04-25T02:11:28.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.690+0000 7fda10a00640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3ef88cc0 0x55fb3ef8b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.702 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-04-25T02:11:28.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.691+0000 7fda10a00640 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3ef88cc0 0x55fb3ef8b110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f50eb6e55dff7fe server_cookie=ce3705c443de5aab in_seq=0 out_seq=0 2024-04-25T02:11:28.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.691+0000 7fd9fa000640 10 client.25826 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:11:28.703 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fd9fa000640 1 -- 172.21.15.137:0/1936988683 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fb3eedfa20 con 0x55fb3ef88cc0 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fd9fa000640 10 client.25826 handle_command_reply: tid=0 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 client.25826 shutdown 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 msgr2=0x55fb3ef76150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fda040209c0 tx=0x7fda04004730 comp rx=0 tx=0).stop 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 shutdown_connections 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef78790 0x55fb3ef76150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3ef88cc0 0x55fb3ef8b110 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef75c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 --2- 172.21.15.137:0/1936988683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fd9fa000640 0 client.25826 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:11:28.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 >> 172.21.15.137:0/1936988683 conn(0x55fb3ef69ac0 msgr2=0x55fb3ef6f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 shutdown_connections 2024-04-25T02:11:28.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.692+0000 7fda1624d740 1 -- 172.21.15.137:0/1936988683 wait complete. 2024-04-25T02:11:28.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.693+0000 7fda1624d740 20 client.25826 trim_cache size 0 max 16384 2024-04-25T02:11:28.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-04-25T02:11:28.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-04-25T02:11:28.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-04-25T02:11:28.705 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-04-25T02:11:28.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-04-25T02:11:28.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-04-25T02:11:28.706 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-04-25T02:11:28.707 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-04-25T02:11:28.708 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-04-25T02:11:28.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/ 2024-04-25T02:11:28.710 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-04-25T02:11:28.711 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-04-25T02:11:28.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-04-25T02:11:28.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.707+0000 7fda1624d740 1 Processor -- start 2024-04-25T02:11:28.714 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-04-25T02:11:28.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.707+0000 7fda1624d740 1 -- start start 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.707+0000 7fda1624d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef84470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.707+0000 7fda1624d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.707+0000 7fda1624d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef909e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda1624d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1b1de0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda1624d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1af6b0 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda1624d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1ad500 con 0x55fb3ef78790 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda10a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef84470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53772/0 (socket says 172.21.15.137:53772) 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 -- 172.21.15.137:0/3167563116 learned_addr learned my addr 172.21.15.137:0/3167563116 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda11400640 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef909e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 -- 172.21.15.137:0/3167563116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 msgr2=0x55fb3ef909e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef909e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 -- 172.21.15.137:0/3167563116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 msgr2=0x55fb3ef84470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef84470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 -- 172.21.15.137:0/3167563116 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3ef63f90 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda11400640 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef909e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:28.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.708+0000 7fda0be00640 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40f0970 tx=0x7fd9f402f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73662aac23601855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.717 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda01200640 1 -- 172.21.15.137:0/3167563116 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40bd3d0 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda01200640 1 -- 172.21.15.137:0/3167563116 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9f4036040 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda01200640 1 -- 172.21.15.137:0/3167563116 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40ee070 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 -- 172.21.15.137:0/3167563116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 msgr2=0x55fb3ef6f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40f0970 tx=0x7fd9f402f610 comp rx=0 tx=0).stop 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 -- 172.21.15.137:0/3167563116 shutdown_connections 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef909e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef6f640 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 --2- 172.21.15.137:0/3167563116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef84470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 -- 172.21.15.137:0/3167563116 >> 172.21.15.137:0/3167563116 conn(0x55fb3ef69ac0 msgr2=0x55fb3ef6ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 -- 172.21.15.137:0/3167563116 shutdown_connections 2024-04-25T02:11:28.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.709+0000 7fda1624d740 1 -- 172.21.15.137:0/3167563116 wait complete. 2024-04-25T02:11:28.719 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 -- start start 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 Processor -- start 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef72f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.710+0000 7fda1624d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1adb70 con 0x55fb3ef6e0c0 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda1624d740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1aefe0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda1624d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1ae240 con 0x55fb3ef78790 2024-04-25T02:11:28.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda1624d740 10 client.0 _ll_register_callbacks cb 0x7fda040096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:28.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53782/0 (socket says 172.21.15.137:53782) 2024-04-25T02:11:28.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 -- 172.21.15.137:0/1392630165 learned_addr learned my addr 172.21.15.137:0/1392630165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda0be00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda11400640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef72f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.721 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-04-25T02:11:28.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 -- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 msgr2=0x55fb3ef72f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef72f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 -- 172.21.15.137:0/1392630165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6e0c0 msgr2=0x55fb3ef729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:28.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 -- 172.21.15.137:0/1392630165 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3efee380 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda11400640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef72f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fda10a00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009250 tx=0x7fd9fc0096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47f8338ed022231c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.711+0000 7fd9fa000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc02bd60 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fd9fc0050b0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f4036040 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd9fc039050 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fda1624d740 10 client.25832 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:28.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fb3efef5d0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.723 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd9f4036040 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.712+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd9fc0035f0 con 0x55fb3ef6d7a0 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 10 client.25832 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 10 client.25832 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 20 client.25832 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3efefc10 0x55fb3eff2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 4 client.25832 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb3eed9d70 con 0x55fb3efefc10 2024-04-25T02:11:28.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.713+0000 7fda0be00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3efefc10 0x55fb3eff2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.725 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda0be00640 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3efefc10 0x55fb3eff2030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=978578ae19585343 server_cookie=a30720d5c5df72a1 in_seq=0 out_seq=0 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fd9fa000640 10 client.25832 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fd9fa000640 1 -- 172.21.15.137:0/1392630165 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb3eed9d70 con 0x55fb3efefc10 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fd9fa000640 10 client.25832 handle_command_reply: tid=0 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 client.25832 shutdown 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 msgr2=0x55fb3ef72480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009250 tx=0x7fd9fc0096c0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 shutdown_connections 2024-04-25T02:11:28.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55fb3efefc10 0x55fb3eff2030 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb3ef78790 0x55fb3ef72f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55fb3ef6e0c0 0x55fb3ef729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 --2- 172.21.15.137:0/1392630165 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fb3ef6d7a0 0x55fb3ef72480 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fd9fa000640 0 client.25832 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 >> 172.21.15.137:0/1392630165 conn(0x55fb3ef69ac0 msgr2=0x55fb3ef6f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 shutdown_connections 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 1 -- 172.21.15.137:0/1392630165 wait complete. 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.714+0000 7fda1624d740 20 client.25832 trim_cache size 0 max 16384 2024-04-25T02:11:28.727 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-04-25T02:11:28.727 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 msgr2=0x7fd9ec0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 0x7fd9ec0a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda04009d30 tx=0x7fda04005f90 comp rx=0 tx=0).stop 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 msgr2=0x7fda0c073f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005e30 tx=0x7fd9f4003f90 comp rx=0 tx=0).stop 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 shutdown_connections 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fd9ec0a2d80 0x7fd9ec0a5240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda0c107680 0x7fda0c0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda0c101fa0 0x7fda0c073f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 --2- 172.21.15.137:0/315994809 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda0c1015e0 0x7fda0c073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 >> 172.21.15.137:0/315994809 conn(0x7fda0c0fd110 msgr2=0x7fda0c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 shutdown_connections 2024-04-25T02:11:28.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.715+0000 7fda11e00640 1 -- 172.21.15.137:0/315994809 wait complete. 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/logo.gif 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/logo.txt 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/lzo.txt 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/m68k/ 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-04-25T02:11:28.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-04-25T02:11:28.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-04-25T02:11:28.733 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-04-25T02:11:28.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/md.txt 2024-04-25T02:11:28.736 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-04-25T02:11:28.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-04-25T02:11:28.737 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:28 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:28.740 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T02:11:28.841 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-04-25T02:11:28.843 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-04-25T02:11:28.844 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-04-25T02:11:28.846 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/metag/ 2024-04-25T02:11:28.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-04-25T02:11:28.849 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-04-25T02:11:28.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/ 2024-04-25T02:11:28.851 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-04-25T02:11:28.853 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-04-25T02:11:28.854 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-04-25T02:11:28.855 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-04-25T02:11:28.856 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-04-25T02:11:28.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-04-25T02:11:28.859 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-04-25T02:11:28.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-04-25T02:11:28.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-04-25T02:11:28.863 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-04-25T02:11:28.865 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mips/ 2024-04-25T02:11:28.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-04-25T02:11:28.867 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-04-25T02:11:28.868 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-04-25T02:11:28.870 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-04-25T02:11:28.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-04-25T02:11:28.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-04-25T02:11:28.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-04-25T02:11:28.875 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-04-25T02:11:28.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-04-25T02:11:28.878 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-04-25T02:11:28.880 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-04-25T02:11:28.881 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-04-25T02:11:28.883 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-04-25T02:11:28.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-04-25T02:11:28.885 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-04-25T02:11:28.886 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-04-25T02:11:28.888 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-04-25T02:11:28.889 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-04-25T02:11:28.891 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-04-25T02:11:28.892 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-04-25T02:11:28.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-04-25T02:11:28.895 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mmc/ 2024-04-25T02:11:28.896 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-04-25T02:11:28.898 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-04-25T02:11:28.899 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-04-25T02:11:28.900 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-04-25T02:11:28.901 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mn10300/ 2024-04-25T02:11:28.903 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-04-25T02:11:28.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-04-25T02:11:28.905 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-04-25T02:11:28.907 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mono.txt 2024-04-25T02:11:28.908 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mtd/ 2024-04-25T02:11:28.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-04-25T02:11:28.911 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-04-25T02:11:28.913 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-04-25T02:11:28.914 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-04-25T02:11:28.917 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/namespaces/ 2024-04-25T02:11:28.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-04-25T02:11:28.919 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-04-25T02:11:28.921 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/ 2024-04-25T02:11:28.922 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-04-25T02:11:28.924 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-04-25T02:11:28.925 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-04-25T02:11:28.927 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-04-25T02:11:28.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-04-25T02:11:28.930 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ 2024-04-25T02:11:28.931 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-04-25T02:11:28.933 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-04-25T02:11:28.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-04-25T02:11:28.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-04-25T02:11:28.937 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-04-25T02:11:28.939 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-04-25T02:11:28.941 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-04-25T02:11:28.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-04-25T02:11:28.944 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-04-25T02:11:28.945 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-04-25T02:11:28.947 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-04-25T02:11:28.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-04-25T02:11:28.950 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-04-25T02:11:28.952 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-04-25T02:11:28.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-04-25T02:11:28.957 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-04-25T02:11:28.958 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-04-25T02:11:28.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-04-25T02:11:28.961 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-04-25T02:11:28.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-04-25T02:11:28.967 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-04-25T02:11:28.969 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-04-25T02:11:28.970 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-04-25T02:11:28.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-04-25T02:11:28.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-04-25T02:11:28.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-04-25T02:11:28.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-04-25T02:11:28.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-04-25T02:11:28.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-04-25T02:11:28.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-04-25T02:11:28.983 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-04-25T02:11:28.985 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-04-25T02:11:28.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-04-25T02:11:28.987 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-04-25T02:11:28.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-04-25T02:11:28.990 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-04-25T02:11:28.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-04-25T02:11:28.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-04-25T02:11:28.993 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 -- 172.21.15.137:0/1735741223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 msgr2=0x7f642c109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 --2- 172.21.15.137:0/1735741223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c109be0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f641c009ca0 tx=0x7f641c02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 -- 172.21.15.137:0/1735741223 shutdown_connections 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 --2- 172.21.15.137:0/1735741223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 0x7f642c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 --2- 172.21.15.137:0/1735741223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 0x7f642c103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 --2- 172.21.15.137:0/1735741223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c109be0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 -- 172.21.15.137:0/1735741223 >> 172.21.15.137:0/1735741223 conn(0x7f642c0ff280 msgr2=0x7f642c1016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:28.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 -- 172.21.15.137:0/1735741223 shutdown_connections 2024-04-25T02:11:28.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.987+0000 7f6431800640 1 -- 172.21.15.137:0/1735741223 wait complete. 2024-04-25T02:11:28.995 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-04-25T02:11:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 Processor -- start 2024-04-25T02:11:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 -- start start 2024-04-25T02:11:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 0x7f642c19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 0x7f642c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f642c113d30 con 0x7f642c1041b0 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f642c113bb0 con 0x7f642c109800 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.988+0000 7f6431800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f642c113eb0 con 0x7f642c1037f0 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53802/0 (socket says 172.21.15.137:53802) 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6423400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 0x7f642c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 -- 172.21.15.137:0/3312630820 learned_addr learned my addr 172.21.15.137:0/3312630820 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:28.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f642be00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 0x7f642c19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:28.997 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 -- 172.21.15.137:0/3312630820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 msgr2=0x7f642c19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 0x7f642c19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 -- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 msgr2=0x7f642c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 0x7f642c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 -- 172.21.15.137:0/3312630820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c19f180 con 0x7f642c109800 2024-04-25T02:11:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.989+0000 7f6430e00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f642400e970 tx=0x7f642400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.990+0000 7f6429600640 1 -- 172.21.15.137:0/3312630820 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642400ccc0 con 0x7f642c109800 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.990+0000 7f6429600640 1 -- 172.21.15.137:0/3312630820 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f642400ce60 con 0x7f642c109800 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.990+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c19f470 con 0x7f642c109800 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.990+0000 7f6429600640 1 -- 172.21.15.137:0/3312630820 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424010690 con 0x7f642c109800 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.990+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1a6d00 con 0x7f642c109800 2024-04-25T02:11:28.999 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-04-25T02:11:28.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.993+0000 7f6429600640 1 -- 172.21.15.137:0/3312630820 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f64240046c0 con 0x7f642c109800 2024-04-25T02:11:29.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.993+0000 7f6435ba9740 1 Processor -- start 2024-04-25T02:11:29.000 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-04-25T02:11:29.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.993+0000 7f6435ba9740 1 -- start start 2024-04-25T02:11:29.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe3064e0 con 0x55a5fe3a17a0 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe2aea70 con 0x55a5fe3ac790 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6435ba9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe3024a0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6423400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49012/0 (socket says 172.21.15.137:49012) 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6423400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59756/0 (socket says 172.21.15.137:59756) 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 -- 172.21.15.137:0/3020026955 learned_addr learned my addr 172.21.15.137:0/3020026955 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6423400640 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6429600640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 0x7f64100a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.003 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-04-25T02:11:29.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 -- 172.21.15.137:0/3020026955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 msgr2=0x55a5fe3aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 -- 172.21.15.137:0/3020026955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 msgr2=0x55a5fe3a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f642be00640 1 -- 172.21.15.137:0/3020026955 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fe01a3f0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.994+0000 7f6423400640 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f6429600640 1 -- 172.21.15.137:0/3312630820 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f64240cf770 con 0x7f642c109800 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f6430e00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 0x7f64100a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f642be00640 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f641c035000 tx=0x7f641c0093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2f547d9bee09c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f6421600640 1 -- 172.21.15.137:0/3020026955 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c031da0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f6421600640 1 -- 172.21.15.137:0/3020026955 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641c036030 con 0x55a5fe3a20c0 2024-04-25T02:11:29.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.995+0000 7f6421600640 1 -- 172.21.15.137:0/3020026955 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c004310 con 0x55a5fe3a20c0 2024-04-25T02:11:29.004 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-04-25T02:11:29.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 -- 172.21.15.137:0/3020026955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 msgr2=0x55a5fe3ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f641c035000 tx=0x7f641c0093f0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6430e00640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 0x7f64100a5240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64240980c0 tx=0x7f6424009310 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 -- 172.21.15.137:0/3020026955 shutdown_connections 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3ac250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3020026955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 -- 172.21.15.137:0/3020026955 >> 172.21.15.137:0/3020026955 conn(0x55a5fe39dac0 msgr2=0x55a5fe39dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 -- 172.21.15.137:0/3020026955 shutdown_connections 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.996+0000 7f6435ba9740 1 -- 172.21.15.137:0/3020026955 wait complete. 2024-04-25T02:11:29.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 -- start start 2024-04-25T02:11:29.006 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-04-25T02:11:29.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 Processor -- start 2024-04-25T02:11:29.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe3af3a0 con 0x55a5fe3ac790 2024-04-25T02:11:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe2c1ec0 con 0x55a5fe3a17a0 2024-04-25T02:11:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a5fe3af520 con 0x55a5fe3a20c0 2024-04-25T02:11:29.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.997+0000 7f6435ba9740 10 client.0 _ll_register_callbacks cb 0x55a5fe2fe3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:29.008 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f6423400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f6423400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53820/0 (socket says 172.21.15.137:53820) 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f6423400640 1 -- 172.21.15.137:0/747407693 learned_addr learned my addr 172.21.15.137:0/747407693 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f6423400640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 -- 172.21.15.137:0/747407693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 msgr2=0x55a5fe3a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 -- 172.21.15.137:0/747407693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 msgr2=0x55a5fe3aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 -- 172.21.15.137:0/747407693 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fe0e47d0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f642be00640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a9b70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f641c005e30 tx=0x7f641c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595d99c63ac06925 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.998+0000 7f641a000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:11:29.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c04a040 con 0x55a5fe3a20c0 2024-04-25T02:11:29.010 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c036030 con 0x55a5fe3a20c0 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f641c003b70 con 0x55a5fe3a20c0 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f641c003d70 con 0x55a5fe3a20c0 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f6435ba9740 10 client.25882 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:28.999+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5fe3af3a0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641c036030 con 0x55a5fe3a20c0 2024-04-25T02:11:29.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f641c04d030 con 0x55a5fe3a20c0 2024-04-25T02:11:29.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-04-25T02:11:29.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 10 client.25882 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 10 client.25882 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 20 client.25882 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe3bc740 0x55a5fe3beb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 4 client.25882 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5fe313a20 con 0x55a5fe3bc740 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.000+0000 7f6423400640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe3bc740 0x55a5fe3beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.013 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-04-25T02:11:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.001+0000 7f6423400640 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe3bc740 0x55a5fe3beb60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e0bc1fbf3abd061 server_cookie=73cd21457153ed9e in_seq=0 out_seq=0 2024-04-25T02:11:29.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.001+0000 7f641a000640 10 client.25882 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:11:29.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.002+0000 7f641a000640 1 -- 172.21.15.137:0/747407693 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5fe313a20 con 0x55a5fe3bc740 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.002+0000 7f641a000640 10 client.25882 handle_command_reply: tid=0 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.002+0000 7f6435ba9740 1 client.25882 shutdown 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.002+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 msgr2=0x55a5fe3a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.002+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a9b70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f641c005e30 tx=0x7f641c02a8c0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 shutdown_connections 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe3bc740 0x55a5fe3beb60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a9b70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 --2- 172.21.15.137:0/747407693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f641a000640 0 client.25882 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 >> 172.21.15.137:0/747407693 conn(0x55a5fe39dac0 msgr2=0x55a5fe3a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 shutdown_connections 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 1 -- 172.21.15.137:0/747407693 wait complete. 2024-04-25T02:11:29.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-04-25T02:11:29.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.003+0000 7f6435ba9740 20 client.25882 trim_cache size 0 max 16384 2024-04-25T02:11:29.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-04-25T02:11:29.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-04-25T02:11:29.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-04-25T02:11:29.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-04-25T02:11:29.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-04-25T02:11:29.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-04-25T02:11:29.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-04-25T02:11:29.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-04-25T02:11:29.018 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-04-25T02:11:29.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-04-25T02:11:29.020 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-04-25T02:11:29.022 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-04-25T02:11:29.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-04-25T02:11:29.024 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-04-25T02:11:29.025 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-04-25T02:11:29.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.018+0000 7f6435ba9740 1 Processor -- start 2024-04-25T02:11:29.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 -- start start 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1b1d10 con 0x55a5fe3ac790 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1af5e0 con 0x55a5fe3a17a0 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6435ba9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1ad430 con 0x55a5fe3a20c0 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6423400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6423400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53832/0 (socket says 172.21.15.137:53832) 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6423400640 1 -- 172.21.15.137:0/2201831205 learned_addr learned my addr 172.21.15.137:0/2201831205 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f642be00640 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.019+0000 7f6423400640 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-04-25T02:11:29.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 -- 172.21.15.137:0/2201831205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 msgr2=0x55a5fe3b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 -- 172.21.15.137:0/2201831205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 msgr2=0x55a5fe3a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 -- 172.21.15.137:0/2201831205 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5fe399410 con 0x55a5fe3a20c0 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f642be00640 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a88a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f641c009ca0 tx=0x7f641c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4bed305252c139 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f6420c00640 1 -- 172.21.15.137:0/2201831205 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c02f9b0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f6420c00640 1 -- 172.21.15.137:0/2201831205 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641c036070 con 0x55a5fe3a20c0 2024-04-25T02:11:29.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.020+0000 7f6420c00640 1 -- 172.21.15.137:0/2201831205 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c030ac0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.029 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 -- 172.21.15.137:0/2201831205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 msgr2=0x55a5fe3a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a88a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f641c009ca0 tx=0x7f641c009360 comp rx=0 tx=0).stop 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 -- 172.21.15.137:0/2201831205 shutdown_connections 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a88a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 --2- 172.21.15.137:0/2201831205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 -- 172.21.15.137:0/2201831205 >> 172.21.15.137:0/2201831205 conn(0x55a5fe39dac0 msgr2=0x55a5fe39cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 -- 172.21.15.137:0/2201831205 shutdown_connections 2024-04-25T02:11:29.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.021+0000 7f6435ba9740 1 -- 172.21.15.137:0/2201831205 wait complete. 2024-04-25T02:11:29.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 -- start start 2024-04-25T02:11:29.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 Processor -- start 2024-04-25T02:11:29.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1adaa0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1aef10 con 0x55a5fe3ac790 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f642c1ae170 con 0x55a5fe3a17a0 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f6435ba9740 10 client.0 _ll_register_callbacks cb 0x7f6414009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:29.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.022+0000 7f642be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f6423400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59804/0 (socket says 172.21.15.137:59804) 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 -- 172.21.15.137:0/3830823076 learned_addr learned my addr 172.21.15.137:0/3830823076 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f6423400640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49036/0 (socket says 172.21.15.137:49036) 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f6423400640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 -- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 msgr2=0x55a5fe3b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 -- 172.21.15.137:0/3830823076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 msgr2=0x55a5fe3a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 -- 172.21.15.137:0/3830823076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5fe3a6e90 con 0x55a5fe3a20c0 2024-04-25T02:11:29.033 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-04-25T02:11:29.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f642be00640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f641c000f80 tx=0x7f641c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdd35c74a797116 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f641a000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c02fd40 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f641c0305c0 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.023+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c036070 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f641c070050 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5fe422d40 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641c036070 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f641c04d040 con 0x55a5fe3a20c0 2024-04-25T02:11:29.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 10 client.15777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 20 client.15777 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe423170 0x55a5fe425560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 4 client.15777 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:11:29.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.024+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5fe30dd70 con 0x55a5fe423170 2024-04-25T02:11:29.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.025+0000 7f6423400640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe423170 0x55a5fe425560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.025+0000 7f641a000640 10 client.15777 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:11:29.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.025+0000 7f6423400640 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe423170 0x55a5fe425560 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4fc94b1d11d7c6a server_cookie=9d359a9f5fa0bd68 in_seq=0 out_seq=0 2024-04-25T02:11:29.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f641a000640 1 -- 172.21.15.137:0/3830823076 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5fe30dd70 con 0x55a5fe423170 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f641a000640 10 client.15777 handle_command_reply: tid=0 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 client.15777 shutdown 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 msgr2=0x55a5fe3a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f641c000f80 tx=0x7f641c005d80 comp rx=0 tx=0).stop 2024-04-25T02:11:29.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 shutdown_connections 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55a5fe423170 0x55a5fe425560 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a5fe3ac790 0x55a5fe3a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5fe3a20c0 0x55a5fe3a6090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 --2- 172.21.15.137:0/3830823076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5fe3a17a0 0x55a5fe3b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f641a000640 0 client.15777 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 >> 172.21.15.137:0/3830823076 conn(0x55a5fe39dac0 msgr2=0x55a5fe3a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 shutdown_connections 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 1 -- 172.21.15.137:0/3830823076 wait complete. 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.026+0000 7f6435ba9740 20 client.15777 trim_cache size 0 max 16384 2024-04-25T02:11:29.039 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:11:29.040 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-04-25T02:11:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 msgr2=0x7f64100a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 0x7f64100a5240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64240980c0 tx=0x7f6424009310 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 msgr2=0x7f642c19ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f642400e970 tx=0x7f642400ed70 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 shutdown_connections 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f64100a2d80 0x7f64100a5240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f642c109800 0x7f642c19ea50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f642c1041b0 0x7f642c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 --2- 172.21.15.137:0/3312630820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f642c1037f0 0x7f642c19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 >> 172.21.15.137:0/3312630820 conn(0x7f642c0ff280 msgr2=0x7f642c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 shutdown_connections 2024-04-25T02:11:29.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.027+0000 7f6431800640 1 -- 172.21.15.137:0/3312630820 wait complete. 2024-04-25T02:11:29.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-04-25T02:11:29.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-04-25T02:11:29.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-04-25T02:11:29.043 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-04-25T02:11:29.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-04-25T02:11:29.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-04-25T02:11:29.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-04-25T02:11:29.048 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-04-25T02:11:29.050 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-04-25T02:11:29.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T02:11:29.052 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-04-25T02:11:29.053 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-04-25T02:11:29.056 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-04-25T02:11:29.057 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-04-25T02:11:29.057 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-04-25T02:11:29.059 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-04-25T02:11:29.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-04-25T02:11:29.062 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-04-25T02:11:29.063 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-04-25T02:11:29.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-04-25T02:11:29.066 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-04-25T02:11:29.068 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-04-25T02:11:29.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-04-25T02:11:29.070 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-04-25T02:11:29.071 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-04-25T02:11:29.072 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-04-25T02:11:29.074 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-04-25T02:11:29.075 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-04-25T02:11:29.076 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-04-25T02:11:29.078 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-04-25T02:11:29.079 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-04-25T02:11:29.081 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-04-25T02:11:29.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-04-25T02:11:29.083 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-04-25T02:11:29.084 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-04-25T02:11:29.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-04-25T02:11:29.087 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-04-25T02:11:29.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-04-25T02:11:29.089 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-04-25T02:11:29.090 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-04-25T02:11:29.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-04-25T02:11:29.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-04-25T02:11:29.093 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-04-25T02:11:29.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-04-25T02:11:29.095 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-04-25T02:11:29.096 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-04-25T02:11:29.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-04-25T02:11:29.098 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-04-25T02:11:29.100 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-04-25T02:11:29.101 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-04-25T02:11:29.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-04-25T02:11:29.103 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-04-25T02:11:29.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-04-25T02:11:29.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-04-25T02:11:29.107 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-04-25T02:11:29.108 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-04-25T02:11:29.109 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nfc/ 2024-04-25T02:11:29.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-04-25T02:11:29.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-04-25T02:11:29.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nios2/ 2024-04-25T02:11:29.114 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nios2/README 2024-04-25T02:11:29.116 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-04-25T02:11:29.118 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/numastat.txt 2024-04-25T02:11:29.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-04-25T02:11:29.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/padata.txt 2024-04-25T02:11:29.123 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parisc/ 2024-04-25T02:11:29.124 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-04-25T02:11:29.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-04-25T02:11:29.127 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parisc/registers 2024-04-25T02:11:29.129 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-04-25T02:11:29.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/parport.txt 2024-04-25T02:11:29.132 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-04-25T02:11:29.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-04-25T02:11:29.135 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-04-25T02:11:29.136 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-04-25T02:11:29.138 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-04-25T02:11:29.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-04-25T02:11:29.141 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-04-25T02:11:29.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-04-25T02:11:29.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-04-25T02:11:29.145 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/phy.txt 2024-04-25T02:11:29.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/phy/ 2024-04-25T02:11:29.149 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-04-25T02:11:29.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-04-25T02:11:29.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-04-25T02:11:29.154 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/platform/ 2024-04-25T02:11:29.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-04-25T02:11:29.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pnp.txt 2024-04-25T02:11:29.158 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/ 2024-04-25T02:11:29.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-04-25T02:11:29.161 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-04-25T02:11:29.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-04-25T02:11:29.164 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-04-25T02:11:29.166 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-04-25T02:11:29.167 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-04-25T02:11:29.169 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-04-25T02:11:29.171 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-04-25T02:11:29.172 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-04-25T02:11:29.174 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-04-25T02:11:29.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-04-25T02:11:29.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-04-25T02:11:29.179 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-04-25T02:11:29.180 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-04-25T02:11:29.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-04-25T02:11:29.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-04-25T02:11:29.184 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-04-25T02:11:29.186 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-04-25T02:11:29.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-04-25T02:11:29.193 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-04-25T02:11:29.194 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-04-25T02:11:29.196 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-04-25T02:11:29.198 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-04-25T02:11:29.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/states.txt 2024-04-25T02:11:29.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-04-25T02:11:29.202 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-04-25T02:11:29.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-04-25T02:11:29.205 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-04-25T02:11:29.207 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-04-25T02:11:29.208 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-04-25T02:11:29.210 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-04-25T02:11:29.212 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/power/video.txt 2024-04-25T02:11:29.214 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/ 2024-04-25T02:11:29.215 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-04-25T02:11:29.217 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-04-25T02:11:29.218 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-04-25T02:11:29.220 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-04-25T02:11:29.222 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-04-25T02:11:29.223 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-04-25T02:11:29.225 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-04-25T02:11:29.227 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-04-25T02:11:29.229 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-04-25T02:11:29.230 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-04-25T02:11:29.232 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-04-25T02:11:29.234 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-04-25T02:11:29.235 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-04-25T02:11:29.237 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pps/ 2024-04-25T02:11:29.238 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-04-25T02:11:29.240 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/ 2024-04-25T02:11:29.241 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-04-25T02:11:29.243 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-04-25T02:11:29.244 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-04-25T02:11:29.248 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-04-25T02:11:29.249 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-04-25T02:11:29.251 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-04-25T02:11:29.252 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-04-25T02:11:29.253 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-04-25T02:11:29.254 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-04-25T02:11:29.256 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pti/ 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.249+0000 7fc5a8600640 1 -- 172.21.15.137:0/384149030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0108970 msgr2=0x7fc5a010c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.249+0000 7fc5a8600640 1 --2- 172.21.15.137:0/384149030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0108970 0x7fc5a010c960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009900 tx=0x7fc58c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 -- 172.21.15.137:0/384149030 shutdown_connections 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 --2- 172.21.15.137:0/384149030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a010d040 0x7fc5a0114c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 --2- 172.21.15.137:0/384149030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0108970 0x7fc5a010c960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 --2- 172.21.15.137:0/384149030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a0107fc0 0x7fc5a01083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 -- 172.21.15.137:0/384149030 >> 172.21.15.137:0/384149030 conn(0x7fc5a0075c80 msgr2=0x7fc5a00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 -- 172.21.15.137:0/384149030 shutdown_connections 2024-04-25T02:11:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.250+0000 7fc5a8600640 1 -- 172.21.15.137:0/384149030 wait complete. 2024-04-25T02:11:29.258 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-04-25T02:11:29.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 Processor -- start 2024-04-25T02:11:29.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 -- start start 2024-04-25T02:11:29.259 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/ 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0107fc0 0x7fc5a019e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0118260 con 0x7fc5a01a3010 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01180e0 con 0x7fc5a0107fc0 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a8600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01183e0 con 0x7fc5a010d040 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59820/0 (socket says 172.21.15.137:59820) 2024-04-25T02:11:29.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a6600640 1 -- 172.21.15.137:0/2303925347 learned_addr learned my addr 172.21.15.137:0/2303925347 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0107fc0 0x7fc5a019e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.251+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49052/0 (socket says 172.21.15.137:49052) 2024-04-25T02:11:29.261 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-04-25T02:11:29.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 -- 172.21.15.137:0/2303925347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0107fc0 msgr2=0x7fc5a019e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0107fc0 0x7fc5a019e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 -- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 msgr2=0x7fc5a01a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 -- 172.21.15.137:0/2303925347 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a01a3b00 con 0x7fc5a010d040 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a6600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc58c02a910 tx=0x7fc58c0329c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.252+0000 7fc59e000640 1 -- 172.21.15.137:0/2303925347 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c03f030 con 0x7fc5a010d040 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.253+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a01a3d90 con 0x7fc5a010d040 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.253+0000 7fc59e000640 1 -- 172.21.15.137:0/2303925347 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc58c032dc0 con 0x7fc5a010d040 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.253+0000 7fc59e000640 1 -- 172.21.15.137:0/2303925347 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c035070 con 0x7fc5a010d040 2024-04-25T02:11:29.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.253+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01ab5b0 con 0x7fc5a010d040 2024-04-25T02:11:29.264 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-04-25T02:11:29.264 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-04-25T02:11:29.264 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-04-25T02:11:29.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 Processor -- start 2024-04-25T02:11:29.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 -- start start 2024-04-25T02:11:29.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc59e000640 1 -- 172.21.15.137:0/2303925347 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fc58c042030 con 0x7fc5a010d040 2024-04-25T02:11:29.265 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-04-25T02:11:29.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 0x55e855c47070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c475b0 0x55e855c499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e855ba14e0 con 0x55e855c3cee0 2024-04-25T02:11:29.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e855b49a70 con 0x55e855c3c5c0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.256+0000 7fc5ab453740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e855b9d4a0 con 0x55e855c475b0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53872/0 (socket says 172.21.15.137:53872) 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 -- 172.21.15.137:0/105228036 learned_addr learned my addr 172.21.15.137:0/105228036 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 0x55e855c47070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a5200640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c475b0 0x55e855c499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 -- 172.21.15.137:0/105228036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c475b0 msgr2=0x55e855c499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c475b0 0x55e855c499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 -- 172.21.15.137:0/105228036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 msgr2=0x55e855c47070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 0x55e855c47070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 -- 172.21.15.137:0/105228036 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8558b53f0 con 0x55e855c3c5c0 2024-04-25T02:11:29.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 0x55e855c47070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.257+0000 7fc5a6600640 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc598011850 tx=0x7fc598011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592e17f35d95e8f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc592a00640 1 -- 172.21.15.137:0/105228036 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598011330 con 0x55e855c3c5c0 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc592a00640 1 -- 172.21.15.137:0/105228036 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc598010430 con 0x55e855c3c5c0 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc592a00640 1 -- 172.21.15.137:0/105228036 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59800fea0 con 0x55e855c3c5c0 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc59e000640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 0x7fc5880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc59e000640 1 -- 172.21.15.137:0/2303925347 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc58c0ef690 con 0x7fc5a010d040 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 0x7fc5880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc5ab453740 1 -- 172.21.15.137:0/105228036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 msgr2=0x55e855c3c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.258+0000 7fc5ab453740 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc598011850 tx=0x7fc598011d10 comp rx=0 tx=0).stop 2024-04-25T02:11:29.269 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/pwm.txt 2024-04-25T02:11:29.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 -- 172.21.15.137:0/105228036 shutdown_connections 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c475b0 0x55e855c499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c3cee0 0x55e855c47070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 --2- 172.21.15.137:0/105228036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c3c9a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 -- 172.21.15.137:0/105228036 >> 172.21.15.137:0/105228036 conn(0x55e855c388e0 msgr2=0x55e855c38cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 -- 172.21.15.137:0/105228036 shutdown_connections 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 -- 172.21.15.137:0/105228036 wait complete. 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 0x7fc5880a51c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55e855c3db80 tx=0x7fc59400b390 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.259+0000 7fc5ab453740 1 -- start start 2024-04-25T02:11:29.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 Processor -- start 2024-04-25T02:11:29.271 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3cee0 0x55e855c449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c44ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e855c4a3a0 con 0x55e855c475b0 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55e855b5cec0 con 0x55e855c3c5c0 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e855c4a520 con 0x55e855c3cee0 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5ab453740 10 client.0 _ll_register_callbacks cb 0x55e855b993f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:29.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c44ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5a5c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53884/0 (socket says 172.21.15.137:53884) 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5a5c00640 1 -- 172.21.15.137:0/3232523509 learned_addr learned my addr 172.21.15.137:0/3232523509 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.260+0000 7fc5a5200640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3cee0 0x55e855c449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 -- 172.21.15.137:0/3232523509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3cee0 msgr2=0x55e855c449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3cee0 0x55e855c449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 -- 172.21.15.137:0/3232523509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 msgr2=0x55e855c44ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c44ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 -- 172.21.15.137:0/3232523509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85597f7d0 con 0x55e855c3c5c0 2024-04-25T02:11:29.275 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rapidio/ 2024-04-25T02:11:29.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc594003e30 tx=0x7fc5940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d126368e82fa17b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc587400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc594005220 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc5940053c0 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.261+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc598010430 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc594003e60 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 10 client.25862 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e855c56650 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc598010430 con 0x55e855c3c5c0 2024-04-25T02:11:29.276 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-04-25T02:11:29.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc594024030 con 0x55e855c3c5c0 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 10 client.25862 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 20 client.25862 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855c57b60 0x55e855c59fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 4 client.25862 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.262+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e855baea20 con 0x55e855c57b60 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.263+0000 7fc5a5200640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855c57b60 0x55e855c59fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.263+0000 7fc587400640 10 client.25862 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:29.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.263+0000 7fc5a5200640 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855c57b60 0x55e855c59fe0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89cebc3aa016b14f server_cookie=2b6a8cef12ebb9eb in_seq=0 out_seq=0 2024-04-25T02:11:29.279 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-04-25T02:11:29.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc587400640 1 -- 172.21.15.137:0/3232523509 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e855baea20 con 0x55e855c57b60 2024-04-25T02:11:29.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc587400640 10 client.25862 handle_command_reply: tid=0 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 client.25862 shutdown 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 msgr2=0x55e855c44470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc594003e30 tx=0x7fc5940046c0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 shutdown_connections 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855c57b60 0x55e855c59fe0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c44ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3cee0 0x55e855c449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc587400640 0 client.25862 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 --2- 172.21.15.137:0/3232523509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3c5c0 0x55e855c44470 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 >> 172.21.15.137:0/3232523509 conn(0x55e855c388e0 msgr2=0x55e855c37b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.281 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-04-25T02:11:29.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 shutdown_connections 2024-04-25T02:11:29.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 1 -- 172.21.15.137:0/3232523509 wait complete. 2024-04-25T02:11:29.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.264+0000 7fc5ab453740 20 client.25862 trim_cache size 0 max 16384 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/rtc.txt 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/ 2024-04-25T02:11:29.283 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-04-25T02:11:29.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-04-25T02:11:29.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-04-25T02:11:29.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-04-25T02:11:29.284 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/DASD 2024-04-25T02:11:29.285 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-04-25T02:11:29.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 Processor -- start 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 -- start start 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855c53290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c3e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b6350 con 0x55e855c475b0 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b3c20 con 0x55e855c3cee0 2024-04-25T02:11:29.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.280+0000 7fc5ab453740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b1a90 con 0x55e855c3c5c0 2024-04-25T02:11:29.291 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a6600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c3e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53892/0 (socket says 172.21.15.137:53892) 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 -- 172.21.15.137:0/401331545 learned_addr learned my addr 172.21.15.137:0/401331545 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855c53290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 -- 172.21.15.137:0/401331545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 msgr2=0x55e855c53290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855c53290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 -- 172.21.15.137:0/401331545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 msgr2=0x55e855c3e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c3e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 -- 172.21.15.137:0/401331545 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e855c38710 con 0x55e855c3cee0 2024-04-25T02:11:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855c53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc5a5200640 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0b8090 tx=0x7fc58c02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457076d79f53ee9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.281+0000 7fc592000640 1 -- 172.21.15.137:0/401331545 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c049040 con 0x55e855c3cee0 2024-04-25T02:11:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc592000640 1 -- 172.21.15.137:0/401331545 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc58c03b460 con 0x55e855c3cee0 2024-04-25T02:11:29.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc592000640 1 -- 172.21.15.137:0/401331545 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0a6040 con 0x55e855c3cee0 2024-04-25T02:11:29.294 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 -- 172.21.15.137:0/401331545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 msgr2=0x55e855c44d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0b8090 tx=0x7fc58c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 -- 172.21.15.137:0/401331545 shutdown_connections 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c3e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855c44d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 --2- 172.21.15.137:0/401331545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855c53290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 -- 172.21.15.137:0/401331545 >> 172.21.15.137:0/401331545 conn(0x55e855c388e0 msgr2=0x55e855c3dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 -- 172.21.15.137:0/401331545 shutdown_connections 2024-04-25T02:11:29.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.282+0000 7fc5ab453740 1 -- 172.21.15.137:0/401331545 wait complete. 2024-04-25T02:11:29.296 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 -- start start 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 Processor -- start 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855cb63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c4ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.283+0000 7fc5ab453740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b20e0 con 0x55e855c475b0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5ab453740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b3550 con 0x55e855c3cee0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5ab453740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a01b27b0 con 0x55e855c3c5c0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5ab453740 10 client.0 _ll_register_callbacks cb 0x7fc594003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53908/0 (socket says 172.21.15.137:53908) 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5200640 1 -- 172.21.15.137:0/2217654060 learned_addr learned my addr 172.21.15.137:0/2217654060 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855cb63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a6600640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c4ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.298 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-04-25T02:11:29.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 -- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 msgr2=0x55e855cb68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 -- 172.21.15.137:0/2217654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 msgr2=0x55e855c4ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c4ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5c00640 1 -- 172.21.15.137:0/2217654060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e855c4b230 con 0x55e855c3c5c0 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.284+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc5a5c00640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855cb63b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc594000c00 tx=0x7fc594012cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4794cd70d625440a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc587400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc594032070 con 0x55e855c3c5c0 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fc594005240 con 0x55e855c3c5c0 2024-04-25T02:11:29.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e855ba8d70 con 0x55e855c3c5c0 2024-04-25T02:11:29.301 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc594005440 con 0x55e855c3c5c0 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc5ab453740 10 client.25906 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.285+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e855cbdc00 con 0x55e855c3c5c0 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55e855ba8d70 con 0x55e855c3c5c0 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc594024040 con 0x55e855c3c5c0 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 10 client.25906 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 10 client.25906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:29.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 20 client.25906 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:29.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855cbe330 0x55e855cc0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:29.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 4 client.25906 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:11:29.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e855b266e0 con 0x55e855cbe330 2024-04-25T02:11:29.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.286+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855cbe330 0x55e855cc0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:29.303 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-04-25T02:11:29.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.287+0000 7fc5a5200640 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855cbe330 0x55e855cc0750 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=675f62de312be073 server_cookie=4460ee185ddc67ac in_seq=0 out_seq=0 2024-04-25T02:11:29.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.287+0000 7fc587400640 10 client.25906 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:29.304 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-04-25T02:11:29.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.287+0000 7fc587400640 1 -- 172.21.15.137:0/2217654060 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e855b266e0 con 0x55e855cbe330 2024-04-25T02:11:29.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.287+0000 7fc587400640 10 client.25906 handle_command_reply: tid=0 2024-04-25T02:11:29.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.287+0000 7fc5ab453740 1 client.25906 shutdown 2024-04-25T02:11:29.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 msgr2=0x55e855cb63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855cb63b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc594000c00 tx=0x7fc594012cb0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 shutdown_connections 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55e855cbe330 0x55e855cc0750 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e855c475b0 0x55e855c4ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e855c3cee0 0x55e855cb68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc587400640 0 client.25906 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 --2- 172.21.15.137:0/2217654060 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e855c3c5c0 0x55e855cb63b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 >> 172.21.15.137:0/2217654060 conn(0x55e855c388e0 msgr2=0x55e855c372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 shutdown_connections 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 1 -- 172.21.15.137:0/2217654060 wait complete. 2024-04-25T02:11:29.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.288+0000 7fc5ab453740 20 client.25906 trim_cache size 0 max 16384 2024-04-25T02:11:29.307 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:11:29.307 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 msgr2=0x7fc5880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 0x7fc5880a51c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55e855c3db80 tx=0x7fc59400b390 comp rx=0 tx=0).stop 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 msgr2=0x7fc5a019ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc58c02a910 tx=0x7fc58c0329c0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 shutdown_connections 2024-04-25T02:11:29.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc5880a2d00 0x7fc5880a51c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5a01a3010 0x7fc5a01a34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5a010d040 0x7fc5a019ece0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 --2- 172.21.15.137:0/2303925347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc5a0107fc0 0x7fc5a019e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 >> 172.21.15.137:0/2303925347 conn(0x7fc5a0075c80 msgr2=0x7fc5a0076840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 shutdown_connections 2024-04-25T02:11:29.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:29.289+0000 7fc5a8600640 1 -- 172.21.15.137:0/2303925347 wait complete. 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/ 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-04-25T02:11:29.311 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-04-25T02:11:29.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-04-25T02:11:29.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ 2024-04-25T02:11:29.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-04-25T02:11:29.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-04-25T02:11:29.312 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-04-25T02:11:29.313 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-04-25T02:11:29.316 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-04-25T02:11:29.316 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-04-25T02:11:29.317 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-04-25T02:11:29.321 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-04-25T02:11:29.323 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-04-25T02:11:29.324 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-04-25T02:11:29.326 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-04-25T02:11:29.328 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-04-25T02:11:29.329 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-04-25T02:11:29.331 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-04-25T02:11:29.332 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-04-25T02:11:29.334 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-04-25T02:11:29.335 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-04-25T02:11:29.337 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-04-25T02:11:29.338 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-04-25T02:11:29.340 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-04-25T02:11:29.341 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-04-25T02:11:29.343 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-04-25T02:11:29.345 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-04-25T02:11:29.346 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-04-25T02:11:29.348 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-04-25T02:11:29.349 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-04-25T02:11:29.351 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-04-25T02:11:29.352 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-04-25T02:11:29.354 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-04-25T02:11:29.355 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-04-25T02:11:29.357 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-04-25T02:11:29.359 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-04-25T02:11:29.360 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-04-25T02:11:29.362 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-04-25T02:11:29.363 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-04-25T02:11:29.365 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-04-25T02:11:29.367 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-04-25T02:11:29.368 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-04-25T02:11:29.370 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-04-25T02:11:29.373 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-04-25T02:11:29.376 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-04-25T02:11:29.377 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-04-25T02:11:29.379 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-04-25T02:11:29.381 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-04-25T02:11:29.382 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-04-25T02:11:29.384 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-04-25T02:11:29.385 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-04-25T02:11:29.387 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-04-25T02:11:29.389 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-04-25T02:11:29.390 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-04-25T02:11:29.392 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-04-25T02:11:29.393 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-04-25T02:11:29.395 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-04-25T02:11:29.396 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-04-25T02:11:29.398 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-04-25T02:11:29.400 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-04-25T02:11:29.401 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-04-25T02:11:29.403 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-04-25T02:11:29.405 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-04-25T02:11:29.406 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/ 2024-04-25T02:11:29.408 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-04-25T02:11:29.409 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-04-25T02:11:29.411 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-04-25T02:11:29.413 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-04-25T02:11:29.414 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-04-25T02:11:29.416 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-04-25T02:11:29.418 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-04-25T02:11:29.419 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-04-25T02:11:29.421 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-04-25T02:11:29.423 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-04-25T02:11:29.425 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-04-25T02:11:29.427 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-04-25T02:11:29.429 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-04-25T02:11:29.430 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-04-25T02:11:29.432 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/ 2024-04-25T02:11:29.433 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-04-25T02:11:29.435 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-04-25T02:11:29.436 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/driver 2024-04-25T02:11:29.438 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-04-25T02:11:29.440 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-04-25T02:11:29.441 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-04-25T02:11:29.442 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-04-25T02:11:29.444 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-04-25T02:11:29.445 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-04-25T02:11:29.447 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sh/ 2024-04-25T02:11:29.448 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-04-25T02:11:29.450 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-04-25T02:11:29.452 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-04-25T02:11:29.453 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/ 2024-04-25T02:11:29.455 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-04-25T02:11:29.456 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-04-25T02:11:29.459 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-04-25T02:11:29.461 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-04-25T02:11:29.463 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-04-25T02:11:29.465 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-04-25T02:11:29.467 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-04-25T02:11:29.469 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-04-25T02:11:29.470 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-04-25T02:11:29.472 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-04-25T02:11:29.474 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-04-25T02:11:29.476 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-04-25T02:11:29.478 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-04-25T02:11:29.479 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-04-25T02:11:29.481 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-04-25T02:11:29.483 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-04-25T02:11:29.485 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-04-25T02:11:29.487 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-04-25T02:11:29.488 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-04-25T02:11:29.490 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-04-25T02:11:29.492 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-04-25T02:11:29.494 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-04-25T02:11:29.495 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-04-25T02:11:29.497 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-04-25T02:11:29.499 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-04-25T02:11:29.501 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-04-25T02:11:29.502 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-04-25T02:11:29.504 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-04-25T02:11:29.505 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-04-25T02:11:29.507 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-04-25T02:11:29.509 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-04-25T02:11:29.510 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-04-25T02:11:29.512 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-04-25T02:11:29.514 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-04-25T02:11:29.515 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-04-25T02:11:29.517 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-04-25T02:11:29.518 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-04-25T02:11:29.520 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-04-25T02:11:29.521 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-04-25T02:11:29.523 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-04-25T02:11:29.525 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-04-25T02:11:29.526 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-04-25T02:11:29.528 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-04-25T02:11:29.529 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-04-25T02:11:29.531 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-04-25T02:11:29.532 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-04-25T02:11:29.534 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-04-25T02:11:29.536 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-04-25T02:11:29.537 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-04-25T02:11:29.538 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-04-25T02:11:29.540 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-04-25T02:11:29.542 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-04-25T02:11:29.543 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-04-25T02:11:29.545 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-04-25T02:11:29.546 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-04-25T02:11:29.548 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-04-25T02:11:29.549 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-04-25T02:11:29.551 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-04-25T02:11:29.552 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-04-25T02:11:29.554 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-04-25T02:11:29.555 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-04-25T02:11:29.557 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-04-25T02:11:29.558 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sparse.txt 2024-04-25T02:11:29.560 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/ 2024-04-25T02:11:29.561 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-04-25T02:11:29.563 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-04-25T02:11:29.564 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-04-25T02:11:29.566 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-04-25T02:11:29.567 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-04-25T02:11:29.569 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-04-25T02:11:29.571 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-04-25T02:11:29.573 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-04-25T02:11:29.574 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-04-25T02:11:29.576 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spidev 2024-04-25T02:11:29.578 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-04-25T02:11:29.579 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-04-25T02:11:29.581 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-04-25T02:11:29.584 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-04-25T02:11:29.586 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-04-25T02:11:29.588 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/svga.txt 2024-04-25T02:11:29.589 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/ 2024-04-25T02:11:29.591 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-04-25T02:11:29.592 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/README 2024-04-25T02:11:29.594 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-04-25T02:11:29.595 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-04-25T02:11:29.597 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-04-25T02:11:29.599 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-04-25T02:11:29.601 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-04-25T02:11:29.603 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-04-25T02:11:29.604 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-04-25T02:11:29.607 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-04-25T02:11:29.608 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/target/ 2024-04-25T02:11:29.610 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-04-25T02:11:29.612 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-04-25T02:11:29.614 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-04-25T02:11:29.616 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/ 2024-04-25T02:11:29.619 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-04-25T02:11:29.621 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-04-25T02:11:29.622 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-04-25T02:11:29.624 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-04-25T02:11:29.626 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-04-25T02:11:29.628 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-04-25T02:11:29.631 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-04-25T02:11:29.634 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-04-25T02:11:29.636 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/ 2024-04-25T02:11:29.639 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-04-25T02:11:29.641 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-04-25T02:11:29.642 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:29 smithi163 ceph-mon[32577]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 7.1 MiB/s wr, 323 op/s 2024-04-25T02:11:29.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:29 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1672236097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:11:29.643 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-04-25T02:11:29.644 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-04-25T02:11:29.646 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-04-25T02:11:29.648 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-04-25T02:11:29.650 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-04-25T02:11:29.653 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-04-25T02:11:29.655 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-04-25T02:11:29.657 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-04-25T02:11:29.660 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-04-25T02:11:29.662 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/tpm/ 2024-04-25T02:11:29.665 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-04-25T02:11:29.667 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/ 2024-04-25T02:11:29.669 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-04-25T02:11:29.671 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-04-25T02:11:29.673 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-04-25T02:11:29.675 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-04-25T02:11:29.677 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-04-25T02:11:29.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:29 smithi174 ceph-mon[33171]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 7.1 MiB/s wr, 323 op/s 2024-04-25T02:11:29.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:29 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1672236097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:11:29.679 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-04-25T02:11:29.681 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-04-25T02:11:29.684 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-04-25T02:11:29.687 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-04-25T02:11:29.688 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-04-25T02:11:29.690 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-04-25T02:11:29.692 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-04-25T02:11:29.694 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-04-25T02:11:29.696 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-04-25T02:11:29.699 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-04-25T02:11:29.701 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-04-25T02:11:29.702 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-04-25T02:11:29.704 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-04-25T02:11:29.707 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/unicode.txt 2024-04-25T02:11:29.709 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/unshare.txt 2024-04-25T02:11:29.711 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/ 2024-04-25T02:11:29.713 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-04-25T02:11:29.715 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-04-25T02:11:29.718 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-04-25T02:11:29.721 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-04-25T02:11:29.724 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-04-25T02:11:29.726 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-04-25T02:11:29.728 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-04-25T02:11:29.730 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-04-25T02:11:29.732 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-04-25T02:11:29.734 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-04-25T02:11:29.736 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-04-25T02:11:29.737 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-04-25T02:11:29.739 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-04-25T02:11:29.741 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-04-25T02:11:29.742 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-04-25T02:11:29.745 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-04-25T02:11:29.746 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-04-25T02:11:29.748 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-04-25T02:11:29.750 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-04-25T02:11:29.752 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-04-25T02:11:29.754 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-04-25T02:11:29.756 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-04-25T02:11:29.757 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-04-25T02:11:29.759 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-04-25T02:11:29.761 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-04-25T02:11:29.763 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-04-25T02:11:29.765 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-04-25T02:11:29.767 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-04-25T02:11:29.768 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-04-25T02:11:29.771 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-04-25T02:11:29.773 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-04-25T02:11:29.775 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-04-25T02:11:29.777 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-04-25T02:11:29.779 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-04-25T02:11:29.781 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-04-25T02:11:29.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:29 smithi137 ceph-mon[28303]: pgmap v56: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 7.1 MiB/s wr, 323 op/s 2024-04-25T02:11:29.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:29 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1672236097' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:11:29.784 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-04-25T02:11:29.785 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/ 2024-04-25T02:11:29.787 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-04-25T02:11:29.789 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-04-25T02:11:29.791 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-04-25T02:11:29.793 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-04-25T02:11:29.795 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-04-25T02:11:29.797 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vfio.txt 2024-04-25T02:11:29.799 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-04-25T02:11:29.801 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video-output.txt 2024-04-25T02:11:29.803 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/ 2024-04-25T02:11:29.805 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-04-25T02:11:29.807 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-04-25T02:11:29.808 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-04-25T02:11:29.810 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-04-25T02:11:29.812 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-04-25T02:11:29.814 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-04-25T02:11:29.816 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-04-25T02:11:29.818 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-04-25T02:11:29.820 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-04-25T02:11:29.822 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-04-25T02:11:29.824 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-04-25T02:11:29.826 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-04-25T02:11:29.828 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-04-25T02:11:29.829 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-04-25T02:11:29.831 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-04-25T02:11:29.833 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-04-25T02:11:29.835 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-04-25T02:11:29.838 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-04-25T02:11:29.839 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-04-25T02:11:29.841 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-04-25T02:11:29.843 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-04-25T02:11:29.845 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-04-25T02:11:29.847 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-04-25T02:11:29.849 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-04-25T02:11:29.850 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-04-25T02:11:29.852 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-04-25T02:11:29.854 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-04-25T02:11:29.856 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-04-25T02:11:29.858 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-04-25T02:11:29.860 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-04-25T02:11:29.862 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-04-25T02:11:29.865 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-04-25T02:11:29.866 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-04-25T02:11:29.869 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-04-25T02:11:29.871 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-04-25T02:11:29.872 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-04-25T02:11:29.874 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-04-25T02:11:29.877 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-04-25T02:11:29.879 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-04-25T02:11:29.882 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-04-25T02:11:29.884 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-04-25T02:11:29.886 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-04-25T02:11:29.888 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-04-25T02:11:29.890 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-04-25T02:11:29.893 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-04-25T02:11:29.894 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-04-25T02:11:29.896 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-04-25T02:11:29.899 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-04-25T02:11:29.902 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-04-25T02:11:29.904 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-04-25T02:11:29.906 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-04-25T02:11:29.908 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-04-25T02:11:29.910 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-04-25T02:11:29.912 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-04-25T02:11:29.914 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-04-25T02:11:29.916 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-04-25T02:11:29.918 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-04-25T02:11:29.920 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-04-25T02:11:29.922 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-04-25T02:11:29.924 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-04-25T02:11:29.926 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-04-25T02:11:29.928 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-04-25T02:11:29.930 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-04-25T02:11:29.932 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-04-25T02:11:29.934 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-04-25T02:11:29.936 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-04-25T02:11:29.938 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-04-25T02:11:29.940 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-04-25T02:11:29.942 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-04-25T02:11:29.944 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-04-25T02:11:29.946 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-04-25T02:11:29.948 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-04-25T02:11:29.949 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-04-25T02:11:29.951 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-04-25T02:11:29.953 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-04-25T02:11:29.955 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-04-25T02:11:29.957 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-04-25T02:11:29.959 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-04-25T02:11:29.960 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/ 2024-04-25T02:11:29.963 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-04-25T02:11:29.965 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-04-25T02:11:29.966 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-04-25T02:11:29.968 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-04-25T02:11:29.971 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-04-25T02:11:29.973 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-04-25T02:11:29.974 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-04-25T02:11:29.976 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-04-25T02:11:29.977 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-04-25T02:11:29.979 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-04-25T02:11:29.981 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-04-25T02:11:29.982 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-04-25T02:11:29.984 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-04-25T02:11:29.986 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-04-25T02:11:29.987 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-04-25T02:11:29.989 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-04-25T02:11:29.991 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-04-25T02:11:29.992 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-04-25T02:11:29.994 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-04-25T02:11:29.996 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-04-25T02:11:29.998 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-04-25T02:11:30.000 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-04-25T02:11:30.001 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-04-25T02:11:30.003 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-04-25T02:11:30.004 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-04-25T02:11:30.009 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/ 2024-04-25T02:11:30.010 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-04-25T02:11:30.012 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-04-25T02:11:30.014 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-04-25T02:11:30.016 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/balance 2024-04-25T02:11:30.017 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-04-25T02:11:30.019 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-04-25T02:11:30.021 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-04-25T02:11:30.023 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-04-25T02:11:30.025 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-04-25T02:11:30.026 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-04-25T02:11:30.028 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/numa 2024-04-25T02:11:30.030 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-04-25T02:11:30.031 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-04-25T02:11:30.033 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-04-25T02:11:30.035 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-04-25T02:11:30.037 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-04-25T02:11:30.038 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-04-25T02:11:30.040 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-04-25T02:11:30.042 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-04-25T02:11:30.044 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-04-25T02:11:30.045 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-04-25T02:11:30.047 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-04-25T02:11:30.049 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-04-25T02:11:30.050 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-04-25T02:11:30.052 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-04-25T02:11:30.054 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/ 2024-04-25T02:11:30.055 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-04-25T02:11:30.057 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-04-25T02:11:30.059 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-04-25T02:11:30.060 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-04-25T02:11:30.062 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-04-25T02:11:30.064 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-04-25T02:11:30.065 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-04-25T02:11:30.067 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-04-25T02:11:30.069 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-04-25T02:11:30.070 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-04-25T02:11:30.072 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-04-25T02:11:30.073 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-04-25T02:11:30.075 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-04-25T02:11:30.077 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-04-25T02:11:30.078 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-04-25T02:11:30.080 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-04-25T02:11:30.082 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/ 2024-04-25T02:11:30.083 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-04-25T02:11:30.085 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-04-25T02:11:30.086 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-04-25T02:11:30.088 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-04-25T02:11:30.090 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-04-25T02:11:30.091 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-04-25T02:11:30.093 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-04-25T02:11:30.094 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-04-25T02:11:30.096 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-04-25T02:11:30.097 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-04-25T02:11:30.099 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-04-25T02:11:30.101 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-04-25T02:11:30.102 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-04-25T02:11:30.104 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/wimax/ 2024-04-25T02:11:30.106 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-04-25T02:11:30.107 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-04-25T02:11:30.109 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-04-25T02:11:30.111 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/ 2024-04-25T02:11:30.113 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-04-25T02:11:30.114 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-04-25T02:11:30.116 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-04-25T02:11:30.118 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-04-25T02:11:30.119 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-04-25T02:11:30.121 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-04-25T02:11:30.123 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-04-25T02:11:30.125 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-04-25T02:11:30.126 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-04-25T02:11:30.128 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-04-25T02:11:30.130 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-04-25T02:11:30.131 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-04-25T02:11:30.133 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-04-25T02:11:30.134 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-04-25T02:11:30.136 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-04-25T02:11:30.137 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-04-25T02:11:30.139 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-04-25T02:11:30.140 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-04-25T02:11:30.142 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-04-25T02:11:30.144 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-04-25T02:11:30.145 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-04-25T02:11:30.147 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-04-25T02:11:30.148 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-04-25T02:11:30.150 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-04-25T02:11:30.152 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/xtensa/ 2024-04-25T02:11:30.154 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-04-25T02:11:30.155 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-04-25T02:11:30.157 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/xz.txt 2024-04-25T02:11:30.159 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-04-25T02:11:30.160 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-04-25T02:11:30.162 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-04-25T02:11:30.163 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-04-25T02:11:30.165 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-04-25T02:11:30.167 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-04-25T02:11:30.168 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-04-25T02:11:30.170 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-04-25T02:11:30.171 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-04-25T02:11:30.173 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-04-25T02:11:30.175 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-04-25T02:11:30.177 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-04-25T02:11:30.178 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-04-25T02:11:30.180 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-04-25T02:11:30.182 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-04-25T02:11:30.183 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-04-25T02:11:30.185 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-04-25T02:11:30.187 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-04-25T02:11:30.188 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-04-25T02:11:30.190 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-04-25T02:11:30.192 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-04-25T02:11:30.194 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-04-25T02:11:30.196 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-04-25T02:11:30.198 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-04-25T02:11:30.199 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-04-25T02:11:30.201 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-04-25T02:11:30.202 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-04-25T02:11:30.204 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-04-25T02:11:30.206 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-04-25T02:11:30.208 INFO:tasks.workunit.client.0.smithi137.stdout:linux-4.0.5/Documentation/zorro.txt 2024-04-25T02:11:30.316 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-25T02:11:30.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:11:30.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-25T02:11:30.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 -- 172.21.15.137:0/2608913151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 msgr2=0x7f2928109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 --2- 172.21.15.137:0/2608913151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f2928109d70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f291c009860 tx=0x7f291c02a340 comp rx=0 tx=0).stop 2024-04-25T02:11:30.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 -- 172.21.15.137:0/2608913151 shutdown_connections 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 --2- 172.21.15.137:0/2608913151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 0x7f2928110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 --2- 172.21.15.137:0/2608913151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f2928103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 --2- 172.21.15.137:0/2608913151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f2928109d70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 -- 172.21.15.137:0/2608913151 >> 172.21.15.137:0/2608913151 conn(0x7f29280ff4d0 msgr2=0x7f29281018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 -- 172.21.15.137:0/2608913151 shutdown_connections 2024-04-25T02:11:30.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.521+0000 7f2930000640 1 -- 172.21.15.137:0/2608913151 wait complete. 2024-04-25T02:11:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.522+0000 7f2930000640 1 Processor -- start 2024-04-25T02:11:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.522+0000 7f2930000640 1 -- start start 2024-04-25T02:11:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f292819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 0x7f292819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2928113ec0 con 0x7f2928103980 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2928113d40 con 0x7f2928109990 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f2930000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2928114040 con 0x7f2928104340 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f292819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292d600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f292819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59848/0 (socket says 172.21.15.137:59848) 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53926/0 (socket says 172.21.15.137:53926) 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292d600640 1 -- 172.21.15.137:0/1087877513 learned_addr learned my addr 172.21.15.137:0/1087877513 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292cc00640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 0x7f292819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 -- 172.21.15.137:0/1087877513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 msgr2=0x7f292819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 0x7f292819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 -- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 msgr2=0x7f292819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f292819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.523+0000 7f292e000640 1 -- 172.21.15.137:0/1087877513 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292819f460 con 0x7f2928109990 2024-04-25T02:11:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f292e000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2920009fd0 tx=0x7f292000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f2926000640 1 -- 172.21.15.137:0/1087877513 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292000cd60 con 0x7f2928109990 2024-04-25T02:11:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f2926000640 1 -- 172.21.15.137:0/1087877513 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2920004b20 con 0x7f2928109990 2024-04-25T02:11:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f2926000640 1 -- 172.21.15.137:0/1087877513 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920010760 con 0x7f2928109990 2024-04-25T02:11:30.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292819f750 con 0x7f2928109990 2024-04-25T02:11:30.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.524+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29281a6fe0 con 0x7f2928109990 2024-04-25T02:11:30.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.527+0000 7f2932d79740 1 Processor -- start 2024-04-25T02:11:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.529+0000 7f2926000640 1 -- 172.21.15.137:0/1087877513 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f2920004cd0 con 0x7f2928109990 2024-04-25T02:11:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.529+0000 7f2932d79740 1 -- start start 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.529+0000 7f2932d79740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79441d60 0x563e79442140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.529+0000 7f2932d79740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.529+0000 7f2932d79740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e7944cd50 0x563e7944f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f2932d79740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e793a0f40 con 0x563e79441d60 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f2932d79740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x563e793a6190 con 0x563e79442680 2024-04-25T02:11:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f2932d79740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563e7934ea10 con 0x563e7944cd50 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292cc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79441d60 0x563e79442140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53942/0 (socket says 172.21.15.137:53942) 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 -- 172.21.15.137:0/2230015969 learned_addr learned my addr 172.21.15.137:0/2230015969 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292cc00640 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e7944cd50 0x563e7944f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 -- 172.21.15.137:0/2230015969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e7944cd50 msgr2=0x563e7944f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e7944cd50 0x563e7944f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 -- 172.21.15.137:0/2230015969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79441d60 msgr2=0x563e79442140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79441d60 0x563e79442140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.530+0000 7f292d600640 1 -- 172.21.15.137:0/2230015969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e791827e0 con 0x563e79442680 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f2926000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 0x7f29100a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f292d600640 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f291c009980 tx=0x7f291c0095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1077d876166946a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f2926000640 1 -- 172.21.15.137:0/1087877513 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f29200cf970 con 0x7f2928109990 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f291a600640 1 -- 172.21.15.137:0/2230015969 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c037040 con 0x563e79442680 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f292cc00640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 0x7f29100a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f291a600640 1 -- 172.21.15.137:0/2230015969 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f291c038040 con 0x563e79442680 2024-04-25T02:11:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.531+0000 7f291a600640 1 -- 172.21.15.137:0/2230015969 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c003850 con 0x563e79442680 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- 172.21.15.137:0/2230015969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 msgr2=0x563e7944c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f292cc00640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 0x7f29100a5240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x563e7943f210 tx=0x7f2914015040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f291c009980 tx=0x7f291c0095a0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- 172.21.15.137:0/2230015969 shutdown_connections 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e7944cd50 0x563e7944f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79442680 0x563e7944c810 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 --2- 172.21.15.137:0/2230015969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79441d60 0x563e79442140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- 172.21.15.137:0/2230015969 >> 172.21.15.137:0/2230015969 conn(0x563e7943e080 msgr2=0x563e7943e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- 172.21.15.137:0/2230015969 shutdown_connections 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- 172.21.15.137:0/2230015969 wait complete. 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.532+0000 7f2932d79740 1 -- start start 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 Processor -- start 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79441d60 0x563e79449c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79442680 0x563e7944a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563e79361e70 con 0x563e79442680 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x563e793a2150 con 0x563e7944cd50 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563e7944fb80 con 0x563e79441d60 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f2932d79740 10 client.0 _ll_register_callbacks cb 0x563e7939d1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f292e000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f292e000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53946/0 (socket says 172.21.15.137:53946) 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f292e000640 1 -- 172.21.15.137:0/2673839591 learned_addr learned my addr 172.21.15.137:0/2673839591 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.533+0000 7f292cc00640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79442680 0x563e7944a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292d600640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79441d60 0x563e79449c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 -- 172.21.15.137:0/2673839591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79441d60 msgr2=0x563e79449c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79441d60 0x563e79449c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 -- 172.21.15.137:0/2673839591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79442680 msgr2=0x563e7944a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79442680 0x563e7944a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 -- 172.21.15.137:0/2673839591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e791e2f70 con 0x563e7944cd50 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f292e000640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f292009be50 tx=0x7f292009c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547e1dbef5aeb37a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f290ea00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29200a48a0 con 0x563e7944cd50 2024-04-25T02:11:30.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f292009b310 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.534+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291c038040 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f29200a4b30 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 10 client.25880 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563e7907a170 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f291c038040 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f292007ace0 con 0x563e7944cd50 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 10 client.25880 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 20 client.25880 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e7945d070 0x563e7945f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 4 client.25880 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e793b36d0 con 0x563e7945d070 2024-04-25T02:11:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.535+0000 7f292d600640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e7945d070 0x563e7945f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.536+0000 7f292d600640 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e7945d070 0x563e7945f4c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89b36d309ebfba4f server_cookie=3e641d86c40d6152 in_seq=0 out_seq=0 2024-04-25T02:11:30.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.536+0000 7f290ea00640 10 client.25880 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.537+0000 7f290ea00640 1 -- 172.21.15.137:0/2673839591 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563e793b36d0 con 0x563e7945d070 2024-04-25T02:11:30.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.537+0000 7f290ea00640 10 client.25880 handle_command_reply: tid=0 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.537+0000 7f2932d79740 1 client.25880 shutdown 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.537+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 msgr2=0x563e7944a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.537+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f292009be50 tx=0x7f292009c680 comp rx=0 tx=0).stop 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 shutdown_connections 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e7945d070 0x563e7945f4c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e7944cd50 0x563e7944a690 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e79442680 0x563e7944a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f290ea00640 0 client.25880 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 --2- 172.21.15.137:0/2673839591 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79441d60 0x563e79449c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 >> 172.21.15.137:0/2673839591 conn(0x563e7943e080 msgr2=0x563e7943d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 shutdown_connections 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 1 -- 172.21.15.137:0/2673839591 wait complete. 2024-04-25T02:11:30.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.538+0000 7f2932d79740 20 client.25880 trim_cache size 0 max 16384 2024-04-25T02:11:30.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 Processor -- start 2024-04-25T02:11:30.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 -- start start 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e7943d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79464dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29281b1fe0 con 0x563e7944cd50 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f29281af8b0 con 0x563e79441d60 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.557+0000 7f2932d79740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29281ad720 con 0x563e79442680 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79464dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49170/0 (socket says 172.21.15.137:49170) 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 -- 172.21.15.137:0/3506775475 learned_addr learned my addr 172.21.15.137:0/3506775475 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292d600640 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e7943d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 -- 172.21.15.137:0/3506775475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 msgr2=0x563e7943d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e7943d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 -- 172.21.15.137:0/3506775475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 msgr2=0x563e79464dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79464dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292cc00640 1 -- 172.21.15.137:0/3506775475 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e794481a0 con 0x563e79442680 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.558+0000 7f292d600640 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e7943d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:30.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.559+0000 7f292cc00640 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2928108d50 tx=0x7f2914004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688724ce5ee802a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.559+0000 7f2919c00640 1 -- 172.21.15.137:0/3506775475 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914003930 con 0x563e79442680 2024-04-25T02:11:30.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.559+0000 7f2919c00640 1 -- 172.21.15.137:0/3506775475 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f291400f480 con 0x563e79442680 2024-04-25T02:11:30.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.559+0000 7f2919c00640 1 -- 172.21.15.137:0/3506775475 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914022660 con 0x563e79442680 2024-04-25T02:11:30.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- 172.21.15.137:0/3506775475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 msgr2=0x563e7944a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2928108d50 tx=0x7f2914004730 comp rx=0 tx=0).stop 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- 172.21.15.137:0/3506775475 shutdown_connections 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79464dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e7944a2e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 --2- 172.21.15.137:0/3506775475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e7943d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- 172.21.15.137:0/3506775475 >> 172.21.15.137:0/3506775475 conn(0x563e7943e080 msgr2=0x563e79449bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- 172.21.15.137:0/3506775475 shutdown_connections 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- 172.21.15.137:0/3506775475 wait complete. 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.560+0000 7f2932d79740 1 -- start start 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 Processor -- start 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e794553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79452540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29281add70 con 0x563e7944cd50 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f29281af1e0 con 0x563e79441d60 2024-04-25T02:11:30.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29281ae440 con 0x563e79442680 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f2932d79740 10 client.0 _ll_register_callbacks cb 0x7f29200057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292e000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79452540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e794553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49178/0 (socket says 172.21.15.137:49178) 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292cc00640 1 -- 172.21.15.137:0/2880542543 learned_addr learned my addr 172.21.15.137:0/2880542543 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.561+0000 7f292d600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e794553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53960/0 (socket says 172.21.15.137:53960) 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 -- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 msgr2=0x563e794553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e794553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 -- 172.21.15.137:0/2880542543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 msgr2=0x563e79452540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79452540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 -- 172.21.15.137:0/2880542543 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e794c3650 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f292cc00640 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2914006010 tx=0x7f291400fae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=224cb70aabd7ef04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f290ea00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914003b40 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f291400f480 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.562+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f2914003ce0 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2914005020 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 10 client.25924 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563e794c48d0 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f291400f480 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f291402a070 con 0x563e79442680 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 10 client.25924 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 10 client.25924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 20 client.25924 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e794c50e0 0x563e794c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 4 client.25924 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.563+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563e793ada20 con 0x563e794c50e0 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.564+0000 7f292d600640 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e794c50e0 0x563e794c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.564+0000 7f292d600640 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e794c50e0 0x563e794c7500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a6b5a8db2863ed server_cookie=b21105cbaee5932a in_seq=0 out_seq=0 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.564+0000 7f290ea00640 10 client.25924 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f290ea00640 1 -- 172.21.15.137:0/2880542543 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563e793ada20 con 0x563e794c50e0 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f290ea00640 10 client.25924 handle_command_reply: tid=0 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 client.25924 shutdown 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 msgr2=0x563e79451e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2914006010 tx=0x7f291400fae0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 shutdown_connections 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x563e794c50e0 0x563e794c7500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.565+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563e7944cd50 0x563e79452540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563e79442680 0x563e79451e00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 1 --2- 172.21.15.137:0/2880542543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x563e79441d60 0x563e794553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f290ea00640 0 client.25924 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 >> 172.21.15.137:0/2880542543 conn(0x563e7943e080 msgr2=0x563e7944a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 shutdown_connections 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 1 -- 172.21.15.137:0/2880542543 wait complete. 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.566+0000 7f2932d79740 20 client.25924 trim_cache size 0 max 16384 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "399d6e64-7f17-427d-ad31-83ab1c937764", 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-25T02:11:30.575 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 msgr2=0x7f29100a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 0x7f29100a5240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x563e7943f210 tx=0x7f2914015040 comp rx=0 tx=0).stop 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 msgr2=0x7f292819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2920009fd0 tx=0x7f292000ee50 comp rx=0 tx=0).stop 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 shutdown_connections 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f29100a2d80 0x7f29100a5240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2928109990 0x7f292819ed30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2928104340 0x7f292819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 --2- 172.21.15.137:0/1087877513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2928103980 0x7f292819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 >> 172.21.15.137:0/1087877513 conn(0x7f29280ff4d0 msgr2=0x7f29280ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 shutdown_connections 2024-04-25T02:11:30.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.567+0000 7f2930000640 1 -- 172.21.15.137:0/1087877513 wait complete. 2024-04-25T02:11:30.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:11:30.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 -- 172.21.15.137:0/3488776092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b4100380 msgr2=0x7ff5b4100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3488776092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b4100380 0x7ff5b4100760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009900 tx=0x7ff5a402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 -- 172.21.15.137:0/3488776092 shutdown_connections 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3488776092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b410df30 0x7ff5b4110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3488776092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b410d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3488776092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b4100380 0x7ff5b4100760 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 -- 172.21.15.137:0/3488776092 >> 172.21.15.137:0/3488776092 conn(0x7ff5b40fbfc0 msgr2=0x7ff5b40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 -- 172.21.15.137:0/3488776092 shutdown_connections 2024-04-25T02:11:30.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.786+0000 7ff5b9800640 1 -- 172.21.15.137:0/3488776092 wait complete. 2024-04-25T02:11:30.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.787+0000 7ff5b9800640 1 Processor -- start 2024-04-25T02:11:30.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 -- start start 2024-04-25T02:11:30.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 0x7ff5b419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 0x7ff5b419ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113d50 con 0x7ff5b410df30 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113bd0 con 0x7ff5b4100380 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b9800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113ed0 con 0x7ff5b4100d30 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 0x7ff5b419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 0x7ff5b419a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53982/0 (socket says 172.21.15.137:53982) 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b3e00640 1 -- 172.21.15.137:0/3806955137 learned_addr learned my addr 172.21.15.137:0/3806955137 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.788+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 0x7ff5b419ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 -- 172.21.15.137:0/3806955137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 msgr2=0x7ff5b419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 0x7ff5b419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 -- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 msgr2=0x7ff5b419ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 0x7ff5b419ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 -- 172.21.15.137:0/3806955137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b419f190 con 0x7ff5b4100d30 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 0x7ff5b419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b419a730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e9f0 tx=0x7ff5a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.789+0000 7ff5b0c00640 1 -- 172.21.15.137:0/3806955137 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000ccc0 con 0x7ff5b4100d30 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.790+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b419f480 con 0x7ff5b4100d30 2024-04-25T02:11:30.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.790+0000 7ff5b0c00640 1 -- 172.21.15.137:0/3806955137 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a0005020 con 0x7ff5b4100d30 2024-04-25T02:11:30.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.790+0000 7ff5b0c00640 1 -- 172.21.15.137:0/3806955137 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0004b40 con 0x7ff5b4100d30 2024-04-25T02:11:30.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.790+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b41a6d10 con 0x7ff5b4100d30 2024-04-25T02:11:30.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.794+0000 7ff5bddc3740 1 Processor -- start 2024-04-25T02:11:30.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.794+0000 7ff5bddc3740 1 -- start start 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.794+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599d81d0 0x559b599da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b59931560 con 0x559b599d81d0 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x559b598d9930 con 0x559b599cdb00 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b5992d520 con 0x559b599cd1e0 2024-04-25T02:11:30.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:53990/0 (socket says 172.21.15.137:53990) 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 -- 172.21.15.137:0/249450779 learned_addr learned my addr 172.21.15.137:0/249450779 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 -- 172.21.15.137:0/249450779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 msgr2=0x559b599cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 -- 172.21.15.137:0/249450779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599d81d0 msgr2=0x559b599da5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599d81d0 0x559b599da5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.795+0000 7ff5b3e00640 1 -- 172.21.15.137:0/249450779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b5970f7d0 con 0x559b599cdb00 2024-04-25T02:11:30.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.796+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4031400 tx=0x7ff5a4031430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5176749c29eae340 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.796+0000 7ff5a9600640 1 -- 172.21.15.137:0/249450779 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4040070 con 0x559b599cdb00 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.796+0000 7ff5b0c00640 1 -- 172.21.15.137:0/3806955137 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7ff5a0004ce0 con 0x7ff5b4100d30 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.796+0000 7ff5a9600640 1 -- 172.21.15.137:0/249450779 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a4005520 con 0x559b599cdb00 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.796+0000 7ff5a9600640 1 -- 172.21.15.137:0/249450779 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4035040 con 0x559b599cdb00 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 -- 172.21.15.137:0/249450779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 msgr2=0x559b599d7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4031400 tx=0x7ff5a4031430 comp rx=0 tx=0).stop 2024-04-25T02:11:30.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 -- 172.21.15.137:0/249450779 shutdown_connections 2024-04-25T02:11:30.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599d81d0 0x559b599da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d7c90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/249450779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.797+0000 7ff5bddc3740 1 -- 172.21.15.137:0/249450779 >> 172.21.15.137:0/249450779 conn(0x559b599c9500 msgr2=0x559b599c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.798+0000 7ff5bddc3740 1 -- 172.21.15.137:0/249450779 shutdown_connections 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.798+0000 7ff5bddc3740 1 -- 172.21.15.137:0/249450779 wait complete. 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.798+0000 7ff5b0c00640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 0x7ff5980a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.798+0000 7ff5bddc3740 1 -- start start 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.798+0000 7ff5b0c00640 1 -- 172.21.15.137:0/3806955137 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff5a00cf460 con 0x7ff5b4100d30 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 0x7ff5980a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 Processor -- start 2024-04-25T02:11:30.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cdb00 0x559b599d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599d81d0 0x559b599d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b599daf60 con 0x559b599cdb00 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x559b598ecd90 con 0x559b599d81d0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559b599db0e0 con 0x559b599cd1e0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.799+0000 7ff5bddc3740 10 client.0 _ll_register_callbacks cb 0x559b598ec780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49208/0 (socket says 172.21.15.137:49208) 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 -- 172.21.15.137:0/891695002 learned_addr learned my addr 172.21.15.137:0/891695002 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 0x7ff5980a51d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4102560 tx=0x7ff5ac009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599d81d0 0x559b599d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3400640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cdb00 0x559b599d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 -- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599d81d0 msgr2=0x559b599d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599d81d0 0x559b599d5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 -- 172.21.15.137:0/891695002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cdb00 msgr2=0x559b599d57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cdb00 0x559b599d57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 -- 172.21.15.137:0/891695002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b596453f0 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005ec0 tx=0x7ff5a4005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1963edbc798a89af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.800+0000 7ff59e000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4040070 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff5a4004380 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a4005520 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5a4056050 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff5bddc3740 10 client.25936 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b596050f0 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a4005520 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.801+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5a4031c40 con 0x559b599cd1e0 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 10 client.25936 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 10 client.25936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:30.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 20 client.25936 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:30.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b599e84b0 0x559b599ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 4 client.25936 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:30.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b59944d90 con 0x559b599e84b0 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.802+0000 7ff5b3400640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b599e84b0 0x559b599ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.803+0000 7ff5b3400640 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b599e84b0 0x559b599ea8a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9f43a711aa5d02 server_cookie=de3620046e0b0339 in_seq=0 out_seq=0 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.803+0000 7ff59e000640 10 client.25936 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff59e000640 1 -- 172.21.15.137:0/891695002 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b59944d90 con 0x559b599e84b0 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff59e000640 10 client.25936 handle_command_reply: tid=0 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff5bddc3740 1 client.25936 shutdown 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 msgr2=0x559b599d5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005ec0 tx=0x7ff5a4005de0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.804+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 shutdown_connections 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b599e84b0 0x559b599ea8a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599d81d0 0x559b599d5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cdb00 0x559b599d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/891695002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599cd1e0 0x559b599d5290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff59e000640 0 client.25936 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 >> 172.21.15.137:0/891695002 conn(0x559b599c9500 msgr2=0x559b599c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 shutdown_connections 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 1 -- 172.21.15.137:0/891695002 wait complete. 2024-04-25T02:11:30.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.805+0000 7ff5bddc3740 20 client.25936 trim_cache size 0 max 16384 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 Processor -- start 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 -- start start 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41b1d60 con 0x559b599cd1e0 2024-04-25T02:11:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41af630 con 0x559b599cdb00 2024-04-25T02:11:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.830+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41ad480 con 0x559b599d81d0 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:33566/0 (socket says 172.21.15.137:33566) 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b8e00640 1 -- 172.21.15.137:0/3762990213 learned_addr learned my addr 172.21.15.137:0/3762990213 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43256/0 (socket says 172.21.15.137:43256) 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 -- 172.21.15.137:0/3762990213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 msgr2=0x559b599cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 -- 172.21.15.137:0/3762990213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 msgr2=0x559b599e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 -- 172.21.15.137:0/3762990213 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b599c8d40 con 0x559b599cdb00 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.831+0000 7ff5b3400640 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00ccb80 tx=0x7ff5a0086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=665516831f20846 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.832+0000 7ff5a8c00640 1 -- 172.21.15.137:0/3762990213 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a001c040 con 0x559b599cdb00 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.832+0000 7ff5a8c00640 1 -- 172.21.15.137:0/3762990213 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a0099c50 con 0x559b599cdb00 2024-04-25T02:11:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.832+0000 7ff5a8c00640 1 -- 172.21.15.137:0/3762990213 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00a4130 con 0x559b599cdb00 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.832+0000 7ff5bddc3740 1 -- 172.21.15.137:0/3762990213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 msgr2=0x559b599c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.832+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00ccb80 tx=0x7ff5a0086040 comp rx=0 tx=0).stop 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 -- 172.21.15.137:0/3762990213 shutdown_connections 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599c8800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/3762990213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 -- 172.21.15.137:0/3762990213 >> 172.21.15.137:0/3762990213 conn(0x559b599c9500 msgr2=0x559b599d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 -- 172.21.15.137:0/3762990213 shutdown_connections 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 -- 172.21.15.137:0/3762990213 wait complete. 2024-04-25T02:11:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 -- start start 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.833+0000 7ff5bddc3740 1 Processor -- start 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41adaf0 con 0x559b599cd1e0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41aef60 con 0x559b599cdb00 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b41ae1c0 con 0x559b599d81d0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5bddc3740 10 client.0 _ll_register_callbacks cb 0x7ff5a40056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5b8e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5b3400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43264/0 (socket says 172.21.15.137:43264) 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5b3400640 1 -- 172.21.15.137:0/1668572845 learned_addr learned my addr 172.21.15.137:0/1668572845 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.834+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 -- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 msgr2=0x559b599d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 -- 172.21.15.137:0/1668572845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 msgr2=0x559b599d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:30.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 -- 172.21.15.137:0/1668572845 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b59a4d870 con 0x559b599d81d0 2024-04-25T02:11:30.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b3400640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:30.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff5b8e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599d2b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac005fd0 tx=0x7ff5ac004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7d706ed6ce0c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:30.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff59e000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.835+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac004b20 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a0099c50 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7ff5ac004cc0 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac01e930 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 10 client.25942 fetch_fsmap learned FSMap version 24 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b59a4ec10 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a0099c50 con 0x559b599d81d0 2024-04-25T02:11:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5ac0057c0 con 0x559b599d81d0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 10 client.25942 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 10 client.25942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 20 client.25942 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b59a4f3f0 0x559b59a51810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 4 client.25942 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.836+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559b5993eaa0 con 0x559b59a4f3f0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.837+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b59a4f3f0 0x559b59a51810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.837+0000 7ff5b3e00640 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b59a4f3f0 0x559b59a51810 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7734c40075c9a75 server_cookie=d8197f8283a21160 in_seq=0 out_seq=0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.837+0000 7ff59e000640 10 client.25942 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff59e000640 1 -- 172.21.15.137:0/1668572845 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x559b5993eaa0 con 0x559b59a4f3f0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff59e000640 10 client.25942 handle_command_reply: tid=0 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 client.25942 shutdown 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 msgr2=0x559b599d2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599d2b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac005fd0 tx=0x7ff5ac004a40 comp rx=0 tx=0).stop 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 shutdown_connections 2024-04-25T02:11:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x559b59a4f3f0 0x559b59a51810 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559b599d81d0 0x559b599d2b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559b599cdb00 0x559b599d25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 --2- 172.21.15.137:0/1668572845 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b599cd1e0 0x559b599d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 >> 172.21.15.137:0/1668572845 conn(0x559b599c9500 msgr2=0x559b599d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff59e000640 0 client.25942 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 shutdown_connections 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.838+0000 7ff5bddc3740 1 -- 172.21.15.137:0/1668572845 wait complete. 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.839+0000 7ff5bddc3740 20 client.25942 trim_cache size 0 max 16384 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "scrub active (539 inodes in the stack)", 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stdout: "399d6e64-7f17-427d-ad31-83ab1c937764": { 2024-04-25T02:11:30.848 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "399d6e64-7f17-427d-ad31-83ab1c937764", 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,force" 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.839+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 msgr2=0x7ff5980a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.839+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 0x7ff5980a51d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4102560 tx=0x7ff5ac009500 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.839+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 msgr2=0x7ff5b419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.839+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b419a730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000e9f0 tx=0x7ff5a000eeb0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 shutdown_connections 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7ff5980a2d10 0x7ff5980a51d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5b410df30 0x7ff5b419ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5b4100d30 0x7ff5b419a730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 --2- 172.21.15.137:0/3806955137 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5b4100380 0x7ff5b419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 >> 172.21.15.137:0/3806955137 conn(0x7ff5b40fbfc0 msgr2=0x7ff5b410f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 shutdown_connections 2024-04-25T02:11:30.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:11:30.840+0000 7ff5b9800640 1 -- 172.21.15.137:0/3806955137 wait complete. 2024-04-25T02:11:30.868 INFO:tasks.cephfs.filesystem:scrub status for tag:399d6e64-7f17-427d-ad31-83ab1c937764 - {'path': '/', 'tag': '399d6e64-7f17-427d-ad31-83ab1c937764', 'options': 'recursive,force'} 2024-04-25T02:11:31.034 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:30.758+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044f [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000044f:[<0x1000000044e/README v2>,<0x1000000044c/Atmel v6>,<0x10000000203/arm v342>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000044f:[<0x1000000044e/README v2>,<0x1000000044c/Atmel v6>,<0x10000000203/arm v683>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.034 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:30.881+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000696 [...4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ auth v4 ap=1 f(v0 m2024-04-25T02:11:24.757138+0000 1=1+0) n(v0 rc2024-04-25T02:11:24.757138+0000 2=1+1) (inest lock) (ifile excl) caps={15147=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15147 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000696:[<0x10000000695/event v4>,<0x1000000054e/devfreq v496>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000000696:[<0x10000000695/event v4>,<0x1000000054e/devfreq v1788>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-25T02:11:24.757138+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-04-25T02:11:24.757138+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:11:24.757138+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:11:24.757138+0000 2=1+1)","error_str":""},"return_code":0} 2024-04-25T02:11:31.034 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.871+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084f [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c042383700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084f:[<0x1000000084c/nvidia,tegra114-mipi.txt v6>,<0x1000000054e/mipi v1248>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000084f:[<0x1000000084c/nvidia,tegra114-mipi.txt v6>,<0x1000000054e/mipi v1802>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.035 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.872+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084e [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c042488580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084e:[<0x1000000084d/mipi-dsi-bus.txt v2>,<0x1000000084c/dsi v4>,<0x1000000054e/mipi v1248>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000084e:[<0x1000000084d/mipi-dsi-bus.txt v2>,<0x1000000084c/dsi v4>,<0x1000000054e/mipi v1802>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.035 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:30.881+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000697 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000697:[<0x10000000696/exynos-ppmu.txt v2>,<0x10000000695/event v4>,<0x1000000054e/devfreq v496>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000697:[<0x10000000696/exynos-ppmu.txt v2>,<0x10000000695/event v4>,<0x1000000054e/devfreq v1788>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.035 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:30.966+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e1 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e1:[<0x100000005e0/power_domain.txt v2>,<0x10000000553/ux500 v284>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005e1:[<0x100000005e0/power_domain.txt v2>,<0x10000000553/ux500 v284>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.035 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.026+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x10000000851/bmips.txt v4>,<0x10000000850/brcm v10>,<0x1000000054e/mips v1258>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000853:[<0x10000000851/bmips.txt v4>,<0x10000000850/brcm v10>,<0x1000000054e/mips v2714>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.035 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.026+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000852 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000852:[<0x10000000851/bcm3384-intc.txt v2>,<0x10000000850/brcm v10>,<0x1000000054e/mips v1258>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000852:[<0x10000000851/bcm3384-intc.txt v2>,<0x10000000850/brcm v10>,<0x1000000054e/mips v2714>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.872+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084d [...4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ auth v4 ap=1 f(v0 m2024-04-25T02:11:25.678121+0000 1=1+0) n(v0 rc2024-04-25T02:11:25.678121+0000 2=1+1) (inest lock) (ifile excl) caps={15147=pAsLsXsFsx/pAsLsXsFsxcral@1},l=15147 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c042488000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000084d:[<0x1000000084c/dsi v4>,<0x1000000054e/mipi v1248>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x1000000084d:[<0x1000000084c/dsi v4>,<0x1000000054e/mipi v1802>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-25T02:11:25.678121+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-04-25T02:11:25.678121+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-04-25T02:11:25.678121+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T02:11:25.678121+0000 2=1+1)","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.975+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dc [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c042489b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005dc:[<0x100000005d7/nvidia,tegra20-pmc.txt v10>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005dc:[<0x100000005d7/nvidia,tegra20-pmc.txt v10>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.975+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005db [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c042489600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005db:[<0x100000005d7/nvidia,tegra20-mc.txt v8>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005db:[<0x100000005d7/nvidia,tegra20-mc.txt v8>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.975+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005da [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c04248a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005da:[<0x100000005d7/nvidia,tegra20-flowctrl.txt v6>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005da:[<0x100000005d7/nvidia,tegra20-flowctrl.txt v6>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.976+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d8 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c04248a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d8:[<0x100000005d7/nvidia,tegra20-ahb.txt v2>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005d8:[<0x100000005d7/nvidia,tegra20-ahb.txt v2>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.976+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d9 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c04248b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d9:[<0x100000005d7/nvidia,tegra20-emc.txt v4>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005d9:[<0x100000005d7/nvidia,tegra20-emc.txt v4>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.036 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:11:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:11:30.976+0000 7f5ee5ff4700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dd [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c04248ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005dd:[<0x100000005d7/nvidia,tegra30-mc.txt v12>,<0x10000000553/tegra v276>,<0x1000000054e/arm v198>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000005dd:[<0x100000005d7/nvidia,tegra30-mc.txt v12>,<0x10000000553/tegra v276>,<0x1000000054e/arm v2728>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.372 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.026+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000855 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000855:[<0x10000000851/usb.txt v8>,<0x10000000850/brcm v10>,<0x1000000054e/mips v1258>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000855:[<0x10000000851/usb.txt v8>,<0x10000000850/brcm v10>,<0x1000000054e/mips v2714>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.026+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000854 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000854:[<0x10000000851/cm-dsl.txt v6>,<0x10000000850/brcm v10>,<0x1000000054e/mips v1258>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000854:[<0x10000000851/cm-dsl.txt v6>,<0x10000000850/brcm v10>,<0x1000000054e/mips v2714>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.107+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f7 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dd9cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f7:[<0x100000007f5/adv7604.txt v4>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007f7:[<0x100000007f5/adv7604.txt v4>,<0x100000007ec/i2c v34>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.107+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fd [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fd:[<0x100000007f5/tvp7002.txt v16>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007fd:[<0x100000007f5/tvp7002.txt v16>,<0x100000007ec/i2c v34>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.107+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f9 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f9:[<0x100000007f5/mt9p031.txt v8>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007f9:[<0x100000007f5/mt9p031.txt v8>,<0x100000007ec/i2c v34>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.107+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fc [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fc:[<0x100000007f5/tvp514x.txt v14>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007fc:[<0x100000007f5/tvp514x.txt v14>,<0x100000007ec/i2c v34>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.108+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f6 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f6:[<0x100000007f5/adv7343.txt v2>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007f6:[<0x100000007f5/adv7343.txt v2>,<0x100000007ec/i2c v71>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.108+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fb [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fb:[<0x100000007f5/ths8200.txt v12>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007fb:[<0x100000007f5/ths8200.txt v12>,<0x100000007ec/i2c v71>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.108+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fa [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fa:[<0x100000007f5/nokia,smia.txt v10>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007fa:[<0x100000007f5/nokia,smia.txt v10>,<0x100000007ec/i2c v71>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.373 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:11:31.109+0000 7f07cdd1b700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f8 [4,head] /volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15147=0-4194304@3} caps={15147=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15147 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b5dda0cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f8:[<0x100000007f5/mt9m111.txt v6>,<0x100000007ec/i2c v34>,<0x1000000054e/media v1124>,<0x1000000054c/bindings v104>,<0x10000000203/devicetree v666>,<0x10000000202/Documentation v160>,<0x10000000201/linux-4.0.5 v12>,<0x10000000006/untar_tar v32>,<0x10000000005/tmp v32>,<0x100000001fb/client.0 v33>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v47>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000007f8:[<0x100000007f5/mt9m111.txt v6>,<0x100000007ec/i2c v71>,<0x1000000054e/media v2724>,<0x1000000054c/bindings v208>,<0x10000000203/devicetree v681>,<0x10000000202/Documentation v331>,<0x10000000201/linux-4.0.5 v19>,<0x10000000006/untar_tar v39>,<0x10000000005/tmp v38>,<0x100000001fb/client.0 v40>,<0x100000001fa/e4f57d96-0844-4e32-821b-43b279d27963 v54>,<0x10000000001/sv_1 v69>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T02:11:31.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:31 smithi163 ceph-mon[32577]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:31.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:31 smithi163 ceph-mon[32577]: scrub queued for path: / 2024-04-25T02:11:31.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:31 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:31.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:31 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:31.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-mon[33171]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:31.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-mon[33171]: scrub queued for path: / 2024-04-25T02:11:31.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:31.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:31 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:31 smithi137 ceph-mon[28303]: pgmap v57: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:31 smithi137 ceph-mon[28303]: scrub queued for path: / 2024-04-25T02:11:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:31 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:31.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:31 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x1000000044f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.644 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005dc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005da (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005d8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005d9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000005dd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.645 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: active paths [/] 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.646 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:32 smithi163 ceph-mon[32577]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x1000000044f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005dc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005da (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005d8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005d9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000005dd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: active paths [/] 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.681 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.682 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:32 smithi174 ceph-mon[33171]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x1000000044f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.785 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005e1 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.786 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005dc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005da (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005d8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005d9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.787 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000005dd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt) see mds.c log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: active paths [/] 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007fc (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.788 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007f6 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007fa (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt) see mds.i log and `damage ls` output for details 2024-04-25T02:11:32.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:32.789 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:32 smithi137 ceph-mon[28303]: scrub summary: idle+waiting paths [/] 2024-04-25T02:11:33.643 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:33 smithi163 ceph-mon[32577]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:33.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:33 smithi174 ceph-mon[33171]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:33.684 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:33 smithi137 ceph-mon[28303]: pgmap v58: 97 pgs: 97 active+clean; 86 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 2.8 MiB/s wr, 318 op/s 2024-04-25T02:11:35.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:35 smithi174 ceph-mon[33171]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 470 op/s 2024-04-25T02:11:35.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar cf doc.tar linux-4.0.5 2024-04-25T02:11:35.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:11:35.378+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:35.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:35 smithi137 ceph-mon[28303]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 470 op/s 2024-04-25T02:11:35.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:35 smithi163 ceph-mon[32577]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 3.1 MiB/s wr, 470 op/s 2024-04-25T02:11:36.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:36 smithi174 ceph-mon[33171]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:36.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:36 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:11:36.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:36 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:36.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:36 smithi137 ceph-mon[28303]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:36.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:36 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:11:36.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:36 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:36.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:36 smithi163 ceph-mon[32577]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:36.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:36 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] up:active 2024-04-25T02:11:36.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:36 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:37.378 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar xf doc.tar 2024-04-25T02:11:37.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:37 smithi174 ceph-mon[33171]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.7 MiB/s wr, 465 op/s 2024-04-25T02:11:37.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:37 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:11:37.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:37 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:11:37.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:37 smithi137 ceph-mon[28303]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.7 MiB/s wr, 465 op/s 2024-04-25T02:11:37.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:37 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:11:37.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:37 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:11:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:37 smithi163 ceph-mon[32577]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 2.7 MiB/s wr, 465 op/s 2024-04-25T02:11:37.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:37 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:11:37.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:37 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:11:38.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:38 smithi174 ceph-mon[33171]: scrub summary: idle 2024-04-25T02:11:38.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:38 smithi137 ceph-mon[28303]: scrub summary: idle 2024-04-25T02:11:38.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:38 smithi163 ceph-mon[32577]: scrub summary: idle 2024-04-25T02:11:39.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:39 smithi174 ceph-mon[33171]: pgmap v61: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 501 op/s 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 -- 172.21.15.137:0/3855951968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 msgr2=0x7efeb810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 --2- 172.21.15.137:0/3855951968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb810dfc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009be0 tx=0x7efeb002a750 comp rx=0 tx=0).stop 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 -- 172.21.15.137:0/3855951968 shutdown_connections 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 --2- 172.21.15.137:0/3855951968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb810dfc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 --2- 172.21.15.137:0/3855951968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 0x7efeb810b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 --2- 172.21.15.137:0/3855951968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 -- 172.21.15.137:0/3855951968 >> 172.21.15.137:0/3855951968 conn(0x7efeb80fbf60 msgr2=0x7efeb80fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 -- 172.21.15.137:0/3855951968 shutdown_connections 2024-04-25T02:11:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.734+0000 7efebda00640 1 -- 172.21.15.137:0/3855951968 wait complete. 2024-04-25T02:11:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.735+0000 7efebda00640 1 Processor -- start 2024-04-25T02:11:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.735+0000 7efebda00640 1 -- start start 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 0x7efeb8100890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb8100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8111a20 con 0x7efeb8103020 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81118a0 con 0x7efeb8102700 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebda00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8111ba0 con 0x7efeb810bb20 2024-04-25T02:11:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43270/0 (socket says 172.21.15.137:43270) 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efeb7e00640 1 -- 172.21.15.137:0/4042415685 learned_addr learned my addr 172.21.15.137:0/4042415685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efeb7400640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 0x7efeb8100890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.736+0000 7efebd000640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb8100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 -- 172.21.15.137:0/4042415685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 msgr2=0x7efeb8100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb8100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 -- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 msgr2=0x7efeb8100890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 0x7efeb8100890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 -- 172.21.15.137:0/4042415685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81a6380 con 0x7efeb8102700 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb7e00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efea800e9c0 tx=0x7efea800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb4c00640 1 -- 172.21.15.137:0/4042415685 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800cde0 con 0x7efeb8102700 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81a6670 con 0x7efeb8102700 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb4c00640 1 -- 172.21.15.137:0/4042415685 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea80035f0 con 0x7efeb8102700 2024-04-25T02:11:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efeb4c00640 1 -- 172.21.15.137:0/4042415685 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8010670 con 0x7efeb8102700 2024-04-25T02:11:39.747 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.737+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a6c10 con 0x7efeb8102700 2024-04-25T02:11:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 Processor -- start 2024-04-25T02:11:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efeb4c00640 1 -- 172.21.15.137:0/4042415685 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7efea80037a0 con 0x7efeb8102700 2024-04-25T02:11:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 -- start start 2024-04-25T02:11:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d593728d0 0x555d5937cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d592d5ab0 con 0x555d5937d190 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x555d5927e640 con 0x555d59371fb0 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efec1faa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555d592d1a70 con 0x555d593728d0 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efebd000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d593728d0 0x555d5937cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.741+0000 7efeb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43284/0 (socket says 172.21.15.137:43284) 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 -- 172.21.15.137:0/3239200957 learned_addr learned my addr 172.21.15.137:0/3239200957 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 -- 172.21.15.137:0/3239200957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d593728d0 msgr2=0x555d5937cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d593728d0 0x555d5937cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 -- 172.21.15.137:0/3239200957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 msgr2=0x555d5937f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 -- 172.21.15.137:0/3239200957 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d58fea210 con 0x555d59371fb0 2024-04-25T02:11:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efeb7400640 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.742+0000 7efebd000640 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efeb002ad40 tx=0x7efeb0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d203264e5186a61a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efead600640 1 -- 172.21.15.137:0/3239200957 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0040030 con 0x555d59371fb0 2024-04-25T02:11:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efead600640 1 -- 172.21.15.137:0/3239200957 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efeb0030c10 con 0x555d59371fb0 2024-04-25T02:11:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efead600640 1 -- 172.21.15.137:0/3239200957 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0036040 con 0x555d59371fb0 2024-04-25T02:11:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efeb4c00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 0x7efe9c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 -- 172.21.15.137:0/3239200957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 msgr2=0x555d59372390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efeb002ad40 tx=0x7efeb0009310 comp rx=0 tx=0).stop 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 -- 172.21.15.137:0/3239200957 shutdown_connections 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d593728d0 0x555d5937cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 --2- 172.21.15.137:0/3239200957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59372390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efec1faa740 1 -- 172.21.15.137:0/3239200957 >> 172.21.15.137:0/3239200957 conn(0x555d5936e4c0 msgr2=0x555d5936e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efeb7e00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 0x7efe9c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.743+0000 7efeb4c00640 1 -- 172.21.15.137:0/4042415685 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efea80cf840 con 0x7efeb8102700 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.744+0000 7efec1faa740 1 -- 172.21.15.137:0/3239200957 shutdown_connections 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.744+0000 7efec1faa740 1 -- 172.21.15.137:0/3239200957 wait complete. 2024-04-25T02:11:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.744+0000 7efeb7e00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 0x7efe9c0a5260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555d59373550 tx=0x7efea80d5530 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.744+0000 7efec1faa740 1 -- start start 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.744+0000 7efec1faa740 1 Processor -- start 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d5937a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555d5937fd60 con 0x555d5937d190 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x555d59291990 con 0x555d593728d0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555d5937fee0 con 0x555d59371fb0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efec1faa740 10 client.0 _ll_register_callbacks cb 0x555d59293950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efeb7400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efeb7400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43298/0 (socket says 172.21.15.137:43298) 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efeb7400640 1 -- 172.21.15.137:0/932792043 learned_addr learned my addr 172.21.15.137:0/932792043 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efebd000640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d5937a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.745+0000 7efebd000640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 -- 172.21.15.137:0/932792043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 msgr2=0x555d5937a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d5937a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 -- 172.21.15.137:0/932792043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 msgr2=0x555d5937ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 -- 172.21.15.137:0/932792043 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d590b6620 con 0x555d593728d0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efebd000640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efeb7400640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efea0012730 tx=0x7efea0012bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b6afe99ed3726c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efea6000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0011bb0 con 0x555d593728d0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efea0011d50 con 0x555d593728d0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb0030c10 con 0x555d593728d0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efea0004020 con 0x555d593728d0 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efec1faa740 10 client.25916 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.746+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555d5938bc70 con 0x555d593728d0 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efeb0030c10 con 0x555d593728d0 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efea001c470 con 0x555d593728d0 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 10 client.25916 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 20 client.25916 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d5938d150 0x555d5938f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 4 client.25916 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d592e2ff0 con 0x555d5938d150 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.747+0000 7efebd000640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d5938d150 0x555d5938f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.748+0000 7efebd000640 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d5938d150 0x555d5938f5b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36cbcf9f22291c77 server_cookie=ec71dbc01c608a2b in_seq=0 out_seq=0 2024-04-25T02:11:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.748+0000 7efea6000640 10 client.25916 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efea6000640 1 -- 172.21.15.137:0/932792043 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555d592e2ff0 con 0x555d5938d150 2024-04-25T02:11:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efea6000640 10 client.25916 handle_command_reply: tid=0 2024-04-25T02:11:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 client.25916 shutdown 2024-04-25T02:11:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 msgr2=0x555d5937a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efea0012730 tx=0x7efea0012bf0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 shutdown_connections 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d5938d150 0x555d5938f5b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d5937d190 0x555d5937ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efea6000640 0 client.25916 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d593728d0 0x555d5937a600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 --2- 172.21.15.137:0/932792043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d5937a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.749+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 >> 172.21.15.137:0/932792043 conn(0x555d5936e4c0 msgr2=0x555d593741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.750+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 shutdown_connections 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.750+0000 7efec1faa740 1 -- 172.21.15.137:0/932792043 wait complete. 2024-04-25T02:11:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.750+0000 7efec1faa740 20 client.25916 trim_cache size 0 max 16384 2024-04-25T02:11:39.773 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 Processor -- start 2024-04-25T02:11:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 -- start start 2024-04-25T02:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59388c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59374970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 0x555d59394ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81b1ea0 con 0x555d593728d0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81af770 con 0x555d59371fb0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efec1faa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ad5c0 con 0x555d5937d190 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efebd000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59388c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efeb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59374970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efebd000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59388c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:43300/0 (socket says 172.21.15.137:43300) 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.766+0000 7efebd000640 1 -- 172.21.15.137:0/2942958923 learned_addr learned my addr 172.21.15.137:0/2942958923 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efebd000640 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 0x555d59394ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 -- 172.21.15.137:0/2942958923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 msgr2=0x555d59394ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 0x555d59394ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 -- 172.21.15.137:0/2942958923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 msgr2=0x555d59388c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59388c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 -- 172.21.15.137:0/2942958923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d5936de00 con 0x555d593728d0 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efebd000640 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 0x555d59394ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeb7400640 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59374970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efea001c8c0 tx=0x7efea0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721945e5ea14a3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.767+0000 7efeacc00640 1 -- 172.21.15.137:0/2942958923 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea001c4f0 con 0x555d593728d0 2024-04-25T02:11:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efeacc00640 1 -- 172.21.15.137:0/2942958923 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea001cab0 con 0x555d593728d0 2024-04-25T02:11:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efeacc00640 1 -- 172.21.15.137:0/2942958923 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00039e0 con 0x555d593728d0 2024-04-25T02:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 -- 172.21.15.137:0/2942958923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 msgr2=0x555d59374970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59374970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efea001c8c0 tx=0x7efea0009e30 comp rx=0 tx=0).stop 2024-04-25T02:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 -- 172.21.15.137:0/2942958923 shutdown_connections 2024-04-25T02:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d5937d190 0x555d59394ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59374970 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 --2- 172.21.15.137:0/2942958923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d59371fb0 0x555d59388c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 -- 172.21.15.137:0/2942958923 >> 172.21.15.137:0/2942958923 conn(0x555d5936e4c0 msgr2=0x555d5936d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 -- 172.21.15.137:0/2942958923 shutdown_connections 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.768+0000 7efec1faa740 1 -- 172.21.15.137:0/2942958923 wait complete. 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 -- start start 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 Processor -- start 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d593812d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d5937d190 0x555d593f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.769+0000 7efec1faa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81adc30 con 0x555d593728d0 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efec1faa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81af0a0 con 0x555d5937d190 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efec1faa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81ae300 con 0x555d59371fb0 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efec1faa740 10 client.0 _ll_register_callbacks cb 0x7efea0009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efebd000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d593812d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47700/0 (socket says 172.21.15.137:47700) 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 -- 172.21.15.137:0/3573648500 learned_addr learned my addr 172.21.15.137:0/3573648500 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efebd000640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d5937d190 0x555d593f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 -- 172.21.15.137:0/3573648500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 msgr2=0x555d593812d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d593812d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 -- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d5937d190 msgr2=0x555d593f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d5937d190 0x555d593f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 -- 172.21.15.137:0/3573648500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d593f2cd0 con 0x555d593728d0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.770+0000 7efeb7400640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efea001c840 tx=0x7efea0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b53e1ef1303504 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efea6000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0033040 con 0x555d593728d0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efea0011bb0 con 0x555d593728d0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea001cab0 con 0x555d593728d0 2024-04-25T02:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efea001cce0 con 0x555d593728d0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efec1faa740 10 client.15843 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555d593f3fe0 con 0x555d593728d0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.771+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efea001cab0 con 0x555d593728d0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efea0036070 con 0x555d593728d0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 10 client.15843 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 20 client.15843 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d593f4700 0x555d593f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 4 client.15843 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d592dd340 con 0x555d593f4700 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efebd000640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d593f4700 0x555d593f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efebd000640 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d593f4700 0x555d593f6b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644bb670bc3ffd24 server_cookie=49032b4eba1501ae in_seq=0 out_seq=0 2024-04-25T02:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:39.772+0000 7efea6000640 10 client.15843 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:39.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:39 smithi137 ceph-mon[28303]: pgmap v61: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 501 op/s 2024-04-25T02:11:39.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:39 smithi163 ceph-mon[32577]: pgmap v61: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 2.9 MiB/s wr, 501 op/s 2024-04-25T02:11:40.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:40 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:11:40.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:40 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:40.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:40 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:11:40.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:40 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:40.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:40 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] up:active 2024-04-25T02:11:40.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:40 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:11:41.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:41 smithi137 ceph-mon[28303]: pgmap v62: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efea6000640 1 -- 172.21.15.137:0/3573648500 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d592dd340 con 0x555d593f4700 2024-04-25T02:11:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efea6000640 10 client.15843 handle_command_reply: tid=0 2024-04-25T02:11:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 client.15843 shutdown 2024-04-25T02:11:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 msgr2=0x555d59381810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efea001c840 tx=0x7efea0009c20 comp rx=0 tx=0).stop 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 shutdown_connections 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555d593f4700 0x555d593f6b20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555d5937d190 0x555d593f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555d593728d0 0x555d59381810 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efea6000640 0 client.15843 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 --2- 172.21.15.137:0/3573648500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555d59371fb0 0x555d593812d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.878+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 >> 172.21.15.137:0/3573648500 conn(0x555d5936e4c0 msgr2=0x555d5936cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.879+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 shutdown_connections 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.879+0000 7efec1faa740 1 -- 172.21.15.137:0/3573648500 wait complete. 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.879+0000 7efec1faa740 20 client.15843 trim_cache size 0 max 16384 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:11:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 msgr2=0x7efe9c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 0x7efe9c0a5260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555d59373550 tx=0x7efea80d5530 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 msgr2=0x7efeb8100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efea800e9c0 tx=0x7efea800ee80 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 shutdown_connections 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efe9c0a2da0 0x7efe9c0a5260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efeb810bb20 0x7efeb8100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efeb8103020 0x7efeb8100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 --2- 172.21.15.137:0/4042415685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efeb8102700 0x7efeb8100350 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.880+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 >> 172.21.15.137:0/4042415685 conn(0x7efeb80fbf60 msgr2=0x7efeb80fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.881+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 shutdown_connections 2024-04-25T02:11:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:41.881+0000 7efebda00640 1 -- 172.21.15.137:0/4042415685 wait complete. 2024-04-25T02:11:41.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:41 smithi163 ceph-mon[32577]: pgmap v62: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:41.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:41 smithi174 ceph-mon[33171]: pgmap v62: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:42.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:11:42.467+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:42.784 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:42 smithi137 ceph-mon[28303]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:42.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:42 smithi163 ceph-mon[32577]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:42.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:42 smithi174 ceph-mon[33171]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T02:11:43.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:43 smithi137 ceph-mon[28303]: pgmap v63: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:43.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:43 smithi163 ceph-mon[32577]: pgmap v63: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:43.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:43 smithi174 ceph-mon[33171]: pgmap v63: 97 pgs: 97 active+clean; 91 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 534 KiB/s wr, 187 op/s 2024-04-25T02:11:45.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:45 smithi137 ceph-mon[28303]: pgmap v64: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 744 op/s 2024-04-25T02:11:45.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:45 smithi163 ceph-mon[32577]: pgmap v64: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 744 op/s 2024-04-25T02:11:45.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:45 smithi174 ceph-mon[33171]: pgmap v64: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 744 op/s 2024-04-25T02:11:47.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:47 smithi137 ceph-mon[28303]: pgmap v65: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.6 MiB/s wr, 592 op/s 2024-04-25T02:11:47.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:47 smithi163 ceph-mon[32577]: pgmap v65: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.6 MiB/s wr, 592 op/s 2024-04-25T02:11:47.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:47 smithi174 ceph-mon[33171]: pgmap v65: 97 pgs: 97 active+clean; 92 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 1.6 MiB/s wr, 592 op/s 2024-04-25T02:11:49.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:49 smithi137 ceph-mon[28303]: pgmap v66: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 971 op/s 2024-04-25T02:11:49.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:49 smithi163 ceph-mon[32577]: pgmap v66: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 971 op/s 2024-04-25T02:11:49.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:49 smithi174 ceph-mon[33171]: pgmap v66: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 971 op/s 2024-04-25T02:11:51.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:51 smithi137 ceph-mon[28303]: pgmap v67: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:51.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:51 smithi163 ceph-mon[32577]: pgmap v67: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:51.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:51 smithi174 ceph-mon[33171]: pgmap v67: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:52.783 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:52 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:52.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:52 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:52.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:52 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:11:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:53 smithi163 ceph-mon[32577]: pgmap v68: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:53 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:53.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:53 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:53.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:53 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:11:53.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:53 smithi174 ceph-mon[33171]: pgmap v68: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:53.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:53 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:53.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:53 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:53.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:53 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:11:54.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:53 smithi137 ceph-mon[28303]: pgmap v68: 97 pgs: 97 active+clean; 137 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.4 MiB/s wr, 935 op/s 2024-04-25T02:11:54.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:53 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:11:54.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:53 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:11:54.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:53 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 -- 172.21.15.137:0/675470880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c109950 msgr2=0x7f5d4c109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 --2- 172.21.15.137:0/675470880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c109950 0x7f5d4c109d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009900 tx=0x7f5d3c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 -- 172.21.15.137:0/675470880 shutdown_connections 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 --2- 172.21.15.137:0/675470880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c104300 0x7f5d4c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 --2- 172.21.15.137:0/675470880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c103940 0x7f5d4c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 --2- 172.21.15.137:0/675470880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c109950 0x7f5d4c109d30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 -- 172.21.15.137:0/675470880 >> 172.21.15.137:0/675470880 conn(0x7f5d4c0ff410 msgr2=0x7f5d4c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 -- 172.21.15.137:0/675470880 shutdown_connections 2024-04-25T02:11:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.035+0000 7f5d52200640 1 -- 172.21.15.137:0/675470880 wait complete. 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.036+0000 7f5d52200640 1 Processor -- start 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.036+0000 7f5d52200640 1 -- start start 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 0x7f5d4c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c109950 0x7f5d4c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c113e80 con 0x7f5d4c109950 2024-04-25T02:11:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c113d00 con 0x7f5d4c103940 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d52200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c114000 con 0x7f5d4c104300 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4b400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51812/0 (socket says 172.21.15.137:51812) 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 0x7f5d4c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4b400640 1 -- 172.21.15.137:0/868768771 learned_addr learned my addr 172.21.15.137:0/868768771 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4be00640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c109950 0x7f5d4c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 -- 172.21.15.137:0/868768771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 msgr2=0x7f5d4c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 -- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c109950 msgr2=0x7f5d4c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c109950 0x7f5d4c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4aa00640 1 -- 172.21.15.137:0/868768771 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c19f230 con 0x7f5d4c104300 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.037+0000 7f5d4b400640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 0x7f5d4c19a780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9f0 tx=0x7f5d3800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d43e00640 1 -- 172.21.15.137:0/868768771 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ccc0 con 0x7f5d4c104300 2024-04-25T02:11:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d43e00640 1 -- 172.21.15.137:0/868768771 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d38005020 con 0x7f5d4c104300 2024-04-25T02:11:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d43e00640 1 -- 172.21.15.137:0/868768771 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38004b40 con 0x7f5d4c104300 2024-04-25T02:11:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c19f520 con 0x7f5d4c104300 2024-04-25T02:11:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.038+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c1a6db0 con 0x7f5d4c104300 2024-04-25T02:11:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 Processor -- start 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d43e00640 1 -- 172.21.15.137:0/868768771 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f5d38004ce0 con 0x7f5d4c104300 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 -- start start 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd874720 0x55d8dd87eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd8813d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd7d7ab0 con 0x55d8dd873e00 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd780640 con 0x55d8dd87efe0 2024-04-25T02:11:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd7d3a70 con 0x55d8dd874720 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d4aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd8813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47984/0 (socket says 172.21.15.137:47984) 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d4be00640 1 -- 172.21.15.137:0/1058007030 learned_addr learned my addr 172.21.15.137:0/1058007030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.042+0000 7f5d4b400640 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd874720 0x55d8dd87eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 -- 172.21.15.137:0/1058007030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd874720 msgr2=0x55d8dd87eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd874720 0x55d8dd87eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 -- 172.21.15.137:0/1058007030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 msgr2=0x55d8dd8813d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd8813d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 -- 172.21.15.137:0/1058007030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8dd4ec210 con 0x55d8dd873e00 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd8813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:11:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d4be00640 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f50 tx=0x7f5d440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cc33e74b97d606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d37e00640 1 -- 172.21.15.137:0/1058007030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44004d20 con 0x55d8dd873e00 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d37e00640 1 -- 172.21.15.137:0/1058007030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d44004050 con 0x55d8dd873e00 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.043+0000 7f5d37e00640 1 -- 172.21.15.137:0/1058007030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44005260 con 0x55d8dd873e00 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d43e00640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 0x7f5d300a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d43e00640 1 -- 172.21.15.137:0/868768771 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5d380cf2f0 con 0x7f5d4c104300 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d4b400640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 0x7f5d300a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1058007030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 msgr2=0x55d8dd8741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f50 tx=0x7f5d440118d0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1058007030 shutdown_connections 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd8813d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd874720 0x55d8dd87eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1058007030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd8741e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.044+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1058007030 >> 172.21.15.137:0/1058007030 conn(0x55d8dd870310 msgr2=0x55d8dd8706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.045+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1058007030 shutdown_connections 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.045+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1058007030 wait complete. 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.045+0000 7f5d4b400640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 0x7f5d300a53c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c032fd0 tx=0x7f5d3c005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.045+0000 7f5d54ffa740 1 -- start start 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.045+0000 7f5d54ffa740 1 Processor -- start 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd87c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd881c10 con 0x55d8dd874720 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd793990 con 0x55d8dd87efe0 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8dd881d90 con 0x55d8dd873e00 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d54ffa740 10 client.0 _ll_register_callbacks cb 0x55d8dd795950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd87c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51824/0 (socket says 172.21.15.137:51824) 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 -- 172.21.15.137:0/4219571296 learned_addr learned my addr 172.21.15.137:0/4219571296 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4b400640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 -- 172.21.15.137:0/4219571296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 msgr2=0x55d8dd87bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 -- 172.21.15.137:0/4219571296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 msgr2=0x55d8dd87c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd87c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.046+0000 7f5d4be00640 1 -- 172.21.15.137:0/4219571296 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8dd5b8620 con 0x55d8dd87efe0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d4be00640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f20 tx=0x7f5d44003c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffffa8f7d361986a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d34c00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44009be0 con 0x55d8dd87efe0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d44004050 con 0x55d8dd87efe0 2024-04-25T02:11:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5d4400f480 con 0x55d8dd87efe0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d44004610 con 0x55d8dd87efe0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d54ffa740 10 client.25934 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.047+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d8dd88da80 con 0x55d8dd87efe0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d44004050 con 0x55d8dd87efe0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5d44005480 con 0x55d8dd87efe0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 10 client.25934 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 20 client.25934 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd88ee30 0x55d8dd891220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 4 client.25934 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8dd7e4ff0 con 0x55d8dd88ee30 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.048+0000 7f5d4b400640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd88ee30 0x55d8dd891220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.049+0000 7f5d4b400640 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd88ee30 0x55d8dd891220 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565bf1bf834a3f09 server_cookie=aae1154212f3a78c in_seq=0 out_seq=0 2024-04-25T02:11:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.049+0000 7f5d34c00640 10 client.25934 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d34c00640 1 -- 172.21.15.137:0/4219571296 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8dd7e4ff0 con 0x55d8dd88ee30 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d34c00640 10 client.25934 handle_command_reply: tid=0 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 client.25934 shutdown 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 msgr2=0x55d8dd87c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f20 tx=0x7f5d44003c60 comp rx=0 tx=0).stop 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 shutdown_connections 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd88ee30 0x55d8dd891220 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd87c980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd87c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d34c00640 0 client.25934 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/4219571296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 >> 172.21.15.137:0/4219571296 conn(0x55d8dd870310 msgr2=0x55d8dd876040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 shutdown_connections 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 1 -- 172.21.15.137:0/4219571296 wait complete. 2024-04-25T02:11:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.050+0000 7f5d54ffa740 20 client.25934 trim_cache size 0 max 16384 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 Processor -- start 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 -- start start 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd88aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd86ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1b1e40 con 0x55d8dd874720 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1af710 con 0x55d8dd87efe0 2024-04-25T02:11:55.075 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.067+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1ad560 con 0x55d8dd873e00 2024-04-25T02:11:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:49340/0 (socket says 172.21.15.137:49340) 2024-04-25T02:11:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 -- 172.21.15.137:0/1227780952 learned_addr learned my addr 172.21.15.137:0/1227780952 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:55.077 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4be00640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd86ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd88aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 -- 172.21.15.137:0/1227780952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 msgr2=0x55d8dd86ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd86ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 -- 172.21.15.137:0/1227780952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 msgr2=0x55d8dd88aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd88aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 -- 172.21.15.137:0/1227780952 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8dd870140 con 0x55d8dd873e00 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd88aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.068+0000 7f5d4b400640 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c006010 tx=0x7f5d3c03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2562f21a74334a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.069+0000 7f5d37400640 1 -- 172.21.15.137:0/1227780952 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c035040 con 0x55d8dd873e00 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.069+0000 7f5d37400640 1 -- 172.21.15.137:0/1227780952 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d3c059070 con 0x55d8dd873e00 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.069+0000 7f5d37400640 1 -- 172.21.15.137:0/1227780952 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c004ac0 con 0x55d8dd873e00 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.069+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1227780952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 msgr2=0x55d8dd87e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.069+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c006010 tx=0x7f5d3c03f000 comp rx=0 tx=0).stop 2024-04-25T02:11:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1227780952 shutdown_connections 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd87efe0 0x55d8dd86ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd874720 0x55d8dd88aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/1227780952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd873e00 0x55d8dd87e6d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1227780952 >> 172.21.15.137:0/1227780952 conn(0x55d8dd870310 msgr2=0x55d8dd87dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1227780952 shutdown_connections 2024-04-25T02:11:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 -- 172.21.15.137:0/1227780952 wait complete. 2024-04-25T02:11:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 -- start start 2024-04-25T02:11:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.070+0000 7f5d54ffa740 1 Processor -- start 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd886fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd87efe0 0x55d8dd883fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1adbd0 con 0x55d8dd873e00 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1af040 con 0x55d8dd874720 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c1ae2a0 con 0x55d8dd87efe0 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d54ffa740 10 client.0 _ll_register_callbacks cb 0x7f5d380d2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:51834/0 (socket says 172.21.15.137:51834) 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 -- 172.21.15.137:0/2143221832 learned_addr learned my addr 172.21.15.137:0/2143221832 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4b400640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd886fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4be00640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd87efe0 0x55d8dd883fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 -- 172.21.15.137:0/2143221832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd87efe0 msgr2=0x55d8dd883fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd87efe0 0x55d8dd883fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 -- 172.21.15.137:0/2143221832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 msgr2=0x55d8dd886fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd886fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.071+0000 7f5d4aa00640 1 -- 172.21.15.137:0/2143221832 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8dd874e90 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d4aa00640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d3809b770 tx=0x7f5d380045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a9d5d5cd85ad40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d380cf040 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d3c059070 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5d3809bc40 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d3801c040 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d54ffa740 10 client.25940 fetch_fsmap learned FSMap version 26 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d8dd8f5ca0 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d3c059070 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.072+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5d380a3fc0 con 0x55d8dd874720 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 10 client.25940 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:11:55.083 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 10 client.25940 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 20 client.25940 populate_metadata read hostname 'smithi137' 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd8f6400 0x55d8dd8f8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 4 client.25940 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8dd7df340 con 0x55d8dd8f6400 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d4b400640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd8f6400 0x55d8dd8f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d4b400640 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd8f6400 0x55d8dd8f8820 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62c5d9ab4b9519fd server_cookie=893e14d3709c97f5 in_seq=0 out_seq=0 2024-04-25T02:11:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:55.073+0000 7f5d34c00640 10 client.25940 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:55.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:55 smithi163 ceph-mon[32577]: pgmap v69: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 1.04k op/s 2024-04-25T02:11:55.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:55 smithi174 ceph-mon[33171]: pgmap v69: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 1.04k op/s 2024-04-25T02:11:56.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:55 smithi137 ceph-mon[28303]: pgmap v69: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 1.04k op/s 2024-04-25T02:11:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.721+0000 7f5d34c00640 1 -- 172.21.15.137:0/2143221832 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8dd7df340 con 0x55d8dd8f6400 2024-04-25T02:11:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.721+0000 7f5d34c00640 10 client.25940 handle_command_reply: tid=0 2024-04-25T02:11:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.721+0000 7f5d54ffa740 1 client.25940 shutdown 2024-04-25T02:11:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.721+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 msgr2=0x55d8dd887520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5d3809b770 tx=0x7f5d380045b0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 shutdown_connections 2024-04-25T02:11:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55d8dd8f6400 0x55d8dd8f8820 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8dd87efe0 0x55d8dd883fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d8dd874720 0x55d8dd887520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 --2- 172.21.15.137:0/2143221832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8dd873e00 0x55d8dd886fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 >> 172.21.15.137:0/2143221832 conn(0x55d8dd870310 msgr2=0x55d8dd889ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.722+0000 7f5d34c00640 0 client.25940 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.723+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 shutdown_connections 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.723+0000 7f5d54ffa740 1 -- 172.21.15.137:0/2143221832 wait complete. 2024-04-25T02:11:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.723+0000 7f5d54ffa740 20 client.25940 trim_cache size 0 max 16384 2024-04-25T02:11:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:11:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:11:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:11:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 msgr2=0x7f5d300a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 0x7f5d300a53c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c032fd0 tx=0x7f5d3c005a20 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 msgr2=0x7f5d4c19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 0x7f5d4c19a780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9f0 tx=0x7f5d3800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 shutdown_connections 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5d300a2f00 0x7f5d300a53c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d4c109950 0x7f5d4c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d4c104300 0x7f5d4c19a780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 --2- 172.21.15.137:0/868768771 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d4c103940 0x7f5d4c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 >> 172.21.15.137:0/868768771 conn(0x7f5d4c0ff410 msgr2=0x7f5d4c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 shutdown_connections 2024-04-25T02:11:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:11:56.724+0000 7f5d52200640 1 -- 172.21.15.137:0/868768771 wait complete. 2024-04-25T02:11:57.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:57 smithi163 ceph-mon[32577]: pgmap v70: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-25T02:11:57.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:57 smithi174 ceph-mon[33171]: pgmap v70: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-25T02:11:58.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:57 smithi137 ceph-mon[28303]: pgmap v70: 97 pgs: 97 active+clean; 141 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-25T02:11:59.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ sync 2024-04-25T02:11:59.893 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:11:59 smithi163 ceph-mon[32577]: pgmap v71: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 1.16k op/s 2024-04-25T02:11:59.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:11:59 smithi174 ceph-mon[33171]: pgmap v71: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 1.16k op/s 2024-04-25T02:12:00.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:11:59 smithi137 ceph-mon[28303]: pgmap v71: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 1.16k op/s 2024-04-25T02:12:00.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-25T02:12:00.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 -- 172.21.15.137:0/1712182835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c10dd00 msgr2=0x7f211c10e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 --2- 172.21.15.137:0/1712182835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c10dd00 0x7f211c10e0e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f210c009ca0 tx=0x7f210c02a940 comp rx=0 tx=0).stop 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 -- 172.21.15.137:0/1712182835 shutdown_connections 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 --2- 172.21.15.137:0/1712182835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c108680 0x7f211c114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 --2- 172.21.15.137:0/1712182835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c107ce0 0x7f211c108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 --2- 172.21.15.137:0/1712182835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c10dd00 0x7f211c10e0e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 -- 172.21.15.137:0/1712182835 >> 172.21.15.137:0/1712182835 conn(0x7f211c077560 msgr2=0x7f211c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 -- 172.21.15.137:0/1712182835 shutdown_connections 2024-04-25T02:12:01.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.073+0000 7f2121800640 1 -- 172.21.15.137:0/1712182835 wait complete. 2024-04-25T02:12:01.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.074+0000 7f2121800640 1 Processor -- start 2024-04-25T02:12:01.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 -- start start 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c108680 0x7f211c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c10dd00 0x7f211c1a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f211c118150 con 0x7f211c108680 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f211c117fd0 con 0x7f211c107ce0 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f2121800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1182d0 con 0x7f211c10dd00 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f211be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f211be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32786/0 (socket says 172.21.15.137:32786) 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.075+0000 7f211be00640 1 -- 172.21.15.137:0/2418888529 learned_addr learned my addr 172.21.15.137:0/2418888529 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2113400640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c108680 0x7f211c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2120e00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c10dd00 0x7f211c1a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 -- 172.21.15.137:0/2418888529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c10dd00 msgr2=0x7f211c1a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c10dd00 0x7f211c1a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 -- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c108680 msgr2=0x7f211c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c108680 0x7f211c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 -- 172.21.15.137:0/2418888529 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c1a3500 con 0x7f211c107ce0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f211be00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f210c005e30 tx=0x7f210c02f780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2119600640 1 -- 172.21.15.137:0/2418888529 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c034040 con 0x7f211c107ce0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2119600640 1 -- 172.21.15.137:0/2418888529 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f210c02fbf0 con 0x7f211c107ce0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c1a3790 con 0x7f211c107ce0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.076+0000 7f2119600640 1 -- 172.21.15.137:0/2418888529 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c039430 con 0x7f211c107ce0 2024-04-25T02:12:01.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.077+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1ab080 con 0x7f211c107ce0 2024-04-25T02:12:01.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 Processor -- start 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 -- start start 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2119600640 1 -- 172.21.15.137:0/2418888529 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f210c037020 con 0x7f211c107ce0 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fefc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35ff25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d35f49560 con 0x562d35ff01d0 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x562d35ef1930 con 0x562d35fe51e0 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2125dd5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562d35f45520 con 0x562d35fe5b00 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2120e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2120e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32802/0 (socket says 172.21.15.137:32802) 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2113400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35ff25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f2120e00640 1 -- 172.21.15.137:0/382855795 learned_addr learned my addr 172.21.15.137:0/382855795 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.080+0000 7f211be00640 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fefc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 -- 172.21.15.137:0/382855795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 msgr2=0x562d35fefc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fefc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 -- 172.21.15.137:0/382855795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 msgr2=0x562d35ff25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35ff25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 -- 172.21.15.137:0/382855795 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d35d277d0 con 0x562d35fe51e0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2113400640 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35ff25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2120e00640 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2114009c60 tx=0x7f2114011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a14f6bd94527ea61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2111600640 1 -- 172.21.15.137:0/382855795 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114004230 con 0x562d35fe51e0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2111600640 1 -- 172.21.15.137:0/382855795 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2114009e10 con 0x562d35fe51e0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2111600640 1 -- 172.21.15.137:0/382855795 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114019880 con 0x562d35fe51e0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.081+0000 7f2119600640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 0x7f21000a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2119600640 1 -- 172.21.15.137:0/2418888529 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f210c0f0170 con 0x7f211c107ce0 2024-04-25T02:12:01.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f211be00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 0x7f21000a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 -- 172.21.15.137:0/382855795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 msgr2=0x562d35fe55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2114009c60 tx=0x7f2114011810 comp rx=0 tx=0).stop 2024-04-25T02:12:01.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 -- 172.21.15.137:0/382855795 shutdown_connections 2024-04-25T02:12:01.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35ff25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fefc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 --2- 172.21.15.137:0/382855795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe51e0 0x562d35fe55c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 -- 172.21.15.137:0/382855795 >> 172.21.15.137:0/382855795 conn(0x562d35fe1500 msgr2=0x562d35fe18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 -- 172.21.15.137:0/382855795 shutdown_connections 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f211be00640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 0x7f21000a5240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x562d35fe67a0 tx=0x7f210c0f3c20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.082+0000 7f2125dd5740 1 -- 172.21.15.137:0/382855795 wait complete. 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 -- start start 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 Processor -- start 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 0x562d35fedb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562d35ff2fc0 con 0x562d35fe51e0 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x562d35f04d90 con 0x562d35fe5b00 2024-04-25T02:12:01.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562d35ff3140 con 0x562d35ff01d0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.083+0000 7f2125dd5740 10 client.0 _ll_register_callbacks cb 0x562d35f04780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2120e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32810/0 (socket says 172.21.15.137:32810) 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 -- 172.21.15.137:0/3917010061 learned_addr learned my addr 172.21.15.137:0/3917010061 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2120e00640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 0x562d35fedb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 -- 172.21.15.137:0/3917010061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 msgr2=0x562d35fedb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 0x562d35fedb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 -- 172.21.15.137:0/3917010061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 msgr2=0x562d35fed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 -- 172.21.15.137:0/3917010061 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d35c5d3f0 con 0x562d35fe5b00 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2120e00640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 0x562d35fedb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f2113400640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2104012700 tx=0x7f2104012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d02fe1a4ae6171b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f210a000640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:01.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.084+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104004030 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f21040041d0 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2114009e10 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21040043d0 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 10 client.25952 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d35c1d0f0 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2114009e10 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2104003bc0 con 0x562d35fe5b00 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 10 client.25952 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 10 client.25952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 20 client.25952 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360005c0 0x562d360029d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 4 client.25952 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.085+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d35f5cd90 con 0x562d360005c0 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.086+0000 7f2120e00640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360005c0 0x562d360029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.086+0000 7f2120e00640 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360005c0 0x562d360029d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be6679ab79e4be91 server_cookie=f9049def582b074c in_seq=0 out_seq=0 2024-04-25T02:12:01.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.086+0000 7f210a000640 10 client.25952 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f210a000640 1 -- 172.21.15.137:0/3917010061 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d35f5cd90 con 0x562d360005c0 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f210a000640 10 client.25952 handle_command_reply: tid=0 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 client.25952 shutdown 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 msgr2=0x562d35fed650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2104012700 tx=0x7f2104012bc0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 shutdown_connections 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360005c0 0x562d360029d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35ff01d0 0x562d35fedb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35fed650 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 --2- 172.21.15.137:0/3917010061 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f210a000640 0 client.25952 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 >> 172.21.15.137:0/3917010061 conn(0x562d35fe1500 msgr2=0x562d35fe7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 shutdown_connections 2024-04-25T02:12:01.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.088+0000 7f2125dd5740 1 -- 172.21.15.137:0/3917010061 wait complete. 2024-04-25T02:12:01.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.089+0000 7f2125dd5740 20 client.25952 trim_cache size 0 max 16384 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 Processor -- start 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 -- start start 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe51e0 0x562d35fe0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35fed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b6140 con 0x562d35ff01d0 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b3a10 con 0x562d35fe5b00 2024-04-25T02:12:01.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.107+0000 7f2125dd5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b1860 con 0x562d35fe51e0 2024-04-25T02:12:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2120e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35fed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32812/0 (socket says 172.21.15.137:32812) 2024-04-25T02:12:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 -- 172.21.15.137:0/1967687286 learned_addr learned my addr 172.21.15.137:0/1967687286 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2120e00640 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe51e0 0x562d35fe0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 -- 172.21.15.137:0/1967687286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe51e0 msgr2=0x562d35fe0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe51e0 0x562d35fe0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 -- 172.21.15.137:0/1967687286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 msgr2=0x562d35fed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35fed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 -- 172.21.15.137:0/1967687286 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d35feb6a0 con 0x562d35fe5b00 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2120e00640 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35fed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2113400640 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2104000c00 tx=0x7f2104009640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3aebdf4dbc40da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2110c00640 1 -- 172.21.15.137:0/1967687286 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104029030 con 0x562d35fe5b00 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.108+0000 7f2110c00640 1 -- 172.21.15.137:0/1967687286 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2104010860 con 0x562d35fe5b00 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2110c00640 1 -- 172.21.15.137:0/1967687286 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210400fc40 con 0x562d35fe5b00 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 -- 172.21.15.137:0/1967687286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 msgr2=0x562d35ffbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2104000c00 tx=0x7f2104009640 comp rx=0 tx=0).stop 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 -- 172.21.15.137:0/1967687286 shutdown_connections 2024-04-25T02:12:01.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35ff01d0 0x562d35fed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35fe5b00 0x562d35ffbee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 --2- 172.21.15.137:0/1967687286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe51e0 0x562d35fe0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 -- 172.21.15.137:0/1967687286 >> 172.21.15.137:0/1967687286 conn(0x562d35fe1500 msgr2=0x562d35fed0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 -- 172.21.15.137:0/1967687286 shutdown_connections 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.109+0000 7f2125dd5740 1 -- 172.21.15.137:0/1967687286 wait complete. 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 -- start start 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 Processor -- start 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35ff01d0 0x562d35fea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b1ed0 con 0x562d35fe51e0 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b3340 con 0x562d35ff01d0 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1b25a0 con 0x562d35fe5b00 2024-04-25T02:12:01.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2125dd5740 10 client.0 _ll_register_callbacks cb 0x7f2104009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2120e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2120e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57856/0 (socket says 172.21.15.137:57856) 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2120e00640 1 -- 172.21.15.137:0/2445180694 learned_addr learned my addr 172.21.15.137:0/2445180694 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.110+0000 7f2120e00640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35ff01d0 0x562d35fea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2113400640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 -- 172.21.15.137:0/2445180694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 msgr2=0x562d35fea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 -- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35ff01d0 msgr2=0x562d35fea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35ff01d0 0x562d35fea800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 -- 172.21.15.137:0/2445180694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d36065b50 con 0x562d35fe51e0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2120e00640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2114009c30 tx=0x7f2114011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a27db9054fc676 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f210a000640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114003ca0 con 0x562d35fe51e0 2024-04-25T02:12:01.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f21140050e0 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2104010860 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21140052e0 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2125dd5740 10 client.15879 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.111+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d36066dc0 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2104010860 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f2114037060 con 0x562d35fe51e0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 20 client.15879 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360673b0 0x562d360697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 4 client.15879 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d35f56aa0 con 0x562d360673b0 2024-04-25T02:12:01.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.112+0000 7f2113400640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360673b0 0x562d360697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.113+0000 7f2113400640 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360673b0 0x562d360697d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9a386cc57436ed1 server_cookie=cb03342cd2a33b17 in_seq=0 out_seq=0 2024-04-25T02:12:01.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.113+0000 7f210a000640 10 client.15879 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f210a000640 1 -- 172.21.15.137:0/2445180694 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562d35f56aa0 con 0x562d360673b0 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f210a000640 10 client.15879 handle_command_reply: tid=0 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 client.15879 shutdown 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 msgr2=0x562d35fe9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2114009c30 tx=0x7f2114011810 comp rx=0 tx=0).stop 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 shutdown_connections 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x562d360673b0 0x562d360697d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562d35ff01d0 0x562d35fea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d35fe5b00 0x562d35fea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 --2- 172.21.15.137:0/2445180694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562d35fe51e0 0x562d35fe9d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 >> 172.21.15.137:0/2445180694 conn(0x562d35fe1500 msgr2=0x562d35fed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f210a000640 0 client.15879 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 shutdown_connections 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 1 -- 172.21.15.137:0/2445180694 wait complete. 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.115+0000 7f2125dd5740 20 client.15879 trim_cache size 0 max 16384 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-25T02:12:01.126 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 msgr2=0x7f21000a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 0x7f21000a5240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x562d35fe67a0 tx=0x7f210c0f3c20 comp rx=0 tx=0).stop 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 msgr2=0x7f211c19e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f210c005e30 tx=0x7f210c02f780 comp rx=0 tx=0).stop 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 shutdown_connections 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f21000a2d80 0x7f21000a5240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f211c10dd00 0x7f211c1a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f211c108680 0x7f211c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 --2- 172.21.15.137:0/2418888529 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c107ce0 0x7f211c19e510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 >> 172.21.15.137:0/2418888529 conn(0x7f211c077560 msgr2=0x7f211c0783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 shutdown_connections 2024-04-25T02:12:01.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.116+0000 7f2121800640 1 -- 172.21.15.137:0/2418888529 wait complete. 2024-04-25T02:12:01.139 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T02:12:01.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2751424456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 msgr2=0x7fbeb4103bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2751424456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb4103bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009900 tx=0x7fbea002a410 comp rx=0 tx=0).stop 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2751424456 shutdown_connections 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2751424456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 0x7fbeb4110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2751424456 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb4103bb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2751424456 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 0x7fbeb4109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2751424456 >> 172.21.15.137:0/2751424456 conn(0x7fbeb40ff1e0 msgr2=0x7fbeb4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2751424456 shutdown_connections 2024-04-25T02:12:01.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.309+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2751424456 wait complete. 2024-04-25T02:12:01.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 Processor -- start 2024-04-25T02:12:01.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 -- start start 2024-04-25T02:12:01.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 0x7fbeb419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 0x7fbeb419e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb4113c80 con 0x7fbeb4109740 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb4113b00 con 0x7fbeb4103730 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.310+0000 7fbeb9e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb4113e00 con 0x7fbeb41040f0 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32848/0 (socket says 172.21.15.137:32848) 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 -- 172.21.15.137:0/2801087608 learned_addr learned my addr 172.21.15.137:0/2801087608 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb9400640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 0x7fbeb419e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb3e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 0x7fbeb419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 -- 172.21.15.137:0/2801087608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 msgr2=0x7fbeb419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 0x7fbeb419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 -- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 msgr2=0x7fbeb419e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 0x7fbeb419e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 -- 172.21.15.137:0/2801087608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb419f110 con 0x7fbeb4103730 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.311+0000 7fbeb8a00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbea800e9f0 tx=0x7fbea800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.312+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea800cd80 con 0x7fbeb4103730 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.312+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbea8010930 con 0x7fbeb4103730 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.312+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb419f400 con 0x7fbeb4103730 2024-04-25T02:12:01.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.312+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8018b00 con 0x7fbeb4103730 2024-04-25T02:12:01.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.312+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb41a6c90 con 0x7fbeb4103730 2024-04-25T02:12:01.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.313+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb40688d0 con 0x7fbeb4103730 2024-04-25T02:12:01.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.315+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fbea8018ca0 con 0x7fbeb4103730 2024-04-25T02:12:01.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.316+0000 7fbeb1600640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 0x7fbe9c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.316+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fbea80cf720 con 0x7fbeb4103730 2024-04-25T02:12:01.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.316+0000 7fbeb3e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 0x7fbe9c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.317+0000 7fbeb3e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 0x7fbe9c0a5240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea0005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.320+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fbea809bcc0 con 0x7fbeb4103730 2024-04-25T02:12:01.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.554+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeb402d170 con 0x7fbeb4103730 2024-04-25T02:12:01.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.554+0000 7fbeb1600640 1 -- 172.21.15.137:0/2801087608 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11889 (secure 0 0 0) 0x7fbea809ffc0 con 0x7fbeb4103730 2024-04-25T02:12:01.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:12:01.566 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:11:39.412662+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":70,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:12:01.567 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 26 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 msgr2=0x7fbe9c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 0x7fbe9c0a5240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea0005e80 comp rx=0 tx=0).stop 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 msgr2=0x7fbeb419a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbea800e9f0 tx=0x7fbea800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 shutdown_connections 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fbe9c0a2d80 0x7fbe9c0a5240 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbeb4109740 0x7fbeb419e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbeb41040f0 0x7fbeb419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 --2- 172.21.15.137:0/2801087608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbeb4103730 0x7fbeb419a120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 >> 172.21.15.137:0/2801087608 conn(0x7fbeb40ff1e0 msgr2=0x7fbeb40ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 shutdown_connections 2024-04-25T02:12:01.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.557+0000 7fbeb9e00640 1 -- 172.21.15.137:0/2801087608 wait complete. 2024-04-25T02:12:01.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.787+0000 7fe880200640 1 -- 172.21.15.137:0/166127531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe87810d040 msgr2=0x7fe878114c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.787+0000 7fe880200640 1 --2- 172.21.15.137:0/166127531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe87810d040 0x7fe878114c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe870009ca0 tx=0x7fe87002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 -- 172.21.15.137:0/166127531 shutdown_connections 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 --2- 172.21.15.137:0/166127531 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe87810d040 0x7fe878114c10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 --2- 172.21.15.137:0/166127531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878108970 0x7fe87810c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 --2- 172.21.15.137:0/166127531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878107fc0 0x7fe8781083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 -- 172.21.15.137:0/166127531 >> 172.21.15.137:0/166127531 conn(0x7fe878075c80 msgr2=0x7fe8780780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 -- 172.21.15.137:0/166127531 shutdown_connections 2024-04-25T02:12:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.788+0000 7fe880200640 1 -- 172.21.15.137:0/166127531 wait complete. 2024-04-25T02:12:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 Processor -- start 2024-04-25T02:12:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 -- start start 2024-04-25T02:12:01.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878107fc0 0x7fe87819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe87810d040 0x7fe87819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe878118210 con 0x7fe87810d040 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe878118090 con 0x7fe8781a2f90 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.789+0000 7fe880200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe878118390 con 0x7fe878107fc0 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe87810d040 0x7fe87819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32860/0 (socket says 172.21.15.137:32860) 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 -- 172.21.15.137:0/2213340853 learned_addr learned my addr 172.21.15.137:0/2213340853 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87d800640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878107fc0 0x7fe87819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 -- 172.21.15.137:0/2213340853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878107fc0 msgr2=0x7fe87819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878107fc0 0x7fe87819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 -- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe87810d040 msgr2=0x7fe87819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe87810d040 0x7fe87819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 -- 172.21.15.137:0/2213340853 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8781a3a80 con 0x7fe8781a2f90 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.790+0000 7fe87e200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe870006010 tx=0x7fe8700319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.791+0000 7fe876000640 1 -- 172.21.15.137:0/2213340853 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87002fa20 con 0x7fe8781a2f90 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.791+0000 7fe876000640 1 -- 172.21.15.137:0/2213340853 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe87002fbc0 con 0x7fe8781a2f90 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.791+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781a3d10 con 0x7fe8781a2f90 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.791+0000 7fe876000640 1 -- 172.21.15.137:0/2213340853 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8700466c0 con 0x7fe8781a2f90 2024-04-25T02:12:01.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.791+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8781ab560 con 0x7fe8781a2f90 2024-04-25T02:12:01.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.795+0000 7fe883020740 1 Processor -- start 2024-04-25T02:12:01.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.795+0000 7fe876000640 1 -- 172.21.15.137:0/2213340853 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fe87002fd70 con 0x7fe8781a2f90 2024-04-25T02:12:01.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.795+0000 7fe883020740 1 -- start start 2024-04-25T02:12:01.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b3f8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d98b3524e0 con 0x55d98b3f85b0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d98b2faa70 con 0x55d98b3ed5c0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe883020740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d98b34e4a0 con 0x55d98b3edee0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b3f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3fa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57904/0 (socket says 172.21.15.137:57904) 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87ce00640 1 -- 172.21.15.137:0/3240534978 learned_addr learned my addr 172.21.15.137:0/3240534978 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87ce00640 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe876000640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 0x7fe8600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 -- 172.21.15.137:0/3240534978 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 msgr2=0x55d98b3ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 -- 172.21.15.137:0/3240534978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 msgr2=0x55d98b3fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87d800640 1 -- 172.21.15.137:0/3240534978 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98b0663f0 con 0x55d98b3edee0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe87ce00640 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.796+0000 7fe876000640 1 -- 172.21.15.137:0/2213340853 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe8700f0640 con 0x7fe8781a2f90 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.797+0000 7fe87e200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 0x7fe8600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.797+0000 7fe87d800640 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b3f8070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009c20 tx=0x7fe86c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8e76addde984f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.797+0000 7fe86aa00640 1 -- 172.21.15.137:0/3240534978 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01e070 con 0x55d98b3edee0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.797+0000 7fe86aa00640 1 -- 172.21.15.137:0/3240534978 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe86c009dd0 con 0x55d98b3edee0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.797+0000 7fe86aa00640 1 -- 172.21.15.137:0/3240534978 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c018910 con 0x55d98b3edee0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- 172.21.15.137:0/3240534978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 msgr2=0x55d98b3f8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe87e200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 0x7fe8600a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe870009430 tx=0x7fe8700095c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b3f8070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009c20 tx=0x7fe86c011810 comp rx=0 tx=0).stop 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- 172.21.15.137:0/3240534978 shutdown_connections 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b3f8070 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 --2- 172.21.15.137:0/3240534978 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- 172.21.15.137:0/3240534978 >> 172.21.15.137:0/3240534978 conn(0x55d98b3e98e0 msgr2=0x55d98b3e9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- 172.21.15.137:0/3240534978 shutdown_connections 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- 172.21.15.137:0/3240534978 wait complete. 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 -- start start 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.798+0000 7fe883020740 1 Processor -- start 2024-04-25T02:12:01.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 0x55d98b3f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d98b3fb3a0 con 0x55d98b3edee0 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55d98b30dec0 con 0x55d98b3f85b0 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d98b3fb520 con 0x55d98b3ed5c0 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe883020740 10 client.0 _ll_register_callbacks cb 0x55d98b34a3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:01.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe87ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe87ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34310/0 (socket says 172.21.15.137:34310) 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe87d800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 0x55d98b3f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe87ce00640 1 -- 172.21.15.137:0/3440983873 learned_addr learned my addr 172.21.15.137:0/3440983873 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.799+0000 7fe87ce00640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 -- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 msgr2=0x55d98b3f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 -- 172.21.15.137:0/3440983873 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3f85b0 msgr2=0x55d98b3f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 -- 172.21.15.137:0/3440983873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98b1307d0 con 0x55d98b3edee0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe87d800640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 0x55d98b3f5a70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097b0 tx=0x7fe86c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd86a7c2b0d903d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe85f400640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01e040 con 0x55d98b3edee0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe86c016070 con 0x55d98b3edee0 2024-04-25T02:12:01.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.800+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe86c009dd0 con 0x55d98b3edee0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe86c005030 con 0x55d98b3edee0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 10 client.15897 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d98b4075c0 con 0x55d98b3edee0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe86c009dd0 con 0x55d98b3edee0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe86c021070 con 0x55d98b3edee0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 10 client.15897 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 10 client.15897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 20 client.15897 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b408970 0x55d98b40ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 4 client.15897 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d98b35fa20 con 0x55d98b408970 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.801+0000 7fe87ce00640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b408970 0x55d98b40ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.802+0000 7fe87ce00640 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b408970 0x55d98b40ad60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf0be3ffef1f4cde server_cookie=8896c4d7225142cc in_seq=0 out_seq=0 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.802+0000 7fe85f400640 10 client.15897 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe85f400640 1 -- 172.21.15.137:0/3440983873 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d98b35fa20 con 0x55d98b408970 2024-04-25T02:12:01.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe85f400640 10 client.15897 handle_command_reply: tid=0 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 client.15897 shutdown 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 msgr2=0x55d98b3f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 0x55d98b3f5a70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097b0 tx=0x7fe86c0045e0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 shutdown_connections 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3edee0 0x55d98b3f5a70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b408970 0x55d98b40ad60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 --2- 172.21.15.137:0/3440983873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe85f400640 0 client.15897 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 >> 172.21.15.137:0/3440983873 conn(0x55d98b3e98e0 msgr2=0x55d98b3ef6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 shutdown_connections 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 1 -- 172.21.15.137:0/3440983873 wait complete. 2024-04-25T02:12:01.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.803+0000 7fe883020740 20 client.15897 trim_cache size 0 max 16384 2024-04-25T02:12:01.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 Processor -- start 2024-04-25T02:12:01.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 -- start start 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b6350 con 0x55d98b3f85b0 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b3c20 con 0x55d98b3ed5c0 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.817+0000 7fe883020740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b1a70 con 0x55d98b3edee0 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34322/0 (socket says 172.21.15.137:34322) 2024-04-25T02:12:01.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 -- 172.21.15.137:0/2724439246 learned_addr learned my addr 172.21.15.137:0/2724439246 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 -- 172.21.15.137:0/2724439246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 msgr2=0x55d98b3f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 -- 172.21.15.137:0/2724439246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 msgr2=0x55d98b3f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 -- 172.21.15.137:0/2724439246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98b3e9710 con 0x55d98b3edee0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.818+0000 7fe87d800640 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe86c011850 tx=0x7fe86c011e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66ab35a849f42c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe86a000640 1 -- 172.21.15.137:0/2724439246 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01e070 con 0x55d98b3edee0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe86a000640 1 -- 172.21.15.137:0/2724439246 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe86c016020 con 0x55d98b3edee0 2024-04-25T02:12:01.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe86a000640 1 -- 172.21.15.137:0/2724439246 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c005430 con 0x55d98b3edee0 2024-04-25T02:12:01.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 -- 172.21.15.137:0/2724439246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 msgr2=0x55d98b404290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe86c011850 tx=0x7fe86c011e40 comp rx=0 tx=0).stop 2024-04-25T02:12:01.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 -- 172.21.15.137:0/2724439246 shutdown_connections 2024-04-25T02:12:01.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3f85b0 0x55d98b3f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3edee0 0x55d98b404290 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 --2- 172.21.15.137:0/2724439246 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3ed5c0 0x55d98b3f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 -- 172.21.15.137:0/2724439246 >> 172.21.15.137:0/2724439246 conn(0x55d98b3e98e0 msgr2=0x55d98b3e8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.819+0000 7fe883020740 1 -- 172.21.15.137:0/2724439246 shutdown_connections 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.820+0000 7fe883020740 1 -- 172.21.15.137:0/2724439246 wait complete. 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.820+0000 7fe883020740 1 -- start start 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.820+0000 7fe883020740 1 Processor -- start 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 0x55d98b4007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3f85b0 0x55d98b3f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b20e0 con 0x55d98b3ed5c0 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b3550 con 0x55d98b3edee0 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b27b0 con 0x55d98b3f85b0 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe883020740 10 client.0 _ll_register_callbacks cb 0x7fe86c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32900/0 (socket says 172.21.15.137:32900) 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 -- 172.21.15.137:0/2019801912 learned_addr learned my addr 172.21.15.137:0/2019801912 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 0x55d98b4007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3f85b0 0x55d98b3f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 -- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3f85b0 msgr2=0x55d98b3f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3f85b0 0x55d98b3f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 -- 172.21.15.137:0/2019801912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 msgr2=0x55d98b4007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 0x55d98b4007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87d800640 1 -- 172.21.15.137:0/2019801912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98b3f24d0 con 0x55d98b3edee0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.821+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 0x55d98b4007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe87d800640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0058c0 tx=0x7fe86c0189f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fef11725109677a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe85f400640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01e040 con 0x55d98b3edee0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fe86c0053e0 con 0x55d98b3edee0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe86c016020 con 0x55d98b3edee0 2024-04-25T02:12:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe86c009dd0 con 0x55d98b3edee0 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe883020740 10 client.25979 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.822+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d98b46e980 con 0x55d98b3edee0 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe86c016020 con 0x55d98b3edee0 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe86c032070 con 0x55d98b3edee0 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 10 client.25979 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 10 client.25979 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 20 client.25979 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b46ed70 0x55d98b4711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 4 client.25979 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 --> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d98b359d70 con 0x55d98b46ed70 2024-04-25T02:12:01.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.823+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b46ed70 0x55d98b4711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:01.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe85f400640 10 client.25979 ms_handle_connect on v2:172.21.15.174:6836/1033703342 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe87ce00640 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b46ed70 0x55d98b4711b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba4ca9d395131dec server_cookie=23763ed9c2581f0b in_seq=0 out_seq=0 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe85f400640 1 -- 172.21.15.137:0/2019801912 <== mds.2 v2:172.21.15.174:6836/1033703342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2480 (crc 0 0 0) 0x55d98b359d70 con 0x55d98b46ed70 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe85f400640 10 client.25979 handle_command_reply: tid=0 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 client.25979 shutdown 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 msgr2=0x55d98b400ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0058c0 tx=0x7fe86c0189f0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 shutdown_connections 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:6836/1033703342,v1:172.21.15.174:6837/1033703342] conn(0x55d98b46ed70 0x55d98b4711b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d98b3f85b0 0x55d98b3f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe85f400640 0 client.25979 ms_handle_reset on v2:172.21.15.174:6836/1033703342 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d98b3edee0 0x55d98b400ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 --2- 172.21.15.137:0/2019801912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d98b3ed5c0 0x55d98b4007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 >> 172.21.15.137:0/2019801912 conn(0x55d98b3e98e0 msgr2=0x55d98b3eed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 shutdown_connections 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.824+0000 7fe883020740 1 -- 172.21.15.137:0/2019801912 wait complete. 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe883020740 20 client.25979 trim_cache size 0 max 16384 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 369751380, 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629277, 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt" 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.840 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 884732560, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629273, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt" 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 893584656, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629275, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt" 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.841 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1781477908, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629902, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt" 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 2792694835, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629274, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt" 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3813443025, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629901, 2024-04-25T02:12:01.842 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi" 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3903739111, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629272, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt" 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4255368948, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629276, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt" 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:01.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4270984996, 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629903, 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt" 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:12:01.844 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 msgr2=0x7fe8600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 0x7fe8600a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe870009430 tx=0x7fe8700095c0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 msgr2=0x7fe8781a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe870006010 tx=0x7fe8700319f0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 shutdown_connections 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8600a2d80 0x7fe8600a5240 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8781a2f90 0x7fe8781a3440 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe87810d040 0x7fe87819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 --2- 172.21.15.137:0/2213340853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe878107fc0 0x7fe87819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.825+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 >> 172.21.15.137:0/2213340853 conn(0x7fe878075c80 msgr2=0x7fe878077f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.826+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 shutdown_connections 2024-04-25T02:12:01.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:01.826+0000 7fe880200640 1 -- 172.21.15.137:0/2213340853 wait complete. 2024-04-25T02:12:01.847 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:01 smithi137 ceph-mon[28303]: pgmap v72: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 780 op/s 2024-04-25T02:12:01.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-25T02:12:01.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:01 smithi163 ceph-mon[32577]: pgmap v72: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 780 op/s 2024-04-25T02:12:01.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:01 smithi174 ceph-mon[33171]: pgmap v72: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 780 op/s 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 -- 172.21.15.137:0/1468699431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c073a10 msgr2=0x7f5c6c073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 --2- 172.21.15.137:0/1468699431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c073a10 0x7f5c6c073df0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009900 tx=0x7f5c5c02a480 comp rx=0 tx=0).stop 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 -- 172.21.15.137:0/1468699431 shutdown_connections 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 --2- 172.21.15.137:0/1468699431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 0x7f5c6c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 --2- 172.21.15.137:0/1468699431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c074330 0x7f5c6c10dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 --2- 172.21.15.137:0/1468699431 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c073a10 0x7f5c6c073df0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 -- 172.21.15.137:0/1468699431 >> 172.21.15.137:0/1468699431 conn(0x7f5c6c078b90 msgr2=0x7f5c6c078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 -- 172.21.15.137:0/1468699431 shutdown_connections 2024-04-25T02:12:02.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.022+0000 7f5c72400640 1 -- 172.21.15.137:0/1468699431 wait complete. 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 Processor -- start 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 -- start start 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 0x7f5c6c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 0x7f5c6c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c113e90 con 0x7f5c6c10e020 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c113d10 con 0x7f5c6c074330 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c72400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c114010 con 0x7f5c6c073a10 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 0x7f5c6c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c6b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 0x7f5c6c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c6b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34362/0 (socket says 172.21.15.137:34362) 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.023+0000 7f5c6b400640 1 -- 172.21.15.137:0/1029030618 learned_addr learned my addr 172.21.15.137:0/1029030618 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 -- 172.21.15.137:0/1029030618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 msgr2=0x7f5c6c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 0x7f5c6c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 -- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 msgr2=0x7f5c6c19ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 0x7f5c6c19ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 -- 172.21.15.137:0/1029030618 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c19f320 con 0x7f5c6c073a10 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 0x7f5c6c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c6b400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c004770 tx=0x7f5c5c032970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c63e00640 1 -- 172.21.15.137:0/1029030618 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c03f030 con 0x7f5c6c073a10 2024-04-25T02:12:02.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c19f5b0 con 0x7f5c6c073a10 2024-04-25T02:12:02.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c63e00640 1 -- 172.21.15.137:0/1029030618 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c5c032d70 con 0x7f5c6c073a10 2024-04-25T02:12:02.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.024+0000 7f5c63e00640 1 -- 172.21.15.137:0/1029030618 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c035070 con 0x7f5c6c073a10 2024-04-25T02:12:02.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.025+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c1a6ea0 con 0x7f5c6c073a10 2024-04-25T02:12:02.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.028+0000 7f5c753d6740 1 Processor -- start 2024-04-25T02:12:02.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.028+0000 7f5c753d6740 1 -- start start 2024-04-25T02:12:02.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b2f920a4e0 con 0x55b2f92a55c0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b2f91b2a70 con 0x55b2f92a5ee0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c753d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b2f92064a0 con 0x55b2f92b05b0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c63e00640 1 -- 172.21.15.137:0/1029030618 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f5c5c042030 con 0x7f5c6c073a10 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34372/0 (socket says 172.21.15.137:34372) 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.029+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3170524721 learned_addr learned my addr 172.21.15.137:0/3170524721 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6b400640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 -- 172.21.15.137:0/3170524721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 msgr2=0x55b2f92b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 -- 172.21.15.137:0/3170524721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 msgr2=0x55b2f92b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 -- 172.21.15.137:0/3170524721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f8f1e3f0 con 0x55b2f92a55c0 2024-04-25T02:12:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6b400640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92a59a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009b50 tx=0x7f5c64011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02bafe907a87a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c60c00640 1 -- 172.21.15.137:0/3170524721 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004050 con 0x55b2f92a55c0 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c60c00640 1 -- 172.21.15.137:0/3170524721 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c64005520 con 0x55b2f92a55c0 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.030+0000 7f5c60c00640 1 -- 172.21.15.137:0/3170524721 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004d90 con 0x55b2f92a55c0 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 -- 172.21.15.137:0/3170524721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 msgr2=0x55b2f92a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92a59a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009b50 tx=0x7f5c64011810 comp rx=0 tx=0).stop 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c63e00640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 0x7f5c4c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 -- 172.21.15.137:0/3170524721 shutdown_connections 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3170524721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92a59a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 -- 172.21.15.137:0/3170524721 >> 172.21.15.137:0/3170524721 conn(0x55b2f92a18e0 msgr2=0x55b2f92a1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c63e00640 1 -- 172.21.15.137:0/1029030618 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5c5c0ef600 con 0x7f5c6c073a10 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c6b400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 0x7f5c4c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 -- 172.21.15.137:0/3170524721 shutdown_connections 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.031+0000 7f5c753d6740 1 -- 172.21.15.137:0/3170524721 wait complete. 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c6b400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 0x7f5c4c0a5240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0ece30 tx=0x7f5c5c009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 -- start start 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 Processor -- start 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92a55c0 0x55b2f92ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b2f92b33a0 con 0x55b2f92a5ee0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55b2f91c5ec0 con 0x55b2f92b05b0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b2f92b3520 con 0x55b2f92a55c0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.032+0000 7f5c753d6740 10 client.0 _ll_register_callbacks cb 0x55b2f92023f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57982/0 (socket says 172.21.15.137:57982) 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 -- 172.21.15.137:0/2157024918 learned_addr learned my addr 172.21.15.137:0/2157024918 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32938/0 (socket says 172.21.15.137:32938) 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6be00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92a55c0 0x55b2f92ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 -- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92a55c0 msgr2=0x55b2f92ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92a55c0 0x55b2f92ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 -- 172.21.15.137:0/2157024918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 msgr2=0x55b2f92ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 -- 172.21.15.137:0/2157024918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f8fe87d0 con 0x55b2f92a5ee0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6be00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400fdf0 tx=0x7f5c54012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67a2b5fc38678b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.033+0000 7f5c59600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54003970 con 0x55b2f92a5ee0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c64005520 con 0x55b2f92a5ee0 2024-04-25T02:12:02.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5c54003b10 con 0x55b2f92a5ee0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c54003d10 con 0x55b2f92a5ee0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 10 client.15915 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b2f92bf6b0 con 0x55b2f92a5ee0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c64005520 con 0x55b2f92a5ee0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c5401c6d0 con 0x55b2f92a5ee0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 10 client.15915 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 10 client.15915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 20 client.15915 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f92c0ac0 0x55b2f92c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 4 client.15915 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.034+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2f9217a20 con 0x55b2f92c0ac0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.035+0000 7f5c6be00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f92c0ac0 0x55b2f92c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.035+0000 7f5c6be00640 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f92c0ac0 0x55b2f92c2ee0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efa9843b85ae73ab server_cookie=e7a4630c9437c6db in_seq=0 out_seq=0 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.035+0000 7f5c59600640 10 client.15915 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:12:02.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c59600640 1 -- 172.21.15.137:0/2157024918 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b2f9217a20 con 0x55b2f92c0ac0 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c59600640 10 client.15915 handle_command_reply: tid=0 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 client.15915 shutdown 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 msgr2=0x55b2f92adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400fdf0 tx=0x7f5c54012820 comp rx=0 tx=0).stop 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 shutdown_connections 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f92c0ac0 0x55b2f92c2ee0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92b05b0 0x55b2f92ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a5ee0 0x55b2f92adac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 --2- 172.21.15.137:0/2157024918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92a55c0 0x55b2f92ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 >> 172.21.15.137:0/2157024918 conn(0x55b2f92a18e0 msgr2=0x55b2f92a76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c59600640 0 client.15915 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 shutdown_connections 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 1 -- 172.21.15.137:0/2157024918 wait complete. 2024-04-25T02:12:02.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.036+0000 7f5c753d6740 20 client.15915 trim_cache size 0 max 16384 2024-04-25T02:12:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.054+0000 7f5c753d6740 1 Processor -- start 2024-04-25T02:12:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.054+0000 7f5c753d6740 1 -- start start 2024-04-25T02:12:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1b1fc0 con 0x55b2f92a55c0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1af890 con 0x55b2f92a5ee0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c753d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1ad6e0 con 0x55b2f92b05b0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32940/0 (socket says 172.21.15.137:32940) 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3991888360 learned_addr learned my addr 172.21.15.137:0/3991888360 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3991888360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 msgr2=0x55b2f92af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3991888360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 msgr2=0x55b2f92bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92bc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3991888360 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f92c3540 con 0x55b2f92a5ee0 2024-04-25T02:12:02.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.055+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:12:02.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.056+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5c5401cea0 tx=0x7f5c5401ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2adc3f2c97feb7a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.056+0000 7f5c5be00640 1 -- 172.21.15.137:0/3991888360 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54003970 con 0x55b2f92a5ee0 2024-04-25T02:12:02.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.056+0000 7f5c5be00640 1 -- 172.21.15.137:0/3991888360 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c54003b10 con 0x55b2f92a5ee0 2024-04-25T02:12:02.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.056+0000 7f5c5be00640 1 -- 172.21.15.137:0/3991888360 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54025c80 con 0x55b2f92a5ee0 2024-04-25T02:12:02.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- 172.21.15.137:0/3991888360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 msgr2=0x55b2f92ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5c5401cea0 tx=0x7f5c5401ced0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- 172.21.15.137:0/3991888360 shutdown_connections 2024-04-25T02:12:02.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b05b0 0x55b2f92af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a5ee0 0x55b2f92ac6e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3991888360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92a55c0 0x55b2f92bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- 172.21.15.137:0/3991888360 >> 172.21.15.137:0/3991888360 conn(0x55b2f92a18e0 msgr2=0x55b2f92aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- 172.21.15.137:0/3991888360 shutdown_connections 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- 172.21.15.137:0/3991888360 wait complete. 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 -- start start 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.057+0000 7f5c753d6740 1 Processor -- start 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 0x55b2f92b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b4e20 0x55b2f9325fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1add50 con 0x55b2f92b05b0 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1af1c0 con 0x55b2f92a55c0 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1ae420 con 0x55b2f92b4e20 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c753d6740 10 client.0 _ll_register_callbacks cb 0x7f5c5400f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:02.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32942/0 (socket says 172.21.15.137:32942) 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6be00640 1 -- 172.21.15.137:0/3010732360 learned_addr learned my addr 172.21.15.137:0/3010732360 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 0x55b2f92b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b4e20 0x55b2f9325fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b4e20 msgr2=0x55b2f9325fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b4e20 0x55b2f9325fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3010732360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 msgr2=0x55b2f92b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6aa00640 1 -- 172.21.15.137:0/3010732360 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f93266d0 con 0x55b2f92b05b0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.058+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c6aa00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 0x55b2f92b48e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55b2f92a68c0 tx=0x7f5c54003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8b7473d0e9c5c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c59600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54025e10 con 0x55b2f92b05b0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c54003b10 con 0x55b2f92b05b0 2024-04-25T02:12:02.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5c5401c470 con 0x55b2f92b05b0 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5c5401c670 con 0x55b2f92b05b0 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c753d6740 10 client.15921 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b2f93278c0 con 0x55b2f92b05b0 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.059+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c54003b10 con 0x55b2f92b05b0 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5c540054f0 con 0x55b2f92b05b0 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 10 client.15921 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 10 client.15921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 20 client.15921 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f9327fc0 0x55b2f932a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 4 client.15921 mds_command: new command op to 24559 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:12:02.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 --> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b2f9211d70 con 0x55b2f9327fc0 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.060+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f9327fc0 0x55b2f932a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c59600640 10 client.15921 ms_handle_connect on v2:172.21.15.174:6838/695835924 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c6be00640 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f9327fc0 0x55b2f932a3b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86af3e529b8e910b server_cookie=8dcdc25fc7f36b1a in_seq=0 out_seq=0 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c59600640 1 -- 172.21.15.137:0/3010732360 <== mds.1 v2:172.21.15.174:6838/695835924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4268 (crc 0 0 0) 0x55b2f9211d70 con 0x55b2f9327fc0 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c59600640 10 client.15921 handle_command_reply: tid=0 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 client.15921 shutdown 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 msgr2=0x55b2f92b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 0x55b2f92b48e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55b2f92a68c0 tx=0x7f5c54003970 comp rx=0 tx=0).stop 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 shutdown_connections 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:6838/695835924,v1:172.21.15.174:6839/695835924] conn(0x55b2f9327fc0 0x55b2f932a3b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b2f92b4e20 0x55b2f9325fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b2f92b05b0 0x55b2f92b48e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c59600640 0 client.15921 ms_handle_reset on v2:172.21.15.174:6838/695835924 2024-04-25T02:12:02.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 --2- 172.21.15.137:0/3010732360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b2f92a55c0 0x55b2f92b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 >> 172.21.15.137:0/3010732360 conn(0x55b2f92a18e0 msgr2=0x55b2f92a6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 shutdown_connections 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.061+0000 7f5c753d6740 1 -- 172.21.15.137:0/3010732360 wait complete. 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c753d6740 20 client.15921 trim_cache size 0 max 16384 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 262143352, 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629818, 2024-04-25T02:12:02.073 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt" 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 288588081, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629815, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt" 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 714858008, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629908, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt" 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.074 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 890507959, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629906, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt" 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1328657186, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629817, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt" 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1486040776, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629281, 2024-04-25T02:12:02.075 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt" 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1703886555, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629462, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event" 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1767630647, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629463, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt" 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.076 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 1926576620, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629907, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt" 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 2293109036, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629814, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt" 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 2709726882, 2024-04-25T02:12:02.077 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511628879, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README" 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 2968430476, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629909, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt" 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3389805539, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629820, 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt" 2024-04-25T02:12:02.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3851627635, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629819, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt" 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3930009410, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629816, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt" 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-25T02:12:02.079 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4275121724, 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511629821, 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt" 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 msgr2=0x7f5c4c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 0x7f5c4c0a5240 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0ece30 tx=0x7f5c5c009260 comp rx=0 tx=0).stop 2024-04-25T02:12:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 msgr2=0x7f5c6c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c004770 tx=0x7f5c5c032970 comp rx=0 tx=0).stop 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 shutdown_connections 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f5c4c0a2d80 0x7f5c4c0a5240 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c10e020 0x7f5c6c19ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c6c074330 0x7f5c6c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 --2- 172.21.15.137:0/1029030618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c6c073a10 0x7f5c6c19a330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 >> 172.21.15.137:0/1029030618 conn(0x7f5c6c078b90 msgr2=0x7f5c6c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 shutdown_connections 2024-04-25T02:12:02.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.062+0000 7f5c72400640 1 -- 172.21.15.137:0/1029030618 wait complete. 2024-04-25T02:12:02.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-25T02:12:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 -- 172.21.15.137:0/1054846462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5508107720 msgr2=0x7f5508107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 --2- 172.21.15.137:0/1054846462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5508107720 0x7f5508107b00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009900 tx=0x7f54fc02a400 comp rx=0 tx=0).stop 2024-04-25T02:12:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 -- 172.21.15.137:0/1054846462 shutdown_connections 2024-04-25T02:12:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 --2- 172.21.15.137:0/1054846462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f55081020d0 0x7f550810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 --2- 172.21.15.137:0/1054846462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508101710 0x7f5508101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 --2- 172.21.15.137:0/1054846462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5508107720 0x7f5508107b00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 -- 172.21.15.137:0/1054846462 >> 172.21.15.137:0/1054846462 conn(0x7f5508078b90 msgr2=0x7f5508078fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 -- 172.21.15.137:0/1054846462 shutdown_connections 2024-04-25T02:12:02.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.284+0000 7f550fa00640 1 -- 172.21.15.137:0/1054846462 wait complete. 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.285+0000 7f550fa00640 1 Processor -- start 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.285+0000 7f550fa00640 1 -- start start 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5508101710 0x7f550819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 0x7f550819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5508111ca0 con 0x7f5508101710 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5508111b20 con 0x7f55081020d0 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550fa00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5508111e20 con 0x7f5508107720 2024-04-25T02:12:02.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f5507e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f5507e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32962/0 (socket says 172.21.15.137:32962) 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f5507e00640 1 -- 172.21.15.137:0/833666608 learned_addr learned my addr 172.21.15.137:0/833666608 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550da00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 0x7f550819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.286+0000 7f550d000640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5508101710 0x7f550819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 -- 172.21.15.137:0/833666608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 msgr2=0x7f550819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 0x7f550819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 -- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5508101710 msgr2=0x7f550819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5508101710 0x7f550819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 -- 172.21.15.137:0/833666608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550819f2e0 con 0x7f55081020d0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f550da00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 0x7f550819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5507e00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9f0 tx=0x7f54f400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5505600640 1 -- 172.21.15.137:0/833666608 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400cd80 con 0x7f55081020d0 2024-04-25T02:12:02.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5505600640 1 -- 172.21.15.137:0/833666608 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54f4005520 con 0x7f55081020d0 2024-04-25T02:12:02.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.287+0000 7f5505600640 1 -- 172.21.15.137:0/833666608 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4010690 con 0x7f55081020d0 2024-04-25T02:12:02.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.288+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550819f5d0 con 0x7f55081020d0 2024-04-25T02:12:02.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.288+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55081a6e60 con 0x7f55081020d0 2024-04-25T02:12:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 Processor -- start 2024-04-25T02:12:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 -- start start 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bca1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bca15b0 0x555a4bca39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555a4bbfb4e0 con 0x555a4bc96ee0 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x555a4bba3a70 con 0x555a4bc965c0 2024-04-25T02:12:02.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.292+0000 7f55127ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a4bbf74a0 con 0x555a4bca15b0 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550d000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bca1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:32966/0 (socket says 172.21.15.137:32966) 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 -- 172.21.15.137:0/2625287981 learned_addr learned my addr 172.21.15.137:0/2625287981 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 -- 172.21.15.137:0/2625287981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bca15b0 msgr2=0x555a4bca39a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bca15b0 0x555a4bca39a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 -- 172.21.15.137:0/2625287981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 msgr2=0x555a4bca1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bca1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 -- 172.21.15.137:0/2625287981 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4b90f3f0 con 0x555a4bc965c0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f5505600640 1 -- 172.21.15.137:0/833666608 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f54f40046c0 con 0x7f55081020d0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.293+0000 7f550da00640 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55000107a0 tx=0x7f5500010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12dd3804a79e5dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.294+0000 7f54fa000640 1 -- 172.21.15.137:0/2625287981 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500003b70 con 0x555a4bc965c0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.294+0000 7f54fa000640 1 -- 172.21.15.137:0/2625287981 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5500010e50 con 0x555a4bc965c0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.294+0000 7f54fa000640 1 -- 172.21.15.137:0/2625287981 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55000047a0 con 0x555a4bc965c0 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.294+0000 7f55127ba740 1 -- 172.21.15.137:0/2625287981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 msgr2=0x555a4bc969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.294+0000 7f55127ba740 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f55000107a0 tx=0x7f5500010c60 comp rx=0 tx=0).stop 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 -- 172.21.15.137:0/2625287981 shutdown_connections 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bca15b0 0x555a4bca39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bca1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 --2- 172.21.15.137:0/2625287981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc965c0 0x555a4bc969a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 -- 172.21.15.137:0/2625287981 >> 172.21.15.137:0/2625287981 conn(0x555a4bc928e0 msgr2=0x555a4bc92cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 -- 172.21.15.137:0/2625287981 shutdown_connections 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 -- 172.21.15.137:0/2625287981 wait complete. 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f5505600640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 0x7f54f00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f5505600640 1 -- 172.21.15.137:0/833666608 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f54f40cf7a0 con 0x7f55081020d0 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f550d000640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 0x7f54f00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.295+0000 7f55127ba740 1 -- start start 2024-04-25T02:12:02.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 Processor -- start 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc9e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc96ee0 0x555a4bc9ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555a4bcacac0 con 0x555a4bca15b0 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x555a4bbb6ec0 con 0x555a4bc96ee0 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555a4bcacc40 con 0x555a4bc965c0 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.296+0000 7f55127ba740 10 client.0 _ll_register_callbacks cb 0x555a4bbf33f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58028/0 (socket says 172.21.15.137:58028) 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 -- 172.21.15.137:0/3015439507 learned_addr learned my addr 172.21.15.137:0/3015439507 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 -- 172.21.15.137:0/3015439507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 msgr2=0x555a4bc9e670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc9e670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 -- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc96ee0 msgr2=0x555a4bc9ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f5507e00640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc96ee0 0x555a4bc9ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc96ee0 0x555a4bc9ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 -- 172.21.15.137:0/3015439507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4b9d97d0 con 0x555a4bca15b0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.297+0000 7f550da00640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5500009960 tx=0x7f55000104e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a6c42a3897e2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f54eea00640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f550d000640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 0x7f54f00a5150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54fc000c00 tx=0x7f54fc005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500003970 con 0x555a4bca15b0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5500010e50 con 0x555a4bca15b0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f5500003b10 con 0x555a4bca15b0 2024-04-25T02:12:02.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5500032050 con 0x555a4bca15b0 2024-04-25T02:12:02.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f55127ba740 10 client.15933 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:02.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.298+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a4bcb8f00 con 0x555a4bca15b0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5500010e50 con 0x555a4bca15b0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f550001a930 con 0x555a4bca15b0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 10 client.15933 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 20 client.15933 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bcba2b0 0x555a4bcbc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 4 client.15933 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.299+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a4bc08a20 con 0x555a4bcba2b0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.300+0000 7f550d000640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bcba2b0 0x555a4bcbc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.300+0000 7f550d000640 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bcba2b0 0x555a4bcbc6a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c6b3ca1b73bf15 server_cookie=f590b7cd89e717ed in_seq=0 out_seq=0 2024-04-25T02:12:02.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.300+0000 7f54eea00640 10 client.15933 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.302+0000 7f54eea00640 1 -- 172.21.15.137:0/3015439507 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555a4bc08a20 con 0x555a4bcba2b0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.302+0000 7f54eea00640 10 client.15933 handle_command_reply: tid=0 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.302+0000 7f55127ba740 1 client.15933 shutdown 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 msgr2=0x555a4bc9f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5500009960 tx=0x7f55000104e0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 shutdown_connections 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bcba2b0 0x555a4bcbc6a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bca15b0 0x555a4bc9f0f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bc96ee0 0x555a4bc9ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f54eea00640 0 client.15933 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 --2- 172.21.15.137:0/3015439507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc9e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 >> 172.21.15.137:0/3015439507 conn(0x555a4bc928e0 msgr2=0x555a4bc986e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 shutdown_connections 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 1 -- 172.21.15.137:0/3015439507 wait complete. 2024-04-25T02:12:02.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.303+0000 7f55127ba740 20 client.15933 trim_cache size 0 max 16384 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 Processor -- start 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 -- start start 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc91d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bcb5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bc9ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55081adc30 con 0x555a4bc96ee0 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f55081ab500 con 0x555a4bca15b0 2024-04-25T02:12:02.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.319+0000 7f55127ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55081a9370 con 0x555a4bc965c0 2024-04-25T02:12:02.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f550d000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc91d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f550d000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc91d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34406/0 (socket says 172.21.15.137:34406) 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f550d000640 1 -- 172.21.15.137:0/4106605750 learned_addr learned my addr 172.21.15.137:0/4106605750 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f550da00640 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bc9ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bcb5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 -- 172.21.15.137:0/4106605750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 msgr2=0x555a4bc91d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc91d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 -- 172.21.15.137:0/4106605750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 msgr2=0x555a4bc9ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bc9ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.320+0000 7f5507e00640 1 -- 172.21.15.137:0/4106605750 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4bca3d10 con 0x555a4bc96ee0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.321+0000 7f5507e00640 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bcb5a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54f40ccef0 tx=0x7f54f4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12204e2bc58a791 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.321+0000 7f54f9600640 1 -- 172.21.15.137:0/4106605750 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f409c3f0 con 0x555a4bc96ee0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.321+0000 7f54f9600640 1 -- 172.21.15.137:0/4106605750 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54f409bcf0 con 0x555a4bc96ee0 2024-04-25T02:12:02.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.321+0000 7f54f9600640 1 -- 172.21.15.137:0/4106605750 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f40a4730 con 0x555a4bc96ee0 2024-04-25T02:12:02.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- 172.21.15.137:0/4106605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 msgr2=0x555a4bcb5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bcb5a60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54f40ccef0 tx=0x7f54f4005760 comp rx=0 tx=0).stop 2024-04-25T02:12:02.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- 172.21.15.137:0/4106605750 shutdown_connections 2024-04-25T02:12:02.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bc9ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bcb5a60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 --2- 172.21.15.137:0/4106605750 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bc91d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- 172.21.15.137:0/4106605750 >> 172.21.15.137:0/4106605750 conn(0x555a4bc928e0 msgr2=0x555a4bc986b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- 172.21.15.137:0/4106605750 shutdown_connections 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- 172.21.15.137:0/4106605750 wait complete. 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 -- start start 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.322+0000 7f55127ba740 1 Processor -- start 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bd18e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bcad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f55081a99c0 con 0x555a4bc96ee0 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f55081aae30 con 0x555a4bca15b0 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55081aa090 con 0x555a4bc965c0 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f55127ba740 10 client.0 _ll_register_callbacks cb 0x7f54fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:02.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f550d000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f5507e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bd18e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f550d000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34416/0 (socket says 172.21.15.137:34416) 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f550d000640 1 -- 172.21.15.137:0/1266822308 learned_addr learned my addr 172.21.15.137:0/1266822308 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.323+0000 7f550da00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bcad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 -- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 msgr2=0x555a4bcad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bcad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 -- 172.21.15.137:0/1266822308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 msgr2=0x555a4bd18e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bd18e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 -- 172.21.15.137:0/1266822308 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4bcada30 con 0x555a4bc965c0 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550da00640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bcad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f5507e00640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bd18e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f550d000640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006010 tx=0x7f54fc03f070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6baf0406afa83414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:02.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f54eea00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc035040 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54f409bcf0 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f54fc0513a0 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f54fc0515a0 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f55127ba740 10 client.26044 fetch_fsmap learned FSMap version 26 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.324+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a4bd200e0 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54f409bcf0 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f54fc032680 con 0x555a4bc965c0 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 10 client.26044 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T02:12:02.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 10 client.26044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 20 client.26044 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bd207f0 0x555a4bd22c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 4 client.26044 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a4bc02d70 con 0x555a4bd207f0 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.325+0000 7f5507e00640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bd207f0 0x555a4bd22c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.326+0000 7f5507e00640 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bd207f0 0x555a4bd22c10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1ef26881005ae3 server_cookie=e48f80350019eae7 in_seq=0 out_seq=0 2024-04-25T02:12:02.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.326+0000 7f54eea00640 10 client.26044 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:02.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f54eea00640 1 -- 172.21.15.137:0/1266822308 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a4bc02d70 con 0x555a4bd207f0 2024-04-25T02:12:02.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f54eea00640 10 client.26044 handle_command_reply: tid=0 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 client.26044 shutdown 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 msgr2=0x555a4bd188c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54fc006010 tx=0x7f54fc03f070 comp rx=0 tx=0).stop 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 shutdown_connections 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x555a4bd207f0 0x555a4bd22c10 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555a4bca15b0 0x555a4bcad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555a4bc96ee0 0x555a4bd18e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f54eea00640 0 client.26044 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 --2- 172.21.15.137:0/1266822308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555a4bc965c0 0x555a4bd188c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 >> 172.21.15.137:0/1266822308 conn(0x555a4bc928e0 msgr2=0x555a4bc9ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 shutdown_connections 2024-04-25T02:12:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.328+0000 7f55127ba740 1 -- 172.21.15.137:0/1266822308 wait complete. 2024-04-25T02:12:02.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f55127ba740 20 client.26044 trim_cache size 0 max 16384 2024-04-25T02:12:02.339 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 msgr2=0x7f54f00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 0x7f54f00a5150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54fc000c00 tx=0x7f54fc005e80 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 msgr2=0x7f550819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9f0 tx=0x7f54f400edf0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 shutdown_connections 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f54f00a2c90 0x7f54f00a5150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5508107720 0x7f550819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55081020d0 0x7f550819a830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 --2- 172.21.15.137:0/833666608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5508101710 0x7f550819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 >> 172.21.15.137:0/833666608 conn(0x7f5508078b90 msgr2=0x7f55080fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.329+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 shutdown_connections 2024-04-25T02:12:02.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:12:02.330+0000 7f550fa00640 1 -- 172.21.15.137:0/833666608 wait complete. 2024-04-25T02:12:02.353 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 369751380, 'ino': 1099511629277, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt'}, {'damage_type': 'backtrace', 'id': 884732560, 'ino': 1099511629273, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt'}, {'damage_type': 'backtrace', 'id': 893584656, 'ino': 1099511629275, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt'}, {'damage_type': 'backtrace', 'id': 1781477908, 'ino': 1099511629902, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt'}, {'damage_type': 'backtrace', 'id': 2792694835, 'ino': 1099511629274, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt'}, {'damage_type': 'backtrace', 'id': 3813443025, 'ino': 1099511629901, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi'}, {'damage_type': 'backtrace', 'id': 3903739111, 'ino': 1099511629272, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt'}, {'damage_type': 'backtrace', 'id': 4255368948, 'ino': 1099511629276, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt'}, {'damage_type': 'backtrace', 'id': 4270984996, 'ino': 1099511629903, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt'}] 2024-04-25T02:12:02.353 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 262143352, 'ino': 1099511629818, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt'}, {'damage_type': 'backtrace', 'id': 288588081, 'ino': 1099511629815, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt'}, {'damage_type': 'backtrace', 'id': 714858008, 'ino': 1099511629908, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt'}, {'damage_type': 'backtrace', 'id': 890507959, 'ino': 1099511629906, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt'}, {'damage_type': 'backtrace', 'id': 1328657186, 'ino': 1099511629817, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt'}, {'damage_type': 'backtrace', 'id': 1486040776, 'ino': 1099511629281, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt'}, {'damage_type': 'backtrace', 'id': 1703886555, 'ino': 1099511629462, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event'}, {'damage_type': 'backtrace', 'id': 1767630647, 'ino': 1099511629463, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt'}, {'damage_type': 'backtrace', 'id': 1926576620, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt'}, {'damage_type': 'backtrace', 'id': 2293109036, 'ino': 1099511629814, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt'}, {'damage_type': 'backtrace', 'id': 2709726882, 'ino': 1099511628879, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/arm/Atmel/README'}, {'damage_type': 'backtrace', 'id': 2968430476, 'ino': 1099511629909, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt'}, {'damage_type': 'backtrace', 'id': 3389805539, 'ino': 1099511629820, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt'}, {'damage_type': 'backtrace', 'id': 3851627635, 'ino': 1099511629819, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt'}, {'damage_type': 'backtrace', 'id': 3930009410, 'ino': 1099511629816, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt'}, {'damage_type': 'backtrace', 'id': 4275121724, 'ino': 1099511629821, 'path': '/volumes/qa/sv_1/e4f57d96-0844-4e32-821b-43b279d27963/client.0/tmp/untar_tar/linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt'}] 2024-04-25T02:12:02.354 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-04-25T02:12:02.582 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar c linux-4.0.5 2024-04-25T02:12:02.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:02 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2801087608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:12:02.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:02 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2801087608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:12:03.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:02 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2801087608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:12:03.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -rf linux-4.0.5 2024-04-25T02:12:03.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:03 smithi163 ceph-mon[32577]: pgmap v73: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 781 op/s 2024-04-25T02:12:03.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:03 smithi174 ceph-mon[33171]: pgmap v73: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 781 op/s 2024-04-25T02:12:04.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:03 smithi137 ceph-mon[28303]: pgmap v73: 97 pgs: 97 active+clean; 113 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 781 op/s 2024-04-25T02:12:05.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:05 smithi163 ceph-mon[32577]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.13k op/s 2024-04-25T02:12:05.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:05 smithi174 ceph-mon[33171]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.13k op/s 2024-04-25T02:12:06.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:05 smithi137 ceph-mon[28303]: pgmap v74: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 1.13k op/s 2024-04-25T02:12:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:07 smithi163 ceph-mon[32577]: pgmap v75: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 1.03k op/s 2024-04-25T02:12:07.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:07 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:07 smithi174 ceph-mon[33171]: pgmap v75: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 1.03k op/s 2024-04-25T02:12:07.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:07 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:08.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:07 smithi137 ceph-mon[28303]: pgmap v75: 97 pgs: 97 active+clean; 140 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 1.03k op/s 2024-04-25T02:12:08.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:07 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:09.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:09 smithi163 ceph-mon[32577]: pgmap v76: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.16k op/s 2024-04-25T02:12:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.909+0000 7fcbd2800640 1 -- 172.21.15.137:0/1593879239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc109930 msgr2=0x7fcbcc109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.909+0000 7fcbd2800640 1 --2- 172.21.15.137:0/1593879239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc109930 0x7fcbcc109d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009930 tx=0x7fcbbc02a440 comp rx=0 tx=0).stop 2024-04-25T02:12:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 -- 172.21.15.137:0/1593879239 shutdown_connections 2024-04-25T02:12:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 --2- 172.21.15.137:0/1593879239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc1042e0 0x7fcbcc1107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 --2- 172.21.15.137:0/1593879239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc103920 0x7fcbcc103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 --2- 172.21.15.137:0/1593879239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc109930 0x7fcbcc109d10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 -- 172.21.15.137:0/1593879239 >> 172.21.15.137:0/1593879239 conn(0x7fcbcc0ff430 msgr2=0x7fcbcc101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 -- 172.21.15.137:0/1593879239 shutdown_connections 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.910+0000 7fcbd2800640 1 -- 172.21.15.137:0/1593879239 wait complete. 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 Processor -- start 2024-04-25T02:12:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 -- start start 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc1042e0 0x7fcbcc19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 0x7fcbcc19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113e30 con 0x7fcbcc103920 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113cb0 con 0x7fcbcc109930 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.911+0000 7fcbd2800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113fb0 con 0x7fcbcc1042e0 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58066/0 (socket says 172.21.15.137:58066) 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 -- 172.21.15.137:0/3559998327 learned_addr learned my addr 172.21.15.137:0/3559998327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc1042e0 0x7fcbcc19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 0x7fcbcc19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 -- 172.21.15.137:0/3559998327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc1042e0 msgr2=0x7fcbcc19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc1042e0 0x7fcbcc19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 -- 172.21.15.137:0/3559998327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 msgr2=0x7fcbcc19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 0x7fcbcc19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcb400640 1 -- 172.21.15.137:0/3559998327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc19f280 con 0x7fcbcc103920 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.912+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 0x7fcbcc19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbcb400640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009230 tx=0x7fcbbc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbc3e00640 1 -- 172.21.15.137:0/3559998327 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc03f030 con 0x7fcbcc103920 2024-04-25T02:12:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbc3e00640 1 -- 172.21.15.137:0/3559998327 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbbc004440 con 0x7fcbcc103920 2024-04-25T02:12:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc19f510 con 0x7fcbcc103920 2024-04-25T02:12:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbc3e00640 1 -- 172.21.15.137:0/3559998327 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc035070 con 0x7fcbcc103920 2024-04-25T02:12:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.913+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc1a6e00 con 0x7fcbcc103920 2024-04-25T02:12:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.916+0000 7fcbc3e00640 1 -- 172.21.15.137:0/3559998327 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fcbbc042030 con 0x7fcbcc103920 2024-04-25T02:12:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.916+0000 7fcbd5792740 1 Processor -- start 2024-04-25T02:12:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 -- start start 2024-04-25T02:12:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x558151761aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5581516baab0 con 0x558151757720 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x558151663640 con 0x558151756e00 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbd5792740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5581516b6a70 con 0x558151761fe0 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:33006/0 (socket says 172.21.15.137:33006) 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbcbe00640 1 -- 172.21.15.137:0/2710408966 learned_addr learned my addr 172.21.15.137:0/2710408966 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbcb400640 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x558151761aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.917+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 -- 172.21.15.137:0/2710408966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 msgr2=0x5581517643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 -- 172.21.15.137:0/2710408966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 msgr2=0x558151761aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x558151761aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 -- 172.21.15.137:0/2710408966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581513cf210 con 0x558151756e00 2024-04-25T02:12:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009fd0 tx=0x7fcbc4010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f744b7d823f4bddb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbc0c00640 1 -- 172.21.15.137:0/2710408966 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011700 con 0x558151756e00 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbc3e00640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 0x7fcbb00a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbc0c00640 1 -- 172.21.15.137:0/2710408966 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbc4011da0 con 0x558151756e00 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.918+0000 7fcbc0c00640 1 -- 172.21.15.137:0/2710408966 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400e3c0 con 0x558151756e00 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbc3e00640 1 -- 172.21.15.137:0/3559998327 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcbbc0ef7a0 con 0x7fcbcc103920 2024-04-25T02:12:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbcb400640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 0x7fcbb00a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.928 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:09 smithi174 ceph-mon[33171]: pgmap v76: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.16k op/s 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 -- 172.21.15.137:0/2710408966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 msgr2=0x5581517571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbcb400640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 0x7fcbb00a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5581517583a0 tx=0x7fcbbc0f5530 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009fd0 tx=0x7fcbc4010860 comp rx=0 tx=0).stop 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 -- 172.21.15.137:0/2710408966 shutdown_connections 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x558151761aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 --2- 172.21.15.137:0/2710408966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x5581517571e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.919+0000 7fcbd5792740 1 -- 172.21.15.137:0/2710408966 >> 172.21.15.137:0/2710408966 conn(0x558151753310 msgr2=0x5581517536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.920+0000 7fcbd5792740 1 -- 172.21.15.137:0/2710408966 shutdown_connections 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.920+0000 7fcbd5792740 1 -- 172.21.15.137:0/2710408966 wait complete. 2024-04-25T02:12:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.920+0000 7fcbd5792740 1 -- start start 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.920+0000 7fcbd5792740 1 Processor -- start 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815175f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x55815175f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558151764c10 con 0x558151757720 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x558151676990 con 0x558151761fe0 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558151764d90 con 0x558151756e00 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbd5792740 10 client.0 _ll_register_callbacks cb 0x558151678950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34450/0 (socket says 172.21.15.137:34450) 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbcbe00640 1 -- 172.21.15.137:0/979815948 learned_addr learned my addr 172.21.15.137:0/979815948 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815175f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.921+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x55815175f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 -- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 msgr2=0x55815175f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x55815175f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 -- 172.21.15.137:0/979815948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 msgr2=0x55815175f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815175f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 -- 172.21.15.137:0/979815948 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55815149b620 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbc401bab0 tx=0x7fcbc401bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e0f0c7e23d4224 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbb5600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011910 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.922+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcbc4011ab0 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc4011da0 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcbc402c400 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbd5792740 10 client.26056 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558151770b80 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbc4011da0 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.923+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcbc402e660 con 0x558151756e00 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 10 client.26056 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 10 client.26056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 20 client.26056 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x558151771f90 0x558151774380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 4 client.26056 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581516c7ff0 con 0x558151771f90 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x558151771f90 0x558151774380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x558151771f90 0x558151774380 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=721bbdd8ae2c675f server_cookie=ae50198be03cc676 in_seq=0 out_seq=0 2024-04-25T02:12:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.924+0000 7fcbb5600640 10 client.26056 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.925+0000 7fcbb5600640 1 -- 172.21.15.137:0/979815948 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5581516c7ff0 con 0x558151771f90 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.925+0000 7fcbb5600640 10 client.26056 handle_command_reply: tid=0 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.925+0000 7fcbd5792740 1 client.26056 shutdown 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 msgr2=0x55815175ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbc401bab0 tx=0x7fcbc401bbb0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 shutdown_connections 2024-04-25T02:12:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x558151771f90 0x558151774380 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x55815175f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815175f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 --2- 172.21.15.137:0/979815948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815175ef70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbb5600640 0 client.26056 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 >> 172.21.15.137:0/979815948 conn(0x558151753310 msgr2=0x558151759090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 shutdown_connections 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 1 -- 172.21.15.137:0/979815948 wait complete. 2024-04-25T02:12:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.926+0000 7fcbd5792740 20 client.26056 trim_cache size 0 max 16384 2024-04-25T02:12:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 Processor -- start 2024-04-25T02:12:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 -- start start 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x558151761740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1b1f40 con 0x558151757720 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1af7b0 con 0x558151756e00 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbd5792740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1ad600 con 0x558151761fe0 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbcaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x558151761740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbcaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58096/0 (socket says 172.21.15.137:58096) 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbcaa00640 1 -- 172.21.15.137:0/3858678275 learned_addr learned my addr 172.21.15.137:0/3858678275 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.945+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 -- 172.21.15.137:0/3858678275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 msgr2=0x5581517587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 -- 172.21.15.137:0/3858678275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 msgr2=0x558151761740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x558151761740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 -- 172.21.15.137:0/3858678275 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55815175df40 con 0x558151757720 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x558151761740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x558151754730 tx=0x7fcbb8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576fef5f8dddc5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbb7e00640 1 -- 172.21.15.137:0/3858678275 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8004230 con 0x558151757720 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbb7e00640 1 -- 172.21.15.137:0/3858678275 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbb8024030 con 0x558151757720 2024-04-25T02:12:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.946+0000 7fcbb7e00640 1 -- 172.21.15.137:0/3858678275 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8003b60 con 0x558151757720 2024-04-25T02:12:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- 172.21.15.137:0/3858678275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 msgr2=0x55815176db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x558151754730 tx=0x7fcbb8005f90 comp rx=0 tx=0).stop 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- 172.21.15.137:0/3858678275 shutdown_connections 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151761fe0 0x5581517587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176db30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 --2- 172.21.15.137:0/3858678275 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151756e00 0x558151761740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- 172.21.15.137:0/3858678275 >> 172.21.15.137:0/3858678275 conn(0x558151753310 msgr2=0x558151761030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- 172.21.15.137:0/3858678275 shutdown_connections 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- 172.21.15.137:0/3858678275 wait complete. 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.947+0000 7fcbd5792740 1 -- start start 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 Processor -- start 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815176a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x558151767010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1adc70 con 0x558151757720 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1af0e0 con 0x558151761fe0 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc1ae340 con 0x558151756e00 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbd5792740 10 client.0 _ll_register_callbacks cb 0x7fcbbc0f5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815176a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbcaa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815176a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:34462/0 (socket says 172.21.15.137:34462) 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.948+0000 7fcbcbe00640 1 -- 172.21.15.137:0/4164212973 learned_addr learned my addr 172.21.15.137:0/4164212973 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x558151767010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 -- 172.21.15.137:0/4164212973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 msgr2=0x55815176a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815176a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 -- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 msgr2=0x558151767010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x558151767010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 -- 172.21.15.137:0/4164212973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558151767820 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x558151767010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbcaa00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176a580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x558151759f10 tx=0x7fcbb80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0e6c409392a653 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbb5600640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb802e070 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7fcbb8020410 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.949+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb8024030 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcbb8039050 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 10 client.15957 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581517d8ce0 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbb8024030 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcbb801e420 con 0x558151757720 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 10 client.15957 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 20 client.15957 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5581517d93a0 0x5581517db7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 4 client.15957 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:12:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581516c2340 con 0x5581517d93a0 2024-04-25T02:12:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.950+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5581517d93a0 0x5581517db7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.951+0000 7fcbcbe00640 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5581517d93a0 0x5581517db7c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1412fdcb85901f5 server_cookie=88612d4226423283 in_seq=0 out_seq=0 2024-04-25T02:12:09.961 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:09.951+0000 7fcbb5600640 10 client.15957 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:10.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:09 smithi137 ceph-mon[28303]: pgmap v76: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 1.16k op/s 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbb5600640 1 -- 172.21.15.137:0/4164212973 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581516c2340 con 0x5581517d93a0 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbb5600640 10 client.15957 handle_command_reply: tid=0 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 client.15957 shutdown 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 msgr2=0x55815176a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176a580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x558151759f10 tx=0x7fcbb80035f0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 shutdown_connections 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x5581517d93a0 0x5581517db7c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558151761fe0 0x558151767010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558151757720 0x55815176a580 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 --2- 172.21.15.137:0/4164212973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558151756e00 0x55815176a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.344+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 >> 172.21.15.137:0/4164212973 conn(0x558151753310 msgr2=0x55815176cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.345+0000 7fcbb5600640 0 client.15957 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.345+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 shutdown_connections 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.345+0000 7fcbd5792740 1 -- 172.21.15.137:0/4164212973 wait complete. 2024-04-25T02:12:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.345+0000 7fcbd5792740 20 client.15957 trim_cache size 0 max 16384 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 msgr2=0x7fcbb00a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 0x7fcbb00a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x5581517583a0 tx=0x7fcbbc0f5530 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 msgr2=0x7fcbcc19a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009230 tx=0x7fcbbc004040 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 shutdown_connections 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fcbb00a2e20 0x7fcbb00a52e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcbcc109930 0x7fcbcc19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbcc1042e0 0x7fcbcc19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 --2- 172.21.15.137:0/3559998327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbcc103920 0x7fcbcc19a290 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.346+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 >> 172.21.15.137:0/3559998327 conn(0x7fcbcc0ff430 msgr2=0x7fcbcc0ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.347+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 shutdown_connections 2024-04-25T02:12:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:10.347+0000 7fcbd2800640 1 -- 172.21.15.137:0/3559998327 wait complete. 2024-04-25T02:12:11.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:11 smithi163 ceph-mon[32577]: pgmap v77: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:11.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:11 smithi174 ceph-mon[33171]: pgmap v77: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:12.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:11 smithi137 ceph-mon[28303]: pgmap v77: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:13.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:13 smithi163 ceph-mon[32577]: pgmap v78: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:13.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:13 smithi174 ceph-mon[33171]: pgmap v78: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:14.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:13 smithi137 ceph-mon[28303]: pgmap v78: 97 pgs: 97 active+clean; 149 MiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2024-04-25T02:12:15.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:15 smithi163 ceph-mon[32577]: pgmap v79: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-04-25T02:12:15.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:15 smithi174 ceph-mon[33171]: pgmap v79: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-04-25T02:12:16.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:15 smithi137 ceph-mon[28303]: pgmap v79: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 854 op/s 2024-04-25T02:12:17.783 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar xf doc.tar 2024-04-25T02:12:17.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:17 smithi163 ceph-mon[32577]: pgmap v80: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 503 op/s 2024-04-25T02:12:17.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:17 smithi174 ceph-mon[33171]: pgmap v80: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 503 op/s 2024-04-25T02:12:18.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:17 smithi137 ceph-mon[28303]: pgmap v80: 97 pgs: 97 active+clean; 130 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 503 op/s 2024-04-25T02:12:19.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:19 smithi163 ceph-mon[32577]: pgmap v81: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 635 op/s 2024-04-25T02:12:19.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:19 smithi174 ceph-mon[33171]: pgmap v81: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 635 op/s 2024-04-25T02:12:20.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:19 smithi137 ceph-mon[28303]: pgmap v81: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 635 op/s 2024-04-25T02:12:21.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:21 smithi163 ceph-mon[32577]: pgmap v82: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:21.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:21 smithi174 ceph-mon[33171]: pgmap v82: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:22.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:21 smithi137 ceph-mon[28303]: pgmap v82: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 -- 172.21.15.137:0/388784223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc74107fa0 msgr2=0x7efc74108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 --2- 172.21.15.137:0/388784223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc74107fa0 0x7efc74108380 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efc64009900 tx=0x7efc6402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 -- 172.21.15.137:0/388784223 shutdown_connections 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 --2- 172.21.15.137:0/388784223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc7410d070 0x7efc74114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 --2- 172.21.15.137:0/388784223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc74108950 0x7efc7410c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 --2- 172.21.15.137:0/388784223 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc74107fa0 0x7efc74108380 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 -- 172.21.15.137:0/388784223 >> 172.21.15.137:0/388784223 conn(0x7efc74075cd0 msgr2=0x7efc740780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.497+0000 7efc7a400640 1 -- 172.21.15.137:0/388784223 shutdown_connections 2024-04-25T02:12:23.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.498+0000 7efc7a400640 1 -- 172.21.15.137:0/388784223 wait complete. 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 Processor -- start 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 -- start start 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc74107fa0 0x7efc7419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 0x7efc7419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc741182b0 con 0x7efc7410d070 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efc74118130 con 0x7efc741a2ee0 2024-04-25T02:12:23.507 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc7a400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efc74118430 con 0x7efc74107fa0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc73e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc73400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc74107fa0 0x7efc7419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc73e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:37966/0 (socket says 172.21.15.137:37966) 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.499+0000 7efc73e00640 1 -- 172.21.15.137:0/1134316814 learned_addr learned my addr 172.21.15.137:0/1134316814 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc72a00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 0x7efc7419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 -- 172.21.15.137:0/1134316814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc74107fa0 msgr2=0x7efc7419e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc74107fa0 0x7efc7419e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 -- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 msgr2=0x7efc7419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 0x7efc7419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 -- 172.21.15.137:0/1134316814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc741a39d0 con 0x7efc741a2ee0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc72a00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 0x7efc7419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc73e00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00eaa0 tx=0x7efc6c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc6be00640 1 -- 172.21.15.137:0/1134316814 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00cdb0 con 0x7efc741a2ee0 2024-04-25T02:12:23.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc6be00640 1 -- 172.21.15.137:0/1134316814 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc6c004b20 con 0x7efc741a2ee0 2024-04-25T02:12:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741a3cc0 con 0x7efc741a2ee0 2024-04-25T02:12:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.500+0000 7efc6be00640 1 -- 172.21.15.137:0/1134316814 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c011760 con 0x7efc741a2ee0 2024-04-25T02:12:23.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.501+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741ab4b0 con 0x7efc741a2ee0 2024-04-25T02:12:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.505+0000 7efc7d391740 1 Processor -- start 2024-04-25T02:12:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.505+0000 7efc6be00640 1 -- 172.21.15.137:0/1134316814 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7efc6c004cd0 con 0x7efc741a2ee0 2024-04-25T02:12:23.511 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.505+0000 7efc7d391740 1 -- start start 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.505+0000 7efc7d391740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc7d391740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d589720 0x55881d593aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc7d391740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d593fe0 0x55881d5963d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc7d391740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55881d4ecab0 con 0x55881d593fe0 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc7d391740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55881d495640 con 0x55881d588e00 2024-04-25T02:12:23.512 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc7d391740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55881d4e8a70 con 0x55881d589720 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:37982/0 (socket says 172.21.15.137:37982) 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 -- 172.21.15.137:0/1903518205 learned_addr learned my addr 172.21.15.137:0/1903518205 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d593fe0 0x55881d5963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 -- 172.21.15.137:0/1903518205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d589720 msgr2=0x55881d593aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d589720 0x55881d593aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.513 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 -- 172.21.15.137:0/1903518205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d593fe0 msgr2=0x55881d5963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d593fe0 0x55881d5963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.506+0000 7efc72a00640 1 -- 172.21.15.137:0/1903518205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881d201210 con 0x55881d588e00 2024-04-25T02:12:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc72a00640 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc600149f0 tx=0x7efc6000c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e55fef6a68b499 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc6be00640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 0x7efc580a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc68c00640 1 -- 172.21.15.137:0/1903518205 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600142d0 con 0x55881d588e00 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc68c00640 1 -- 172.21.15.137:0/1903518205 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc6000f760 con 0x55881d588e00 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc68c00640 1 -- 172.21.15.137:0/1903518205 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60003850 con 0x55881d588e00 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.507+0000 7efc6be00640 1 -- 172.21.15.137:0/1134316814 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efc6c0cf640 con 0x7efc741a2ee0 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc73400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 0x7efc580a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 -- 172.21.15.137:0/1903518205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 msgr2=0x55881d5891e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc600149f0 tx=0x7efc6000c540 comp rx=0 tx=0).stop 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 -- 172.21.15.137:0/1903518205 shutdown_connections 2024-04-25T02:12:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d593fe0 0x55881d5963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d589720 0x55881d593aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 --2- 172.21.15.137:0/1903518205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d5891e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.508+0000 7efc7d391740 1 -- 172.21.15.137:0/1903518205 >> 172.21.15.137:0/1903518205 conn(0x55881d585310 msgr2=0x55881d5856f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.509+0000 7efc7d391740 1 -- 172.21.15.137:0/1903518205 shutdown_connections 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.509+0000 7efc7d391740 1 -- 172.21.15.137:0/1903518205 wait complete. 2024-04-25T02:12:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.509+0000 7efc73400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 0x7efc580a5260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.509+0000 7efc7d391740 1 -- start start 2024-04-25T02:12:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 Processor -- start 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d591480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d5919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55881d596bb0 con 0x55881d589720 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55881d4a8990 con 0x55881d588e00 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55881d596d30 con 0x55881d593fe0 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc7d391740 10 client.0 _ll_register_callbacks cb 0x55881d4aa950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc73400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc73400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:37986/0 (socket says 172.21.15.137:37986) 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc73400640 1 -- 172.21.15.137:0/79635328 learned_addr learned my addr 172.21.15.137:0/79635328 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.510+0000 7efc72a00640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d591480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73e00640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d5919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 -- 172.21.15.137:0/79635328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 msgr2=0x55881d5919c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d5919c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 -- 172.21.15.137:0/79635328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 msgr2=0x55881d591480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d591480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 -- 172.21.15.137:0/79635328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881d2cd620 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc73400640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc64005c40 tx=0x7efc6402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=505c960d1b8d5fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc5d600640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6404d020 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efc640048e0 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.511+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc6000f760 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.512+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc64058050 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.512+0000 7efc7d391740 10 client.26039 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.512+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55881d5a2a40 con 0x55881d588e00 2024-04-25T02:12:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.512+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc6000f760 con 0x55881d588e00 2024-04-25T02:12:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efc64032900 con 0x55881d588e00 2024-04-25T02:12:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 10 client.26039 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 10 client.26039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 20 client.26039 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d5a3f50 0x55881d5a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 4 client.26039 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55881d4f9ff0 con 0x55881d5a3f50 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.513+0000 7efc72a00640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d5a3f50 0x55881d5a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.514+0000 7efc72a00640 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d5a3f50 0x55881d5a63e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15325c8be5eabbdd server_cookie=f88526ef796da0c9 in_seq=0 out_seq=0 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.514+0000 7efc5d600640 10 client.26039 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc5d600640 1 -- 172.21.15.137:0/79635328 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55881d4f9ff0 con 0x55881d5a3f50 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc5d600640 10 client.26039 handle_command_reply: tid=0 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 client.26039 shutdown 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 msgr2=0x55881d590f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efc64005c40 tx=0x7efc6402a3f0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 shutdown_connections 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d5a3f50 0x55881d5a63e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d5919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d591480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 --2- 172.21.15.137:0/79635328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d590f40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc5d600640 0 client.26039 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.515+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 >> 172.21.15.137:0/79635328 conn(0x55881d585310 msgr2=0x55881d58b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.516+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 shutdown_connections 2024-04-25T02:12:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.516+0000 7efc7d391740 1 -- 172.21.15.137:0/79635328 wait complete. 2024-04-25T02:12:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.516+0000 7efc7d391740 20 client.26039 trim_cache size 0 max 16384 2024-04-25T02:12:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.533+0000 7efc7d391740 1 Processor -- start 2024-04-25T02:12:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.533+0000 7efc7d391740 1 -- start start 2024-04-25T02:12:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d588e00 0x55881d59fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d5929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b6340 con 0x55881d589720 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b3bb0 con 0x55881d593fe0 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc7d391740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b1a00 con 0x55881d588e00 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc72a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d5929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:37998/0 (socket says 172.21.15.137:37998) 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 -- 172.21.15.137:0/2443654324 learned_addr learned my addr 172.21.15.137:0/2443654324 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73400640 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d588e00 0x55881d59fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 -- 172.21.15.137:0/2443654324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d588e00 msgr2=0x55881d59fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d588e00 0x55881d59fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 -- 172.21.15.137:0/2443654324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 msgr2=0x55881d5929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.534+0000 7efc73e00640 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d5929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc73e00640 1 -- 172.21.15.137:0/2443654324 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881d596600 con 0x55881d593fe0 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc72a00640 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d5929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc73e00640 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc6c09b870 tx=0x7efc6c09b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b7313ed12781207 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc5fe00640 1 -- 172.21.15.137:0/2443654324 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c01f050 con 0x55881d593fe0 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc5fe00640 1 -- 172.21.15.137:0/2443654324 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc6c09ff20 con 0x55881d593fe0 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.535+0000 7efc5fe00640 1 -- 172.21.15.137:0/2443654324 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0cf370 con 0x55881d593fe0 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- 172.21.15.137:0/2443654324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 msgr2=0x55881d584c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efc6c09b870 tx=0x7efc6c09b7a0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- 172.21.15.137:0/2443654324 shutdown_connections 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d593fe0 0x55881d584c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d5929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 --2- 172.21.15.137:0/2443654324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d588e00 0x55881d59fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- 172.21.15.137:0/2443654324 >> 172.21.15.137:0/2443654324 conn(0x55881d585310 msgr2=0x55881d59f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- 172.21.15.137:0/2443654324 shutdown_connections 2024-04-25T02:12:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- 172.21.15.137:0/2443654324 wait complete. 2024-04-25T02:12:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 -- start start 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.536+0000 7efc7d391740 1 Processor -- start 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d598f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d599490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b2070 con 0x55881d589720 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b34e0 con 0x55881d588e00 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efc741b2740 con 0x55881d593fe0 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc7d391740 10 client.0 _ll_register_callbacks cb 0x7efc64040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc73400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc73400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:38004/0 (socket says 172.21.15.137:38004) 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc73400640 1 -- 172.21.15.137:0/692021047 learned_addr learned my addr 172.21.15.137:0/692021047 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:23.547 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc73e00640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d599490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.537+0000 7efc72a00640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d598f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 -- 172.21.15.137:0/692021047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 msgr2=0x55881d599490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d599490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 -- 172.21.15.137:0/692021047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 msgr2=0x55881d598f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d598f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 -- 172.21.15.137:0/692021047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881d585140 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc73400640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc640057c0 tx=0x7efc64032720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132da210651f9f98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc5d600640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6404d070 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7efc640046c0 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc6c09ff20 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc6406b050 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc7d391740 10 client.26045 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.538+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55881d60b240 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc6c09ff20 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7efc64064060 con 0x55881d588e00 2024-04-25T02:12:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 10 client.26045 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 10 client.26045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 20 client.26045 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d60ba70 0x55881d60de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 4 client.26045 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55881d4f4340 con 0x55881d60ba70 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.539+0000 7efc72a00640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d60ba70 0x55881d60de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.540+0000 7efc72a00640 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d60ba70 0x55881d60de90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ef9fe01615878e server_cookie=93f61cd735e9001c in_seq=0 out_seq=0 2024-04-25T02:12:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:23.540+0000 7efc5d600640 10 client.26045 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:23.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:23 smithi163 ceph-mon[32577]: pgmap v83: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:23.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:23 smithi174 ceph-mon[33171]: pgmap v83: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:24.035 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:23 smithi137 ceph-mon[28303]: pgmap v83: 97 pgs: 97 active+clean; 138 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 507 op/s 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc5d600640 1 -- 172.21.15.137:0/692021047 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55881d4f4340 con 0x55881d60ba70 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc5d600640 10 client.26045 handle_command_reply: tid=0 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 client.26045 shutdown 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 msgr2=0x55881d59c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efc640057c0 tx=0x7efc64032720 comp rx=0 tx=0).stop 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 shutdown_connections 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55881d60ba70 0x55881d60de90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55881d593fe0 0x55881d599490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55881d589720 0x55881d598f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.357 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 --2- 172.21.15.137:0/692021047 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55881d588e00 0x55881d59c1e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 >> 172.21.15.137:0/692021047 conn(0x55881d585310 msgr2=0x55881d59ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc5d600640 0 client.26045 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 shutdown_connections 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.350+0000 7efc7d391740 1 -- 172.21.15.137:0/692021047 wait complete. 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.351+0000 7efc7d391740 20 client.26045 trim_cache size 0 max 16384 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:12:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:12:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.351+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 msgr2=0x7efc580a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.351+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 0x7efc580a5260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64005b50 comp rx=0 tx=0).stop 2024-04-25T02:12:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.351+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 msgr2=0x7efc741a3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.351+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00eaa0 tx=0x7efc6c00ef60 comp rx=0 tx=0).stop 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 shutdown_connections 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7efc580a2da0 0x7efc580a5260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc741a2ee0 0x7efc741a3390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efc7410d070 0x7efc7419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 --2- 172.21.15.137:0/1134316814 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc74107fa0 0x7efc7419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 >> 172.21.15.137:0/1134316814 conn(0x7efc74075cd0 msgr2=0x7efc740766c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 shutdown_connections 2024-04-25T02:12:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:24.352+0000 7efc7a400640 1 -- 172.21.15.137:0/1134316814 wait complete. 2024-04-25T02:12:25.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:25 smithi163 ceph-mon[32577]: pgmap v84: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-04-25T02:12:25.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:25 smithi174 ceph-mon[33171]: pgmap v84: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-04-25T02:12:26.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:25 smithi137 ceph-mon[28303]: pgmap v84: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 529 op/s 2024-04-25T02:12:27.892 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:27 smithi163 ceph-mon[32577]: pgmap v85: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:27.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:27 smithi174 ceph-mon[33171]: pgmap v85: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:28.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:27 smithi137 ceph-mon[28303]: pgmap v85: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:29.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:29 smithi174 ceph-mon[33171]: pgmap v86: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:30.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:29 smithi137 ceph-mon[28303]: pgmap v86: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:30.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:29 smithi163 ceph-mon[32577]: pgmap v86: 97 pgs: 97 active+clean; 143 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-04-25T02:12:30.434 INFO:tasks.workunit.client.0.smithi137.stderr:+ sync 2024-04-25T02:12:31.474 INFO:tasks.workunit.client.0.smithi137.stderr:+ tar c linux-4.0.5 2024-04-25T02:12:31.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:31 smithi174 ceph-mon[33171]: pgmap v87: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:32.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:31 smithi137 ceph-mon[28303]: pgmap v87: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:32.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:31 smithi163 ceph-mon[32577]: pgmap v87: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:32.144 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo Ok 2024-04-25T02:12:32.144 INFO:tasks.workunit.client.0.smithi137.stdout:Ok 2024-04-25T02:12:32.146 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:12:32.146 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T02:12:33.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:33 smithi174 ceph-mon[33171]: pgmap v88: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:34.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:33 smithi137 ceph-mon[28303]: pgmap v88: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:34.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:33 smithi163 ceph-mon[32577]: pgmap v88: 97 pgs: 97 active+clean; 133 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 696 op/s 2024-04-25T02:12:35.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:35 smithi174 ceph-mon[33171]: pgmap v89: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 932 op/s 2024-04-25T02:12:36.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:35 smithi137 ceph-mon[28303]: pgmap v89: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 932 op/s 2024-04-25T02:12:36.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:35 smithi163 ceph-mon[32577]: pgmap v89: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 932 op/s 2024-04-25T02:12:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.492+0000 7f3b05400640 1 -- 172.21.15.137:0/1299425862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b00107fa0 msgr2=0x7f3b00108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.500 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.492+0000 7f3b05400640 1 --2- 172.21.15.137:0/1299425862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b00107fa0 0x7f3b00108380 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009ca0 tx=0x7f3af002a8c0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 -- 172.21.15.137:0/1299425862 shutdown_connections 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 --2- 172.21.15.137:0/1299425862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b00114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 --2- 172.21.15.137:0/1299425862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00108950 0x7f3b0010c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 --2- 172.21.15.137:0/1299425862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b00107fa0 0x7f3b00108380 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 -- 172.21.15.137:0/1299425862 >> 172.21.15.137:0/1299425862 conn(0x7f3b00075cd0 msgr2=0x7f3b000780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 -- 172.21.15.137:0/1299425862 shutdown_connections 2024-04-25T02:12:37.501 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.493+0000 7f3b05400640 1 -- 172.21.15.137:0/1299425862 wait complete. 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.494+0000 7f3b05400640 1 Processor -- start 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.494+0000 7f3b05400640 1 -- start start 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.494+0000 7f3b05400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00107fa0 0x7f3b0019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.494+0000 7f3b05400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.494+0000 7f3b05400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b001a2f30 0x7f3b001a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3b05400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001182b0 con 0x7f3b001a2f30 2024-04-25T02:12:37.503 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3b05400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00118130 con 0x7f3b0010d070 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3b05400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00118430 con 0x7f3b00107fa0 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3aff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b001a2f30 0x7f3b001a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:49868/0 (socket says 172.21.15.137:49868) 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 -- 172.21.15.137:0/3465733968 learned_addr learned my addr 172.21.15.137:0/3465733968 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3afe800640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00107fa0 0x7f3b0019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 -- 172.21.15.137:0/3465733968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00107fa0 msgr2=0x7f3b0019e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00107fa0 0x7f3b0019e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 -- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b001a2f30 msgr2=0x7f3b001a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b001a2f30 0x7f3b001a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.495+0000 7f3af5e00640 1 -- 172.21.15.137:0/3465733968 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001a3a20 con 0x7f3b0010d070 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3af5e00640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800e9f0 tx=0x7f3ae800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3af7e00640 1 -- 172.21.15.137:0/3465733968 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800ccc0 con 0x7f3b0010d070 2024-04-25T02:12:37.504 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3af7e00640 1 -- 172.21.15.137:0/3465733968 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ae8005520 con 0x7f3b0010d070 2024-04-25T02:12:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3af7e00640 1 -- 172.21.15.137:0/3465733968 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8010690 con 0x7f3b0010d070 2024-04-25T02:12:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b001a3d10 con 0x7f3b0010d070 2024-04-25T02:12:37.505 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.496+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001ab4b0 con 0x7f3b0010d070 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.499+0000 7f3b083a5740 1 Processor -- start 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.499+0000 7f3af7e00640 1 -- 172.21.15.137:0/3465733968 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f3ae8004f70 con 0x7f3b0010d070 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.499+0000 7f3b083a5740 1 -- start start 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbf41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddb57ab0 con 0x55c7ddbf4720 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddb00640 con 0x55c7ddbfefe0 2024-04-25T02:12:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3b083a5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddb53a70 con 0x55c7ddbf3e00 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3afe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3aff200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbf41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3afe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47948/0 (socket says 172.21.15.137:47948) 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3afe800640 1 -- 172.21.15.137:0/1947641335 learned_addr learned my addr 172.21.15.137:0/1947641335 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.500+0000 7f3af5e00640 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 -- 172.21.15.137:0/1947641335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 msgr2=0x55c7ddbf41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbf41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 -- 172.21.15.137:0/1947641335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 msgr2=0x55c7ddc013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 -- 172.21.15.137:0/1947641335 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dd86c210 con 0x55c7ddbf4720 2024-04-25T02:12:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3aff200640 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbf41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3afe800640 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3af002ade0 tx=0x7f3af0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b98c4f6272ad4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3af7e00640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 0x7f3ae40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3af7e00640 1 -- 172.21.15.137:0/3465733968 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3ae80cf810 con 0x7f3b0010d070 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3aef400640 1 -- 172.21.15.137:0/1947641335 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031db0 con 0x55c7ddbf4720 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3aef400640 1 -- 172.21.15.137:0/1947641335 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af0036030 con 0x55c7ddbf4720 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.501+0000 7f3aff200640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 0x7f3ae40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3aef400640 1 -- 172.21.15.137:0/1947641335 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00042d0 con 0x55c7ddbf4720 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3aff200640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 0x7f3ae40a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009ef0 tx=0x7f3af8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 -- 172.21.15.137:0/1947641335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 msgr2=0x55c7ddbfeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3af002ade0 tx=0x7f3af0005fa0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.514 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 -- 172.21.15.137:0/1947641335 shutdown_connections 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfeaa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 --2- 172.21.15.137:0/1947641335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbf41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 -- 172.21.15.137:0/1947641335 >> 172.21.15.137:0/1947641335 conn(0x55c7ddbf0310 msgr2=0x55c7ddbf06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.502+0000 7f3b083a5740 1 -- 172.21.15.137:0/1947641335 shutdown_connections 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.503+0000 7f3b083a5740 1 -- 172.21.15.137:0/1947641335 wait complete. 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.503+0000 7f3b083a5740 1 -- start start 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.503+0000 7f3b083a5740 1 Processor -- start 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbfbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbfefe0 0x55c7ddbfc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddc01a30 con 0x55c7ddbf3e00 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddb13990 con 0x55c7ddbf4720 2024-04-25T02:12:37.515 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c7ddc01bb0 con 0x55c7ddbfefe0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3b083a5740 10 client.0 _ll_register_callbacks cb 0x55c7ddb15950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3afe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbfbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3afe800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbfbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:47958/0 (socket says 172.21.15.137:47958) 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3afe800640 1 -- 172.21.15.137:0/351762955 learned_addr learned my addr 172.21.15.137:0/351762955 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3aff200640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbfefe0 0x55c7ddbfc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 -- 172.21.15.137:0/351762955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbfefe0 msgr2=0x55c7ddbfc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbfefe0 0x55c7ddbfc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 -- 172.21.15.137:0/351762955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 msgr2=0x55c7ddbfbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbfbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.504+0000 7f3af5e00640 1 -- 172.21.15.137:0/351762955 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dd938620 con 0x55c7ddbf4720 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3af5e00640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfc480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80ccf70 tx=0x7f3ae8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b83718e3720c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae809b6a0 con 0x55c7ddbf4720 2024-04-25T02:12:37.516 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af0036030 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3ae80cd1f0 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3ae800ce60 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 10 client.26057 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7ddc0d970 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af0036030 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3ae80a4520 con 0x55c7ddbf4720 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 10 client.26057 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.505+0000 7f3b083a5740 20 client.26057 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc0ede0 0x55c7ddc11270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3b083a5740 4 client.26057 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7ddb64ff0 con 0x55c7ddc0ede0 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3afe800640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc0ede0 0x55c7ddc11270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3afe800640 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc0ede0 0x55c7ddc11270 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6cf590c52a46cd server_cookie=f75b80eb536f9670 in_seq=0 out_seq=0 2024-04-25T02:12:37.517 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.506+0000 7f3ae3e00640 10 client.26057 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3ae3e00640 1 -- 172.21.15.137:0/351762955 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c7ddb64ff0 con 0x55c7ddc0ede0 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3ae3e00640 10 client.26057 handle_command_reply: tid=0 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 client.26057 shutdown 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 msgr2=0x55c7ddbfc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfc480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80ccf70 tx=0x7f3ae8009780 comp rx=0 tx=0).stop 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 shutdown_connections 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc0ede0 0x55c7ddc11270 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbfefe0 0x55c7ddbfc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf4720 0x55c7ddbfc480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3ae3e00640 0 client.26057 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 --2- 172.21.15.137:0/351762955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddbfbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 >> 172.21.15.137:0/351762955 conn(0x55c7ddbf0310 msgr2=0x55c7ddbf6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.519 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 shutdown_connections 2024-04-25T02:12:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 1 -- 172.21.15.137:0/351762955 wait complete. 2024-04-25T02:12:37.520 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.508+0000 7f3b083a5740 20 client.26057 trim_cache size 0 max 16384 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.525+0000 7f3b083a5740 1 Processor -- start 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.525+0000 7f3b083a5740 1 -- start start 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc0a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc16b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b6310 con 0x55c7ddbf3e00 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b3b80 con 0x55c7ddbfefe0 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3b083a5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b19d0 con 0x55c7ddbf4720 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3aff200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3aff200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:49894/0 (socket says 172.21.15.137:49894) 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3aff200640 1 -- 172.21.15.137:0/940257102 learned_addr learned my addr 172.21.15.137:0/940257102 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3af5e00640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc16b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3afe800640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc0a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.526+0000 7f3aff200640 1 -- 172.21.15.137:0/940257102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 msgr2=0x55c7ddc16b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aff200640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc16b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aff200640 1 -- 172.21.15.137:0/940257102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 msgr2=0x55c7ddc0a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aff200640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc0a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aff200640 1 -- 172.21.15.137:0/940257102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ddbee890 con 0x55c7ddbfefe0 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3af5e00640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc16b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aff200640 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3af8004390 tx=0x7f3af801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e8783f42bcabe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aeea00640 1 -- 172.21.15.137:0/940257102 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8004480 con 0x55c7ddbfefe0 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aeea00640 1 -- 172.21.15.137:0/940257102 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af802a980 con 0x55c7ddbfefe0 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.527+0000 7f3aeea00640 1 -- 172.21.15.137:0/940257102 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af801fb80 con 0x55c7ddbfefe0 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- 172.21.15.137:0/940257102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 msgr2=0x55c7ddc170c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3af8004390 tx=0x7f3af801b000 comp rx=0 tx=0).stop 2024-04-25T02:12:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- 172.21.15.137:0/940257102 shutdown_connections 2024-04-25T02:12:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc170c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc16b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.539 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 --2- 172.21.15.137:0/940257102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc0a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- 172.21.15.137:0/940257102 >> 172.21.15.137:0/940257102 conn(0x55c7ddbf0310 msgr2=0x55c7ddbf7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- 172.21.15.137:0/940257102 shutdown_connections 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- 172.21.15.137:0/940257102 wait complete. 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.528+0000 7f3b083a5740 1 -- start start 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 Processor -- start 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc03310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b2040 con 0x55c7ddbfefe0 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b34b0 con 0x55c7ddbf3e00 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b001b2710 con 0x55c7ddbf4720 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3b083a5740 10 client.0 _ll_register_callbacks cb 0x7f3ae80d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3afe800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.540 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3aff200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc03310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3afe800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:49908/0 (socket says 172.21.15.137:49908) 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3afe800640 1 -- 172.21.15.137:0/2081440568 learned_addr learned my addr 172.21.15.137:0/2081440568 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.529+0000 7f3af5e00640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 -- 172.21.15.137:0/2081440568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 msgr2=0x55c7ddc02dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc02dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 -- 172.21.15.137:0/2081440568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbfefe0 msgr2=0x55c7ddc03310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc03310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 -- 172.21.15.137:0/2081440568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ddc74420 con 0x55c7ddbf3e00 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3afe800640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3af002ae80 tx=0x7f3af0031a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed1ea4abb923216f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3ae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af005c060 con 0x55c7ddbf3e00 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8469+0+0 (secure 0 0 0) 0x7f3af0031650 con 0x55c7ddbf3e00 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.530+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af802a980 con 0x55c7ddbf3e00 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3af004a040 con 0x55c7ddbf3e00 2024-04-25T02:12:37.541 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 10 client.26063 fetch_fsmap learned FSMap version 27 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7ddc75770 con 0x55c7ddbf3e00 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3af802a980 con 0x55c7ddbf3e00 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3af0043070 con 0x55c7ddbf3e00 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 10 client.26063 fetch_fsmap finished waiting for FSMap version 27 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 10 client.26063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 20 client.26063 populate_metadata read hostname 'smithi137' 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc75c10 0x55c7ddc78000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 4 client.26063 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 --> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c7ddbf0160 con 0x55c7ddc75c10 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.531+0000 7f3af5e00640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc75c10 0x55c7ddc78000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.532+0000 7f3af5e00640 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc75c10 0x55c7ddc78000 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9480fe8cf2e55a server_cookie=6e60cbd4704a6264 in_seq=0 out_seq=0 2024-04-25T02:12:37.542 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.532+0000 7f3ae3e00640 10 client.26063 ms_handle_connect on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:37.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:37 smithi174 ceph-mon[33171]: pgmap v90: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3ae3e00640 1 -- 172.21.15.137:0/2081440568 <== mds.0 v2:172.21.15.163:6838/2170091547 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c7ddbf0160 con 0x55c7ddc75c10 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3ae3e00640 10 client.26063 handle_command_reply: tid=0 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 client.26063 shutdown 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 msgr2=0x55c7ddc02890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3af002ae80 tx=0x7f3af0031a40 comp rx=0 tx=0).stop 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 shutdown_connections 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:6838/2170091547,v1:172.21.15.163:6839/2170091547] conn(0x55c7ddc75c10 0x55c7ddc78000 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c7ddbfefe0 0x55c7ddc03310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7ddbf4720 0x55c7ddc02dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 --2- 172.21.15.137:0/2081440568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c7ddbf3e00 0x55c7ddc02890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 >> 172.21.15.137:0/2081440568 conn(0x55c7ddbf0310 msgr2=0x55c7ddbf57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3ae3e00640 0 client.26063 ms_handle_reset on v2:172.21.15.163:6838/2170091547 2024-04-25T02:12:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 shutdown_connections 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.990+0000 7f3b083a5740 1 -- 172.21.15.137:0/2081440568 wait complete. 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.991+0000 7f3b083a5740 20 client.26063 trim_cache size 0 max 16384 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:{ 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "message": "", 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout: "return_code": 0 2024-04-25T02:12:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stdout:} 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.991+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 msgr2=0x7f3ae40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 0x7f3ae40a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009ef0 tx=0x7f3af8005f90 comp rx=0 tx=0).stop 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 msgr2=0x7f3b0019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800e9f0 tx=0x7f3ae800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 shutdown_connections 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ae40a2da0 0x7f3ae40a5260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b001a2f30 0x7f3b001a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3b0010d070 0x7f3b0019ebb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 --2- 172.21.15.137:0/3465733968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b00107fa0 0x7f3b0019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:12:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 >> 172.21.15.137:0/3465733968 conn(0x7f3b00075cd0 msgr2=0x7f3b000766a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:12:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 shutdown_connections 2024-04-25T02:12:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi137.front.sepia.ceph.com.smithi137.stderr:2024-04-25T02:12:37.992+0000 7f3b05400640 1 -- 172.21.15.137:0/3465733968 wait complete. 2024-04-25T02:12:38.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:37 smithi137 ceph-mon[28303]: pgmap v90: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:38.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:37 smithi163 ceph-mon[32577]: pgmap v90: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:39.927 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:39 smithi174 ceph-mon[33171]: pgmap v91: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:40.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:39 smithi137 ceph-mon[28303]: pgmap v91: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:40.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:39 smithi163 ceph-mon[32577]: pgmap v91: 97 pgs: 97 active+clean; 160 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 909 op/s 2024-04-25T02:12:42.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:41 smithi137 ceph-mon[28303]: pgmap v92: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 1.32k op/s 2024-04-25T02:12:42.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:41 smithi163 ceph-mon[32577]: pgmap v92: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 1.32k op/s 2024-04-25T02:12:42.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:41 smithi174 ceph-mon[33171]: pgmap v92: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 1.32k op/s 2024-04-25T02:12:44.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:43 smithi137 ceph-mon[28303]: pgmap v93: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 649 op/s 2024-04-25T02:12:44.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:43 smithi163 ceph-mon[32577]: pgmap v93: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 649 op/s 2024-04-25T02:12:44.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:43 smithi174 ceph-mon[33171]: pgmap v93: 97 pgs: 97 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 649 op/s 2024-04-25T02:12:46.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:45 smithi137 ceph-mon[28303]: pgmap v94: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 806 op/s 2024-04-25T02:12:46.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:45 smithi163 ceph-mon[32577]: pgmap v94: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 806 op/s 2024-04-25T02:12:46.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:45 smithi174 ceph-mon[33171]: pgmap v94: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 806 op/s 2024-04-25T02:12:46.823 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-04-25T02:12:46.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T02:12:47.980 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:47 smithi137 ceph-mon[28303]: pgmap v95: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:47.980 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:47 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:47.988 DEBUG:teuthology.parallel:result is None 2024-04-25T02:12:47.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:12:48.060 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:12:48.060 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-25T02:12:48.072 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:12:48.087 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-25T02:12:48.097 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-25T02:12:48.097 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:12:48.097 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:12:48.097 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-25T02:12:48.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:47 smithi163 ceph-mon[32577]: pgmap v95: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:48.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:47 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:48.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:47 smithi174 ceph-mon[33171]: pgmap v95: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:48.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:47 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:12:48.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-25T02:12:50.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:49 smithi137 ceph-mon[28303]: pgmap v96: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:50.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:49 smithi163 ceph-mon[32577]: pgmap v96: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:50.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:49 smithi174 ceph-mon[33171]: pgmap v96: 97 pgs: 97 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 570 op/s 2024-04-25T02:12:52.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:51 smithi137 ceph-mon[28303]: pgmap v97: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 691 op/s 2024-04-25T02:12:52.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:51 smithi163 ceph-mon[32577]: pgmap v97: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 691 op/s 2024-04-25T02:12:52.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:51 smithi174 ceph-mon[33171]: pgmap v97: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 691 op/s 2024-04-25T02:12:54.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:53 smithi137 ceph-mon[28303]: pgmap v98: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1008 KiB/s wr, 277 op/s 2024-04-25T02:12:54.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:53 smithi163 ceph-mon[32577]: pgmap v98: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1008 KiB/s wr, 277 op/s 2024-04-25T02:12:54.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:53 smithi174 ceph-mon[33171]: pgmap v98: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 1008 KiB/s wr, 277 op/s 2024-04-25T02:12:55.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:54 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:55.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:54 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:55.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:54 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:12:56.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:55 smithi137 ceph-mon[28303]: pgmap v99: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1015 KiB/s wr, 282 op/s 2024-04-25T02:12:56.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:55 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:56.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:55 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:56.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:55 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:12:56.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:55 smithi163 ceph-mon[32577]: pgmap v99: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1015 KiB/s wr, 282 op/s 2024-04-25T02:12:56.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:55 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:56.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:55 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:56.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:55 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:12:56.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:55 smithi174 ceph-mon[33171]: pgmap v99: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 1015 KiB/s wr, 282 op/s 2024-04-25T02:12:56.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:55 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:12:56.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:55 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:12:56.178 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:55 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:12:58.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:57 smithi137 ceph-mon[28303]: pgmap v100: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:12:58.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:57 smithi163 ceph-mon[32577]: pgmap v100: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:12:58.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:57 smithi174 ceph-mon[33171]: pgmap v100: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:13:00.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:12:59 smithi137 ceph-mon[28303]: pgmap v101: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:13:00.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:12:59 smithi163 ceph-mon[32577]: pgmap v101: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:13:00.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:12:59 smithi174 ceph-mon[33171]: pgmap v101: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 407 KiB/s wr, 126 op/s 2024-04-25T02:13:02.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:01 smithi137 ceph-mon[28303]: pgmap v102: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 408 KiB/s wr, 130 op/s 2024-04-25T02:13:02.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:01 smithi163 ceph-mon[32577]: pgmap v102: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 408 KiB/s wr, 130 op/s 2024-04-25T02:13:02.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:01 smithi174 ceph-mon[33171]: pgmap v102: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 408 KiB/s wr, 130 op/s 2024-04-25T02:13:04.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:03 smithi137 ceph-mon[28303]: pgmap v103: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-04-25T02:13:04.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:03 smithi163 ceph-mon[32577]: pgmap v103: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-04-25T02:13:04.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:03 smithi174 ceph-mon[33171]: pgmap v103: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 8 op/s 2024-04-25T02:13:06.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:05 smithi137 ceph-mon[28303]: pgmap v104: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 KiB/s wr, 26 op/s 2024-04-25T02:13:06.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:05 smithi163 ceph-mon[32577]: pgmap v104: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 KiB/s wr, 26 op/s 2024-04-25T02:13:06.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:05 smithi174 ceph-mon[33171]: pgmap v104: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 30 KiB/s wr, 26 op/s 2024-04-25T02:13:08.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:07 smithi137 ceph-mon[28303]: pgmap v105: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:08.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:07 smithi163 ceph-mon[32577]: pgmap v105: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:08.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:07 smithi174 ceph-mon[33171]: pgmap v105: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:10.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:09 smithi137 ceph-mon[28303]: pgmap v106: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:10.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:09 smithi163 ceph-mon[32577]: pgmap v106: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:10.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:09 smithi174 ceph-mon[33171]: pgmap v106: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:12.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:11 smithi137 ceph-mon[28303]: pgmap v107: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-25T02:13:12.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:11 smithi163 ceph-mon[32577]: pgmap v107: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-25T02:13:12.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:11 smithi174 ceph-mon[33171]: pgmap v107: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-04-25T02:13:14.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:13 smithi137 ceph-mon[28303]: pgmap v108: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:14.142 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:13 smithi163 ceph-mon[32577]: pgmap v108: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:14.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:13 smithi174 ceph-mon[33171]: pgmap v108: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-04-25T02:13:16.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:15 smithi137 ceph-mon[28303]: pgmap v109: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-04-25T02:13:16.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:15 smithi163 ceph-mon[32577]: pgmap v109: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-04-25T02:13:16.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:15 smithi174 ceph-mon[33171]: pgmap v109: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-04-25T02:13:18.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:17 smithi137 ceph-mon[28303]: pgmap v110: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:18.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:17 smithi163 ceph-mon[32577]: pgmap v110: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:18.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:17 smithi174 ceph-mon[33171]: pgmap v110: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:20.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:19 smithi163 ceph-mon[32577]: pgmap v111: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:20.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:19 smithi174 ceph-mon[33171]: pgmap v111: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:20.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:19 smithi137 ceph-mon[28303]: pgmap v111: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-04-25T02:13:21.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:20 smithi163 ceph-mon[32577]: pgmap v112: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-04-25T02:13:21.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:20 smithi174 ceph-mon[33171]: pgmap v112: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-04-25T02:13:21.282 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:20 smithi137 ceph-mon[28303]: pgmap v112: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-04-25T02:13:23.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:23 smithi174 ceph-mon[33171]: pgmap v113: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:23.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:23 smithi137 ceph-mon[28303]: pgmap v113: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:23.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:23 smithi163 ceph-mon[32577]: pgmap v113: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:25.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:25 smithi174 ceph-mon[33171]: pgmap v114: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:25.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:25 smithi137 ceph-mon[28303]: pgmap v114: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:25.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:25 smithi163 ceph-mon[32577]: pgmap v114: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:27.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:27 smithi174 ceph-mon[33171]: pgmap v115: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:27.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:27 smithi137 ceph-mon[28303]: pgmap v115: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:27.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:27 smithi163 ceph-mon[32577]: pgmap v115: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:29.427 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:29 smithi174 ceph-mon[33171]: pgmap v116: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:29.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:29 smithi137 ceph-mon[28303]: pgmap v116: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:29.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:29 smithi163 ceph-mon[32577]: pgmap v116: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:31.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:31 smithi137 ceph-mon[28303]: pgmap v117: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:31.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:31 smithi163 ceph-mon[32577]: pgmap v117: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:31.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:31 smithi174 ceph-mon[33171]: pgmap v117: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:33.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:33 smithi137 ceph-mon[28303]: pgmap v118: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:33.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:33 smithi163 ceph-mon[32577]: pgmap v118: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:33.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:33 smithi174 ceph-mon[33171]: pgmap v118: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:35.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:35 smithi137 ceph-mon[28303]: pgmap v119: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:35.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:35 smithi163 ceph-mon[32577]: pgmap v119: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:35.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:35 smithi174 ceph-mon[33171]: pgmap v119: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:37.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:37 smithi137 ceph-mon[28303]: pgmap v120: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:37.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:37 smithi163 ceph-mon[32577]: pgmap v120: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:37.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:37 smithi174 ceph-mon[33171]: pgmap v120: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:39.479 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:39 smithi174 ceph-mon[33171]: pgmap v121: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:39.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:39 smithi137 ceph-mon[28303]: pgmap v121: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:39.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:39 smithi163 ceph-mon[32577]: pgmap v121: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:41.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:41 smithi137 ceph-mon[28303]: pgmap v122: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:41.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:41 smithi163 ceph-mon[32577]: pgmap v122: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:41.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:41 smithi174 ceph-mon[33171]: pgmap v122: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:43.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:43 smithi137 ceph-mon[28303]: pgmap v123: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:43.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:43 smithi163 ceph-mon[32577]: pgmap v123: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:43.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:43 smithi174 ceph-mon[33171]: pgmap v123: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:45.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:45 smithi137 ceph-mon[28303]: pgmap v124: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:45.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:45 smithi163 ceph-mon[32577]: pgmap v124: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:45.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:45 smithi174 ceph-mon[33171]: pgmap v124: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:47.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:47 smithi137 ceph-mon[28303]: pgmap v125: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:47.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:47 smithi163 ceph-mon[32577]: pgmap v125: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:47.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:47 smithi174 ceph-mon[33171]: pgmap v125: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:49.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:49 smithi137 ceph-mon[28303]: pgmap v126: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:49.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:49 smithi163 ceph-mon[32577]: pgmap v126: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:49.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:49 smithi174 ceph-mon[33171]: pgmap v126: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:51.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:51 smithi137 ceph-mon[28303]: pgmap v127: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:51.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:51 smithi163 ceph-mon[32577]: pgmap v127: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:51.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:51 smithi174 ceph-mon[33171]: pgmap v127: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:53.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:53 smithi137 ceph-mon[28303]: pgmap v128: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:53.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:53 smithi163 ceph-mon[32577]: pgmap v128: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:53.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:53 smithi174 ceph-mon[33171]: pgmap v128: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:55.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:55 smithi137 ceph-mon[28303]: pgmap v129: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:55.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:55 smithi163 ceph-mon[32577]: pgmap v129: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:55.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:55 smithi174 ceph-mon[33171]: pgmap v129: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:13:56.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:56 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:56.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:56 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:56.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:56 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:13:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:57 smithi137 ceph-mon[28303]: pgmap v130: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:57 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:57 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:57.533 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:57 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:13:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:57 smithi163 ceph-mon[32577]: pgmap v130: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:57 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:57 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:57.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:57 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:13:57.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:57 smithi174 ceph-mon[33171]: pgmap v130: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:57 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:13:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:57 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:13:57.677 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:57 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:13:59.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:13:59 smithi137 ceph-mon[28303]: pgmap v131: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:59.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:13:59 smithi163 ceph-mon[32577]: pgmap v131: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:13:59.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:13:59 smithi174 ceph-mon[33171]: pgmap v131: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:01.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:01 smithi137 ceph-mon[28303]: pgmap v132: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:01.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:01 smithi163 ceph-mon[32577]: pgmap v132: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:01.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:01 smithi174 ceph-mon[33171]: pgmap v132: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:03.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:03 smithi137 ceph-mon[28303]: pgmap v133: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:03.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:03 smithi163 ceph-mon[32577]: pgmap v133: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:03.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:03 smithi174 ceph-mon[33171]: pgmap v133: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:05.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:05 smithi137 ceph-mon[28303]: pgmap v134: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:05.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:05 smithi163 ceph-mon[32577]: pgmap v134: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:05.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:05 smithi174 ceph-mon[33171]: pgmap v134: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:07.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:07 smithi163 ceph-mon[32577]: pgmap v135: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:07.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:07 smithi174 ceph-mon[33171]: pgmap v135: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:07.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:07 smithi137 ceph-mon[28303]: pgmap v135: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:09.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:09 smithi163 ceph-mon[32577]: pgmap v136: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:09.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:09 smithi174 ceph-mon[33171]: pgmap v136: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:09.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:09 smithi137 ceph-mon[28303]: pgmap v136: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:11.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:11 smithi163 ceph-mon[32577]: pgmap v137: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:11.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:11 smithi174 ceph-mon[33171]: pgmap v137: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:11.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:11 smithi137 ceph-mon[28303]: pgmap v137: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:13.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:13 smithi163 ceph-mon[32577]: pgmap v138: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:13.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:13 smithi174 ceph-mon[33171]: pgmap v138: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:13.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:13 smithi137 ceph-mon[28303]: pgmap v138: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:14:15.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:15 smithi163 ceph-mon[32577]: pgmap v139: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:15.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:15 smithi174 ceph-mon[33171]: pgmap v139: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:15.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:15 smithi137 ceph-mon[28303]: pgmap v139: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:14:17.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:17 smithi163 ceph-mon[32577]: pgmap v140: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:17.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:17 smithi174 ceph-mon[33171]: pgmap v140: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:17.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:17 smithi137 ceph-mon[28303]: pgmap v140: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:19.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:19 smithi163 ceph-mon[32577]: pgmap v141: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:19.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:19 smithi174 ceph-mon[33171]: pgmap v141: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:19.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:19 smithi137 ceph-mon[28303]: pgmap v141: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:14:21.641 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:21 smithi163 ceph-mon[32577]: pgmap v142: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:14:21.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:21 smithi174 ceph-mon[33171]: pgmap v142: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:14:21.782 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:21 smithi137 ceph-mon[28303]: pgmap v142: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:14:23.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:23 smithi163 ceph-mon[32577]: pgmap v143: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:23.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:23 smithi174 ceph-mon[33171]: pgmap v143: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:24.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:23 smithi137 ceph-mon[28303]: pgmap v143: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:25.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:25 smithi163 ceph-mon[32577]: pgmap v144: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:25.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:25 smithi174 ceph-mon[33171]: pgmap v144: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:26.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:25 smithi137 ceph-mon[28303]: pgmap v144: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:27.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:27 smithi163 ceph-mon[32577]: pgmap v145: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:27.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:27 smithi174 ceph-mon[33171]: pgmap v145: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:28.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:27 smithi137 ceph-mon[28303]: pgmap v145: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:29.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:29 smithi163 ceph-mon[32577]: pgmap v146: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:29.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:29 smithi174 ceph-mon[33171]: pgmap v146: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:30.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:29 smithi137 ceph-mon[28303]: pgmap v146: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:31.894 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:31 smithi163 ceph-mon[32577]: pgmap v147: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:31.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:31 smithi174 ceph-mon[33171]: pgmap v147: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:32.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:31 smithi137 ceph-mon[28303]: pgmap v147: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:33.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:33 smithi163 ceph-mon[32577]: pgmap v148: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:33.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:33 smithi174 ceph-mon[33171]: pgmap v148: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:34.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:33 smithi137 ceph-mon[28303]: pgmap v148: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:35.835 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:35 smithi137 ceph-mon[28303]: pgmap v149: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:35.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:35 smithi163 ceph-mon[32577]: pgmap v149: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:35.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:35 smithi174 ceph-mon[33171]: pgmap v149: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:37.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:37 smithi163 ceph-mon[32577]: pgmap v150: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:37.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:37 smithi174 ceph-mon[33171]: pgmap v150: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:38.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:37 smithi137 ceph-mon[28303]: pgmap v150: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:39.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:39 smithi163 ceph-mon[32577]: pgmap v151: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:39.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:39 smithi174 ceph-mon[33171]: pgmap v151: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:40.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:39 smithi137 ceph-mon[28303]: pgmap v151: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:41.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:41 smithi163 ceph-mon[32577]: pgmap v152: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:41.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:41 smithi174 ceph-mon[33171]: pgmap v152: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:42.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:41 smithi137 ceph-mon[28303]: pgmap v152: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:43.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:43 smithi163 ceph-mon[32577]: pgmap v153: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:43.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:43 smithi174 ceph-mon[33171]: pgmap v153: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:44.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:43 smithi137 ceph-mon[28303]: pgmap v153: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:45.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:45 smithi163 ceph-mon[32577]: pgmap v154: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:45.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:45 smithi174 ceph-mon[33171]: pgmap v154: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:46.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:45 smithi137 ceph-mon[28303]: pgmap v154: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:47.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:47 smithi163 ceph-mon[32577]: pgmap v155: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:47.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:47 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:14:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:47 smithi174 ceph-mon[33171]: pgmap v155: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:47.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:47 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:14:48.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:47 smithi137 ceph-mon[28303]: pgmap v155: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:48.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:47 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:14:49.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:49 smithi163 ceph-mon[32577]: pgmap v156: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:14:49.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:49 smithi174 ceph-mon[33171]: pgmap v156: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:14:50.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:49 smithi137 ceph-mon[28303]: pgmap v156: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:14:51.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:51 smithi163 ceph-mon[32577]: pgmap v157: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:51.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:51 smithi174 ceph-mon[33171]: pgmap v157: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:52.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:51 smithi137 ceph-mon[28303]: pgmap v157: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:53.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:53 smithi163 ceph-mon[32577]: pgmap v158: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:53.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:53 smithi174 ceph-mon[33171]: pgmap v158: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:54.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:53 smithi137 ceph-mon[28303]: pgmap v158: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:55.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:55 smithi163 ceph-mon[32577]: pgmap v159: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:55.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:55 smithi174 ceph-mon[33171]: pgmap v159: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:56.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:55 smithi137 ceph-mon[28303]: pgmap v159: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:14:57.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:57 smithi163 ceph-mon[32577]: pgmap v160: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:57.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:57 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:57.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:57 smithi174 ceph-mon[33171]: pgmap v160: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:57.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:57 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:58.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:57 smithi137 ceph-mon[28303]: pgmap v160: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:14:58.034 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:57 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:14:58.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:58 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:58 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:58.891 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:58 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:14:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:58 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:58 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:58.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:58 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:14:59.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:58 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:14:59.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:58 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:14:59.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:58 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:14:59.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:14:59 smithi174 ceph-mon[33171]: pgmap v161: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:00.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:14:59 smithi137 ceph-mon[28303]: pgmap v161: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:00.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:14:59 smithi163 ceph-mon[32577]: pgmap v161: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:01.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:01 smithi174 ceph-mon[33171]: pgmap v162: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:02.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:01 smithi137 ceph-mon[28303]: pgmap v162: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:02.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:01 smithi163 ceph-mon[32577]: pgmap v162: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:03.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:03 smithi174 ceph-mon[33171]: pgmap v163: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:04.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:03 smithi137 ceph-mon[28303]: pgmap v163: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:04.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:03 smithi163 ceph-mon[32577]: pgmap v163: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:05.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:05 smithi174 ceph-mon[33171]: pgmap v164: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:06.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:05 smithi137 ceph-mon[28303]: pgmap v164: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:06.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:05 smithi163 ceph-mon[32577]: pgmap v164: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:07.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:07 smithi174 ceph-mon[33171]: pgmap v165: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:08.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:07 smithi137 ceph-mon[28303]: pgmap v165: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:07 smithi163 ceph-mon[32577]: pgmap v165: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:09.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:09 smithi174 ceph-mon[33171]: pgmap v166: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:10.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:09 smithi137 ceph-mon[28303]: pgmap v166: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:09 smithi163 ceph-mon[32577]: pgmap v166: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:11.926 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:11 smithi174 ceph-mon[33171]: pgmap v167: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:12.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:11 smithi137 ceph-mon[28303]: pgmap v167: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:12.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:11 smithi163 ceph-mon[32577]: pgmap v167: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:13 smithi137 ceph-mon[28303]: pgmap v168: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:14.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:13 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:14.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:13 smithi163 ceph-mon[32577]: pgmap v168: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:14.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:13 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:14.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:13 smithi174 ceph-mon[33171]: pgmap v168: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-25T02:15:14.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:13 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:15 smithi137 ceph-mon[28303]: pgmap v169: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:16.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:15 smithi163 ceph-mon[32577]: pgmap v169: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:16.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:15 smithi174 ceph-mon[33171]: pgmap v169: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-25T02:15:18.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:17 smithi137 ceph-mon[28303]: pgmap v170: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:18.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:17 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:17 smithi163 ceph-mon[32577]: pgmap v170: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:17 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:18.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:17 smithi174 ceph-mon[33171]: pgmap v170: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:18.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:17 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:19 smithi137 ceph-mon[28303]: pgmap v171: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:20.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:19 smithi163 ceph-mon[32577]: pgmap v171: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:20.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:19 smithi174 ceph-mon[33171]: pgmap v171: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T02:15:22.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:21 smithi137 ceph-mon[28303]: pgmap v172: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:15:22.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:21 smithi163 ceph-mon[32577]: pgmap v172: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:15:22.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:21 smithi174 ceph-mon[33171]: pgmap v172: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-25T02:15:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:23 smithi137 ceph-mon[28303]: pgmap v173: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:24.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:23 smithi163 ceph-mon[32577]: pgmap v173: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:24.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:23 smithi174 ceph-mon[33171]: pgmap v173: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:26.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:25 smithi137 ceph-mon[28303]: pgmap v174: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:26.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:25 smithi163 ceph-mon[32577]: pgmap v174: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:26.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:25 smithi174 ceph-mon[33171]: pgmap v174: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:27.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:26 smithi137 ceph-mon[28303]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:27.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:26 smithi163 ceph-mon[32577]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:27.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:26 smithi174 ceph-mon[33171]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-04-25T02:15:28.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:27 smithi137 ceph-mon[28303]: pgmap v175: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:28.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:27 smithi163 ceph-mon[32577]: pgmap v175: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:28.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:27 smithi174 ceph-mon[33171]: pgmap v175: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:30.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:29 smithi137 ceph-mon[28303]: pgmap v176: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:30.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:29 smithi163 ceph-mon[32577]: pgmap v176: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:30.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:29 smithi174 ceph-mon[33171]: pgmap v176: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:32.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:31 smithi137 ceph-mon[28303]: pgmap v177: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:32.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:31 smithi163 ceph-mon[32577]: pgmap v177: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:32.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:31 smithi174 ceph-mon[33171]: pgmap v177: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:34.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:33 smithi137 ceph-mon[28303]: pgmap v178: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:34.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:33 smithi163 ceph-mon[32577]: pgmap v178: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:34.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:33 smithi174 ceph-mon[33171]: pgmap v178: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:36.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:35 smithi137 ceph-mon[28303]: pgmap v179: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:36.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:35 smithi163 ceph-mon[32577]: pgmap v179: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:36.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:35 smithi174 ceph-mon[33171]: pgmap v179: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:38.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:37 smithi137 ceph-mon[28303]: pgmap v180: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:38.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:37 smithi163 ceph-mon[32577]: pgmap v180: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:38.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:37 smithi174 ceph-mon[33171]: pgmap v180: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:40.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:39 smithi137 ceph-mon[28303]: pgmap v181: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:40.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:39 smithi163 ceph-mon[32577]: pgmap v181: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:39 smithi174 ceph-mon[33171]: pgmap v181: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:42.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:41 smithi163 ceph-mon[32577]: pgmap v182: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:42.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:41 smithi174 ceph-mon[33171]: pgmap v182: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:42.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:41 smithi137 ceph-mon[28303]: pgmap v182: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:44.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:43 smithi163 ceph-mon[32577]: pgmap v183: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:44.177 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:43 smithi174 ceph-mon[33171]: pgmap v183: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:44.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:43 smithi137 ceph-mon[28303]: pgmap v183: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:46.141 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:45 smithi163 ceph-mon[32577]: pgmap v184: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:46.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:45 smithi174 ceph-mon[33171]: pgmap v184: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:46.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:45 smithi137 ceph-mon[28303]: pgmap v184: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:47 smithi163 ceph-mon[32577]: pgmap v185: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:48.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:47 smithi174 ceph-mon[33171]: pgmap v185: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:48.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:47 smithi137 ceph-mon[28303]: pgmap v185: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:50.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:49 smithi163 ceph-mon[32577]: pgmap v186: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:50.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:49 smithi174 ceph-mon[33171]: pgmap v186: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:50.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:49 smithi137 ceph-mon[28303]: pgmap v186: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:52.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:51 smithi163 ceph-mon[32577]: pgmap v187: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:52.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:51 smithi174 ceph-mon[33171]: pgmap v187: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:52.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:51 smithi137 ceph-mon[28303]: pgmap v187: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:54.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:53 smithi163 ceph-mon[32577]: pgmap v188: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:54.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:53 smithi174 ceph-mon[33171]: pgmap v188: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:54.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:53 smithi137 ceph-mon[28303]: pgmap v188: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:55.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:54 smithi163 ceph-mon[32577]: pgmap v189: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:55.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:54 smithi174 ceph-mon[33171]: pgmap v189: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:55.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:54 smithi137 ceph-mon[28303]: pgmap v189: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:15:57.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:57 smithi137 ceph-mon[28303]: pgmap v190: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:57.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:57 smithi163 ceph-mon[32577]: pgmap v190: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:57.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:57 smithi174 ceph-mon[33171]: pgmap v190: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:15:59.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:59 smithi137 ceph-mon[28303]: pgmap v191: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:59.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:15:59 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:59 smithi163 ceph-mon[32577]: pgmap v191: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:15:59 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:15:59.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:59 smithi174 ceph-mon[33171]: pgmap v191: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:15:59.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:15:59 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:16:00.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:00 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:00.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:00 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:00.532 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:00 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:16:00.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:00 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:00.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:00 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:00.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:00 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:16:00.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:00 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:16:00.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:00 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:16:00.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:00 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:16:01.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:01 smithi137 ceph-mon[28303]: pgmap v192: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:01.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:01 smithi163 ceph-mon[32577]: pgmap v192: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:01.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:01 smithi174 ceph-mon[33171]: pgmap v192: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:03.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:03 smithi137 ceph-mon[28303]: pgmap v193: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:03.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:03 smithi163 ceph-mon[32577]: pgmap v193: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:03.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:03 smithi174 ceph-mon[33171]: pgmap v193: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:05.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:05 smithi137 ceph-mon[28303]: pgmap v194: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-25T02:16:05.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:05 smithi163 ceph-mon[32577]: pgmap v194: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-25T02:16:05.676 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:05 smithi174 ceph-mon[33171]: pgmap v194: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-25T02:16:07.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:07 smithi137 ceph-mon[28303]: pgmap v195: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-25T02:16:07.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:07 smithi163 ceph-mon[32577]: pgmap v195: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-25T02:16:07.679 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:07 smithi174 ceph-mon[33171]: pgmap v195: 97 pgs: 97 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-25T02:16:08.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:08 smithi137 ceph-mon[28303]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T02:16:08.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:08 smithi163 ceph-mon[32577]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T02:16:08.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:08 smithi174 ceph-mon[33171]: osdmap e89: 12 total, 12 up, 12 in 2024-04-25T02:16:09.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:09 smithi137 ceph-mon[28303]: pgmap v197: 97 pgs: 8 active+clean+snaptrim, 76 active+clean, 13 active+clean+snaptrim_wait; 139 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:09.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:09 smithi174 ceph-mon[33171]: pgmap v197: 97 pgs: 8 active+clean+snaptrim, 76 active+clean, 13 active+clean+snaptrim_wait; 139 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:09.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:09 smithi163 ceph-mon[32577]: pgmap v197: 97 pgs: 8 active+clean+snaptrim, 76 active+clean, 13 active+clean+snaptrim_wait; 139 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:11.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:11 smithi137 ceph-mon[28303]: pgmap v198: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:11.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:11 smithi163 ceph-mon[32577]: pgmap v198: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:11.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:11 smithi174 ceph-mon[33171]: pgmap v198: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:13.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:13 smithi137 ceph-mon[28303]: pgmap v199: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:13.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:13 smithi163 ceph-mon[32577]: pgmap v199: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:13.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:13 smithi174 ceph-mon[33171]: pgmap v199: 97 pgs: 22 active+clean+snaptrim, 35 active+clean, 40 active+clean+snaptrim_wait; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-25T02:16:15.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:15 smithi163 ceph-mon[32577]: pgmap v200: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:15.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:15 smithi174 ceph-mon[33171]: pgmap v200: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:15.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:15 smithi137 ceph-mon[28303]: pgmap v200: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:17.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:17 smithi163 ceph-mon[32577]: pgmap v201: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:17.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:17 smithi174 ceph-mon[33171]: pgmap v201: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:17.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:17 smithi137 ceph-mon[28303]: pgmap v201: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:18.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:18 smithi163 ceph-mon[32577]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T02:16:18.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:18 smithi174 ceph-mon[33171]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T02:16:19.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:18 smithi137 ceph-mon[28303]: osdmap e90: 12 total, 12 up, 12 in 2024-04-25T02:16:19.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:19 smithi163 ceph-mon[32577]: pgmap v203: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:19.933 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:19 smithi174 ceph-mon[33171]: pgmap v203: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:20.032 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:19 smithi137 ceph-mon[28303]: pgmap v203: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:16:21.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:21 smithi163 ceph-mon[32577]: pgmap v204: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:21.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:21 smithi174 ceph-mon[33171]: pgmap v204: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:22.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:21 smithi137 ceph-mon[28303]: pgmap v204: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:23.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:23 smithi163 ceph-mon[32577]: pgmap v205: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:23.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:23 smithi174 ceph-mon[33171]: pgmap v205: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:23 smithi137 ceph-mon[28303]: pgmap v205: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:16:25.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:25 smithi163 ceph-mon[32577]: pgmap v206: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:25.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:25 smithi174 ceph-mon[33171]: pgmap v206: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:26.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:25 smithi137 ceph-mon[28303]: pgmap v206: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:27.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:27 smithi163 ceph-mon[32577]: pgmap v207: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:27.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:27 smithi174 ceph-mon[33171]: pgmap v207: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:28.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:27 smithi137 ceph-mon[28303]: pgmap v207: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:16:29.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:29 smithi163 ceph-mon[32577]: pgmap v208: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-25T02:16:29.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:29 smithi174 ceph-mon[33171]: pgmap v208: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-25T02:16:30.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:29 smithi137 ceph-mon[28303]: pgmap v208: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-04-25T02:16:31.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:31 smithi163 ceph-mon[32577]: pgmap v209: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:31.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:31 smithi174 ceph-mon[33171]: pgmap v209: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:32.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:31 smithi137 ceph-mon[28303]: pgmap v209: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:33.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:33 smithi163 ceph-mon[32577]: pgmap v210: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:33.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:33 smithi174 ceph-mon[33171]: pgmap v210: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:34.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:33 smithi137 ceph-mon[28303]: pgmap v210: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:35.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:35 smithi163 ceph-mon[32577]: pgmap v211: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:35.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:35 smithi174 ceph-mon[33171]: pgmap v211: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:36.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:35 smithi137 ceph-mon[28303]: pgmap v211: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:37.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:37 smithi163 ceph-mon[32577]: pgmap v212: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:37.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:37 smithi174 ceph-mon[33171]: pgmap v212: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:38.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:37 smithi137 ceph-mon[28303]: pgmap v212: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:39.890 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:39 smithi163 ceph-mon[32577]: pgmap v213: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:39.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:39 smithi174 ceph-mon[33171]: pgmap v213: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:40.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:39 smithi137 ceph-mon[28303]: pgmap v213: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:41.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:41 smithi174 ceph-mon[33171]: pgmap v214: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:42.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:41 smithi137 ceph-mon[28303]: pgmap v214: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:42.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:41 smithi163 ceph-mon[32577]: pgmap v214: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:43.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:43 smithi174 ceph-mon[33171]: pgmap v215: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:44.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:43 smithi137 ceph-mon[28303]: pgmap v215: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:44.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:43 smithi163 ceph-mon[32577]: pgmap v215: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:45.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:45 smithi174 ceph-mon[33171]: pgmap v216: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:46.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:45 smithi137 ceph-mon[28303]: pgmap v216: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:46.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:45 smithi163 ceph-mon[32577]: pgmap v216: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:47.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:47 smithi174 ceph-mon[33171]: pgmap v217: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:47.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:47 smithi163 ceph-mon[32577]: pgmap v217: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:48.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:47 smithi137 ceph-mon[28303]: pgmap v217: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:49.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:49 smithi174 ceph-mon[33171]: pgmap v218: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:50.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:49 smithi137 ceph-mon[28303]: pgmap v218: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:50.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:49 smithi163 ceph-mon[32577]: pgmap v218: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-25T02:16:51.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:51 smithi174 ceph-mon[33171]: pgmap v219: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:52.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:51 smithi137 ceph-mon[28303]: pgmap v219: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:52.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:51 smithi163 ceph-mon[32577]: pgmap v219: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:53.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:53 smithi174 ceph-mon[33171]: pgmap v220: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:54.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:53 smithi137 ceph-mon[28303]: pgmap v220: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:54.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:53 smithi163 ceph-mon[32577]: pgmap v220: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:56.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:55 smithi137 ceph-mon[28303]: pgmap v221: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:56.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:55 smithi163 ceph-mon[32577]: pgmap v221: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:56.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:55 smithi174 ceph-mon[33171]: pgmap v221: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:16:58.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:57 smithi137 ceph-mon[28303]: pgmap v222: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:58.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:57 smithi163 ceph-mon[32577]: pgmap v222: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:16:58.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:57 smithi174 ceph-mon[33171]: pgmap v222: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:00.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:16:59 smithi137 ceph-mon[28303]: pgmap v223: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:00.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:16:59 smithi163 ceph-mon[32577]: pgmap v223: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:00.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:16:59 smithi174 ceph-mon[33171]: pgmap v223: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:01.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:00 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:01.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:00 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:01.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:00 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:17:02.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:01 smithi137 ceph-mon[28303]: pgmap v224: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:02.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:01 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:02.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:01 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:02.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:01 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:17:02.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:01 smithi163 ceph-mon[32577]: pgmap v224: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:02.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:01 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:02.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:01 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:02.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:01 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:17:02.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:01 smithi174 ceph-mon[33171]: pgmap v224: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:02.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:01 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:17:02.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:01 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:17:02.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:01 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:17:04.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:03 smithi137 ceph-mon[28303]: pgmap v225: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:04.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:03 smithi163 ceph-mon[32577]: pgmap v225: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:04.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:03 smithi174 ceph-mon[33171]: pgmap v225: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:06.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:05 smithi137 ceph-mon[28303]: pgmap v226: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:17:06.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:05 smithi163 ceph-mon[32577]: pgmap v226: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:17:06.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:05 smithi174 ceph-mon[33171]: pgmap v226: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:17:08.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:07 smithi137 ceph-mon[28303]: pgmap v227: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:17:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:07 smithi163 ceph-mon[32577]: pgmap v227: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:17:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:07 smithi174 ceph-mon[33171]: pgmap v227: 97 pgs: 97 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:17:09.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:08 smithi137 ceph-mon[28303]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T02:17:09.075 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:08 smithi174 ceph-mon[33171]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T02:17:09.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:08 smithi163 ceph-mon[32577]: osdmap e91: 12 total, 12 up, 12 in 2024-04-25T02:17:10.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:09 smithi137 ceph-mon[28303]: pgmap v229: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:10.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:09 smithi163 ceph-mon[32577]: pgmap v229: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:10.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:09 smithi174 ceph-mon[33171]: pgmap v229: 97 pgs: 12 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 70 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:12.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:11 smithi137 ceph-mon[28303]: pgmap v230: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:12.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:11 smithi163 ceph-mon[32577]: pgmap v230: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:12.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:11 smithi174 ceph-mon[33171]: pgmap v230: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:14.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:13 smithi137 ceph-mon[28303]: pgmap v231: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:14.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:13 smithi163 ceph-mon[32577]: pgmap v231: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:14.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:13 smithi174 ceph-mon[33171]: pgmap v231: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 139 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:17:16.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:15 smithi137 ceph-mon[28303]: pgmap v232: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:16.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:15 smithi163 ceph-mon[32577]: pgmap v232: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:16.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:15 smithi174 ceph-mon[33171]: pgmap v232: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:18.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:17 smithi137 ceph-mon[28303]: pgmap v233: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:18.033 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:17 smithi137 ceph-mon[28303]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T02:17:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:17 smithi163 ceph-mon[32577]: pgmap v233: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:18.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:17 smithi163 ceph-mon[32577]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T02:17:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:17 smithi174 ceph-mon[33171]: pgmap v233: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:18.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:17 smithi174 ceph-mon[33171]: osdmap e92: 12 total, 12 up, 12 in 2024-04-25T02:17:20.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:19 smithi137 ceph-mon[28303]: pgmap v235: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:20.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:19 smithi163 ceph-mon[32577]: pgmap v235: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:20.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:19 smithi174 ceph-mon[33171]: pgmap v235: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:17:22.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:21 smithi137 ceph-mon[28303]: pgmap v236: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:22.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:21 smithi163 ceph-mon[32577]: pgmap v236: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:22.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:21 smithi174 ceph-mon[33171]: pgmap v236: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:24.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:23 smithi137 ceph-mon[28303]: pgmap v237: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:24.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:23 smithi163 ceph-mon[32577]: pgmap v237: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:24.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:23 smithi174 ceph-mon[33171]: pgmap v237: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:17:26.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:25 smithi137 ceph-mon[28303]: pgmap v238: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:26.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:25 smithi163 ceph-mon[32577]: pgmap v238: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:26.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:25 smithi174 ceph-mon[33171]: pgmap v238: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:28.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:27 smithi137 ceph-mon[28303]: pgmap v239: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:28.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:27 smithi163 ceph-mon[32577]: pgmap v239: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:28.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:27 smithi174 ceph-mon[33171]: pgmap v239: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:17:30.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:29 smithi163 ceph-mon[32577]: pgmap v240: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:17:30.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:29 smithi174 ceph-mon[33171]: pgmap v240: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:17:30.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:29 smithi137 ceph-mon[28303]: pgmap v240: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:17:32.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:31 smithi163 ceph-mon[32577]: pgmap v241: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:32.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:31 smithi174 ceph-mon[33171]: pgmap v241: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:32.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:31 smithi137 ceph-mon[28303]: pgmap v241: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:34.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:33 smithi163 ceph-mon[32577]: pgmap v242: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:34.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:33 smithi174 ceph-mon[33171]: pgmap v242: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:34.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:33 smithi137 ceph-mon[28303]: pgmap v242: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:36.083 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:35 smithi137 ceph-mon[28303]: pgmap v243: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:35 smithi163 ceph-mon[32577]: pgmap v243: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:36.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:35 smithi174 ceph-mon[33171]: pgmap v243: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:38.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:37 smithi163 ceph-mon[32577]: pgmap v244: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:38.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:37 smithi174 ceph-mon[33171]: pgmap v244: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:38.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:37 smithi137 ceph-mon[28303]: pgmap v244: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:40.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:39 smithi163 ceph-mon[32577]: pgmap v245: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:39 smithi174 ceph-mon[33171]: pgmap v245: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:40.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:39 smithi137 ceph-mon[28303]: pgmap v245: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:42.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:41 smithi163 ceph-mon[32577]: pgmap v246: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:42.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:41 smithi174 ceph-mon[33171]: pgmap v246: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:42.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:41 smithi137 ceph-mon[28303]: pgmap v246: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:44.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:43 smithi163 ceph-mon[32577]: pgmap v247: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:44.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:43 smithi174 ceph-mon[33171]: pgmap v247: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:44.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:43 smithi137 ceph-mon[28303]: pgmap v247: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:46.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:45 smithi163 ceph-mon[32577]: pgmap v248: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:46.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:45 smithi174 ceph-mon[33171]: pgmap v248: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:46.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:45 smithi137 ceph-mon[28303]: pgmap v248: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:47 smithi163 ceph-mon[32577]: pgmap v249: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:48.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:47 smithi174 ceph-mon[33171]: pgmap v249: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:48.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:47 smithi137 ceph-mon[28303]: pgmap v249: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:50.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:49 smithi163 ceph-mon[32577]: pgmap v250: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:50.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:49 smithi174 ceph-mon[33171]: pgmap v250: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:50.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:49 smithi137 ceph-mon[28303]: pgmap v250: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:51.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:50 smithi163 ceph-mon[32577]: pgmap v251: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:51.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:50 smithi174 ceph-mon[33171]: pgmap v251: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:51.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:50 smithi137 ceph-mon[28303]: pgmap v251: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:17:53.530 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:53 smithi137 ceph-mon[28303]: pgmap v252: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:53.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:53 smithi163 ceph-mon[32577]: pgmap v252: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:53.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:53 smithi174 ceph-mon[33171]: pgmap v252: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:55.531 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:55 smithi137 ceph-mon[28303]: pgmap v253: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:55.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:55 smithi163 ceph-mon[32577]: pgmap v253: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:55.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:55 smithi174 ceph-mon[33171]: pgmap v253: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:17:57.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:57 smithi163 ceph-mon[32577]: pgmap v254: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:57.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:57 smithi174 ceph-mon[33171]: pgmap v254: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:57.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:57 smithi137 ceph-mon[28303]: pgmap v254: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:17:59.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:17:59 smithi163 ceph-mon[32577]: pgmap v255: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:59.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:17:59 smithi174 ceph-mon[33171]: pgmap v255: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:17:59.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:17:59 smithi137 ceph-mon[28303]: pgmap v255: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:01.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:01 smithi163 ceph-mon[32577]: pgmap v256: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:01.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:01 smithi174 ceph-mon[33171]: pgmap v256: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:01.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:01 smithi137 ceph-mon[28303]: pgmap v256: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:02.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:02 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:02.678 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:02 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:02.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:02 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:18:03.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:03 smithi163 ceph-mon[32577]: pgmap v257: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:03.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:03 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:03.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:03 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:03.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:03 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:18:03.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:03 smithi174 ceph-mon[33171]: pgmap v257: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:03.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:03 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:03.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:03 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:03.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:03 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:18:03.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:03 smithi137 ceph-mon[28303]: pgmap v257: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:03.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:03 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:18:03.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:03 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:18:03.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:03 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:18:05.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:05 smithi163 ceph-mon[32577]: pgmap v258: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:18:05.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:05 smithi174 ceph-mon[33171]: pgmap v258: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:18:05.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:05 smithi137 ceph-mon[28303]: pgmap v258: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:18:07.582 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:07 smithi137 ceph-mon[28303]: pgmap v259: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:18:07.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:07 smithi163 ceph-mon[32577]: pgmap v259: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:18:07.675 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:07 smithi174 ceph-mon[33171]: pgmap v259: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:18:08.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:08 smithi163 ceph-mon[32577]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T02:18:08.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:08 smithi174 ceph-mon[33171]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T02:18:08.781 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:08 smithi137 ceph-mon[28303]: osdmap e93: 12 total, 12 up, 12 in 2024-04-25T02:18:09.639 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:09 smithi163 ceph-mon[32577]: pgmap v261: 97 pgs: 15 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 72 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:18:09.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:09 smithi174 ceph-mon[33171]: pgmap v261: 97 pgs: 15 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 72 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:18:09.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:09 smithi137 ceph-mon[28303]: pgmap v261: 97 pgs: 15 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 72 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:18:11.640 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:11 smithi163 ceph-mon[32577]: pgmap v262: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:11.674 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:11 smithi174 ceph-mon[33171]: pgmap v262: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:11.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:11 smithi137 ceph-mon[28303]: pgmap v262: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:13.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:13 smithi163 ceph-mon[32577]: pgmap v263: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:13.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:13 smithi174 ceph-mon[33171]: pgmap v263: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:14.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:13 smithi137 ceph-mon[28303]: pgmap v263: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 80 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-04-25T02:18:15.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:15 smithi163 ceph-mon[32577]: pgmap v264: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:15.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:15 smithi174 ceph-mon[33171]: pgmap v264: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:16.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:15 smithi137 ceph-mon[28303]: pgmap v264: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:17.889 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:17 smithi163 ceph-mon[32577]: pgmap v265: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:17.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:17 smithi174 ceph-mon[33171]: pgmap v265: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:18.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:17 smithi137 ceph-mon[28303]: pgmap v265: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:18.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:18 smithi174 ceph-mon[33171]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T02:18:19.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:18 smithi137 ceph-mon[28303]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T02:18:19.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:18 smithi163 ceph-mon[32577]: osdmap e94: 12 total, 12 up, 12 in 2024-04-25T02:18:19.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:19 smithi174 ceph-mon[33171]: pgmap v267: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:20.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:19 smithi137 ceph-mon[28303]: pgmap v267: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:20.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:19 smithi163 ceph-mon[32577]: pgmap v267: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:18:21.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:21 smithi174 ceph-mon[33171]: pgmap v268: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:22.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:21 smithi137 ceph-mon[28303]: pgmap v268: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:22.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:21 smithi163 ceph-mon[32577]: pgmap v268: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:23.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:23 smithi174 ceph-mon[33171]: pgmap v269: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:24.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:23 smithi137 ceph-mon[28303]: pgmap v269: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:24.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:23 smithi163 ceph-mon[32577]: pgmap v269: 97 pgs: 97 active+clean; 19 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:18:25.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:25 smithi174 ceph-mon[33171]: pgmap v270: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:26.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:25 smithi137 ceph-mon[28303]: pgmap v270: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:26.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:25 smithi163 ceph-mon[32577]: pgmap v270: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:27.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:27 smithi174 ceph-mon[33171]: pgmap v271: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:28.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:27 smithi137 ceph-mon[28303]: pgmap v271: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:28.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:27 smithi163 ceph-mon[32577]: pgmap v271: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-25T02:18:30.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:29 smithi137 ceph-mon[28303]: pgmap v272: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:18:30.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:29 smithi163 ceph-mon[32577]: pgmap v272: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:18:30.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:29 smithi174 ceph-mon[33171]: pgmap v272: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-04-25T02:18:32.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:31 smithi137 ceph-mon[28303]: pgmap v273: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:32.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:31 smithi163 ceph-mon[32577]: pgmap v273: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:32.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:31 smithi174 ceph-mon[33171]: pgmap v273: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:34.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:33 smithi137 ceph-mon[28303]: pgmap v274: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:34.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:33 smithi163 ceph-mon[32577]: pgmap v274: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:34.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:33 smithi174 ceph-mon[33171]: pgmap v274: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:36.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:35 smithi137 ceph-mon[28303]: pgmap v275: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:35 smithi163 ceph-mon[32577]: pgmap v275: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:36.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:35 smithi174 ceph-mon[33171]: pgmap v275: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:38.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:37 smithi137 ceph-mon[28303]: pgmap v276: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:38.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:37 smithi163 ceph-mon[32577]: pgmap v276: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:38.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:37 smithi174 ceph-mon[33171]: pgmap v276: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:39.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:39 smithi174 ceph-mon[33171]: pgmap v277: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:40.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:39 smithi137 ceph-mon[28303]: pgmap v277: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:40.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:39 smithi163 ceph-mon[32577]: pgmap v277: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:42.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:41 smithi137 ceph-mon[28303]: pgmap v278: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:42.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:41 smithi163 ceph-mon[32577]: pgmap v278: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:42.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:41 smithi174 ceph-mon[33171]: pgmap v278: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:44.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:43 smithi137 ceph-mon[28303]: pgmap v279: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:44.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:43 smithi163 ceph-mon[32577]: pgmap v279: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:44.206 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:43 smithi174 ceph-mon[33171]: pgmap v279: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:46.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:45 smithi137 ceph-mon[28303]: pgmap v280: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:46.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:45 smithi163 ceph-mon[32577]: pgmap v280: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:46.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:45 smithi174 ceph-mon[33171]: pgmap v280: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:48.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:47 smithi137 ceph-mon[28303]: pgmap v281: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:48.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:47 smithi163 ceph-mon[32577]: pgmap v281: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:48.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:47 smithi174 ceph-mon[33171]: pgmap v281: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:50.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:49 smithi137 ceph-mon[28303]: pgmap v282: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:50.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:49 smithi163 ceph-mon[32577]: pgmap v282: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:50.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:49 smithi174 ceph-mon[33171]: pgmap v282: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:18:52.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:51 smithi137 ceph-mon[28303]: pgmap v283: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:52.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:51 smithi163 ceph-mon[32577]: pgmap v283: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:52.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:51 smithi174 ceph-mon[33171]: pgmap v283: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:18:54.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:53 smithi137 ceph-mon[28303]: pgmap v284: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:54.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:53 smithi163 ceph-mon[32577]: pgmap v284: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:54.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:53 smithi174 ceph-mon[33171]: pgmap v284: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:56.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:55 smithi137 ceph-mon[28303]: pgmap v285: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:56.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:55 smithi163 ceph-mon[32577]: pgmap v285: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:56.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:55 smithi174 ceph-mon[33171]: pgmap v285: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:18:58.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:57 smithi137 ceph-mon[28303]: pgmap v286: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:58.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:57 smithi163 ceph-mon[32577]: pgmap v286: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:18:58.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:57 smithi174 ceph-mon[33171]: pgmap v286: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:00.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:18:59 smithi137 ceph-mon[28303]: pgmap v287: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:00.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:18:59 smithi163 ceph-mon[32577]: pgmap v287: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:00.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:18:59 smithi174 ceph-mon[33171]: pgmap v287: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:02.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:01 smithi137 ceph-mon[28303]: pgmap v288: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:02.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:01 smithi163 ceph-mon[32577]: pgmap v288: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:02.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:01 smithi174 ceph-mon[33171]: pgmap v288: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:04.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:03 smithi137 ceph-mon[28303]: pgmap v289: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:04.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:03 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:04.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:03 smithi163 ceph-mon[32577]: pgmap v289: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:04.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:03 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:04.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:03 smithi174 ceph-mon[33171]: pgmap v289: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:04.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:03 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:19:05.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:04 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:05.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:04 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:05.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:04 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:19:05.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:04 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:05.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:04 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:05.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:04 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:19:05.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:04 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:19:05.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:04 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:19:05.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:04 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:19:06.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:05 smithi137 ceph-mon[28303]: pgmap v290: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:19:06.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:05 smithi163 ceph-mon[32577]: pgmap v290: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:19:06.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:05 smithi174 ceph-mon[33171]: pgmap v290: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:19:08.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:07 smithi137 ceph-mon[28303]: pgmap v291: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:19:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:07 smithi163 ceph-mon[32577]: pgmap v291: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:19:08.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:07 smithi174 ceph-mon[33171]: pgmap v291: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-25T02:19:09.076 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:08 smithi174 ceph-mon[33171]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T02:19:09.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:08 smithi163 ceph-mon[32577]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T02:19:09.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:08 smithi137 ceph-mon[28303]: osdmap e95: 12 total, 12 up, 12 in 2024-04-25T02:19:10.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:09 smithi163 ceph-mon[32577]: pgmap v293: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:10.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:09 smithi174 ceph-mon[33171]: pgmap v293: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:10.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:09 smithi137 ceph-mon[28303]: pgmap v293: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:12.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:11 smithi163 ceph-mon[32577]: pgmap v294: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:12.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:11 smithi174 ceph-mon[33171]: pgmap v294: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:12.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:11 smithi137 ceph-mon[28303]: pgmap v294: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:13.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:13 smithi174 ceph-mon[33171]: pgmap v295: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:13.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:13 smithi174 ceph-mon[33171]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T02:19:14.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:13 smithi137 ceph-mon[28303]: pgmap v295: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:14.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:13 smithi137 ceph-mon[28303]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T02:19:14.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:13 smithi163 ceph-mon[32577]: pgmap v295: 97 pgs: 97 active+clean; 19 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:19:14.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:13 smithi163 ceph-mon[32577]: osdmap e96: 12 total, 12 up, 12 in 2024-04-25T02:19:15.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:15 smithi174 ceph-mon[33171]: pgmap v297: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:19:16.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:15 smithi137 ceph-mon[28303]: pgmap v297: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:19:16.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:15 smithi163 ceph-mon[32577]: pgmap v297: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:19:17.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:17 smithi174 ceph-mon[33171]: pgmap v298: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 241 B/s wr, 7 op/s 2024-04-25T02:19:17.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:17 smithi163 ceph-mon[32577]: pgmap v298: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 241 B/s wr, 7 op/s 2024-04-25T02:19:18.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:17 smithi137 ceph-mon[28303]: pgmap v298: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 241 B/s wr, 7 op/s 2024-04-25T02:19:19.925 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:19 smithi174 ceph-mon[33171]: pgmap v299: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:19:20.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:19 smithi137 ceph-mon[28303]: pgmap v299: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:19:20.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:19 smithi163 ceph-mon[32577]: pgmap v299: 97 pgs: 97 active+clean; 19 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:19:21.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:21 smithi174 ceph-mon[33171]: pgmap v300: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:22.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:21 smithi137 ceph-mon[28303]: pgmap v300: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:22.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:21 smithi163 ceph-mon[32577]: pgmap v300: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:24.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:23 smithi137 ceph-mon[28303]: pgmap v301: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:24.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:23 smithi163 ceph-mon[32577]: pgmap v301: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:24.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:23 smithi174 ceph-mon[33171]: pgmap v301: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:19:26.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:25 smithi137 ceph-mon[28303]: pgmap v302: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:19:26.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:25 smithi163 ceph-mon[32577]: pgmap v302: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:19:26.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:25 smithi174 ceph-mon[33171]: pgmap v302: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:19:28.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:27 smithi137 ceph-mon[28303]: pgmap v303: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:28.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:27 smithi163 ceph-mon[32577]: pgmap v303: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:28.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:27 smithi174 ceph-mon[33171]: pgmap v303: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:30.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:29 smithi137 ceph-mon[28303]: pgmap v304: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:30.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:29 smithi163 ceph-mon[32577]: pgmap v304: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:30.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:29 smithi174 ceph-mon[33171]: pgmap v304: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:32.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:31 smithi137 ceph-mon[28303]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:32.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:31 smithi163 ceph-mon[32577]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:32.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:31 smithi174 ceph-mon[33171]: pgmap v305: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:34.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:33 smithi137 ceph-mon[28303]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:34.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:33 smithi163 ceph-mon[32577]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:34.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:33 smithi174 ceph-mon[33171]: pgmap v306: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:36.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:35 smithi137 ceph-mon[28303]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:35 smithi163 ceph-mon[32577]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:36.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:35 smithi174 ceph-mon[33171]: pgmap v307: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:38.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:37 smithi137 ceph-mon[28303]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:38.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:37 smithi163 ceph-mon[32577]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:38.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:37 smithi174 ceph-mon[33171]: pgmap v308: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:39.977 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:39 smithi174 ceph-mon[33171]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:40.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:39 smithi137 ceph-mon[28303]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:40.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:39 smithi163 ceph-mon[32577]: pgmap v309: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:42.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:41 smithi137 ceph-mon[28303]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:42.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:41 smithi163 ceph-mon[32577]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:42.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:41 smithi174 ceph-mon[33171]: pgmap v310: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:44.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:43 smithi137 ceph-mon[28303]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:44.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:43 smithi163 ceph-mon[32577]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:44.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:43 smithi174 ceph-mon[33171]: pgmap v311: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:46.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:45 smithi137 ceph-mon[28303]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:46.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:45 smithi163 ceph-mon[32577]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:46.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:45 smithi174 ceph-mon[33171]: pgmap v312: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:48.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:47 smithi137 ceph-mon[28303]: pgmap v313: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:48.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:47 smithi163 ceph-mon[32577]: pgmap v313: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:48.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:47 smithi174 ceph-mon[33171]: pgmap v313: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:50.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:49 smithi137 ceph-mon[28303]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:50.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:49 smithi163 ceph-mon[32577]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:50.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:49 smithi174 ceph-mon[33171]: pgmap v314: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:19:52.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:51 smithi137 ceph-mon[28303]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:52.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:51 smithi163 ceph-mon[32577]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:52.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:51 smithi174 ceph-mon[33171]: pgmap v315: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-04-25T02:19:53.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 -- 172.21.15.137:0/3012147070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c801027c0 msgr2=0x7f7c80102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 --2- 172.21.15.137:0/3012147070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c801027c0 0x7f7c80102ba0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009900 tx=0x7f7c7402a480 comp rx=0 tx=0).stop 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 -- 172.21.15.137:0/3012147070 shutdown_connections 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 --2- 172.21.15.137:0/3012147070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c8010bb90 0x7f7c8010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 --2- 172.21.15.137:0/3012147070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801030e0 0x7f7c8010b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 --2- 172.21.15.137:0/3012147070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c801027c0 0x7f7c80102ba0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 -- 172.21.15.137:0/3012147070 >> 172.21.15.137:0/3012147070 conn(0x7f7c800fbf60 msgr2=0x7f7c800fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:53.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 -- 172.21.15.137:0/3012147070 shutdown_connections 2024-04-25T02:19:53.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.501+0000 7f7c87000640 1 -- 172.21.15.137:0/3012147070 wait complete. 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.502+0000 7f7c87000640 1 Processor -- start 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 -- start start 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801027c0 0x7f7c8019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 0x7f7c8019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80111ac0 con 0x7f7c801030e0 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80111940 con 0x7f7c801027c0 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c87000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80111c40 con 0x7f7c8010bb90 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c85200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c85200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33734/0 (socket says 172.21.15.137:33734) 2024-04-25T02:19:53.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c85200640 1 -- 172.21.15.137:0/3897606930 learned_addr learned my addr 172.21.15.137:0/3897606930 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c86600640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 0x7f7c8019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.503+0000 7f7c85c00640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801027c0 0x7f7c8019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 -- 172.21.15.137:0/3897606930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 msgr2=0x7f7c8019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 0x7f7c8019ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 -- 172.21.15.137:0/3897606930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801027c0 msgr2=0x7f7c8019a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801027c0 0x7f7c8019a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 -- 172.21.15.137:0/3897606930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8019f200 con 0x7f7c801030e0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c86600640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 0x7f7c8019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c85200640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00e9f0 tx=0x7f7c6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00ccc0 con 0x7f7c801030e0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8019f4f0 con 0x7f7c801030e0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c6c00ce60 con 0x7f7c801030e0 2024-04-25T02:19:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c010690 con 0x7f7c801030e0 2024-04-25T02:19:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.504+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801a6d80 con 0x7f7c801030e0 2024-04-25T02:19:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.505+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8004fd50 con 0x7f7c801030e0 2024-04-25T02:19:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.508+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f7c6c0046c0 con 0x7f7c801030e0 2024-04-25T02:19:53.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.509+0000 7f7c7e000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 0x7f7c680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.510+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f7c6c0cf870 con 0x7f7c801030e0 2024-04-25T02:19:53.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.510+0000 7f7c85c00640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 0x7f7c680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.510+0000 7f7c85c00640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 0x7f7c680a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000c00 tx=0x7f7c74005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:53.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.514+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f7c6c09c430 con 0x7f7c801030e0 2024-04-25T02:19:53.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.739+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7c80101c50 con 0x7f7c680a2cf0 2024-04-25T02:19:53.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.753+0000 7f7c7e000640 1 -- 172.21.15.137:0/3897606930 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f7c80101c50 con 0x7f7c680a2cf0 2024-04-25T02:19:53.757 INFO:teuthology.orchestra.run.smithi137.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-25T00:00:00", "created": "2024-04-25T02:09:51", "first": "2024-04-25T02:10:00", "last": "2024-04-25T02:19:00", "last_pruned": "2024-04-25T02:19:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 msgr2=0x7f7c680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 0x7f7c680a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000c00 tx=0x7f7c74005e80 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 msgr2=0x7f7c8019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00e9f0 tx=0x7f7c6c00edf0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 shutdown_connections 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f7c680a2cf0 0x7f7c680a51b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8010bb90 0x7f7c8019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7c801030e0 0x7f7c8019a840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 --2- 172.21.15.137:0/3897606930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c801027c0 0x7f7c8019a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 >> 172.21.15.137:0/3897606930 conn(0x7f7c800fbf60 msgr2=0x7f7c80101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 shutdown_connections 2024-04-25T02:19:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.756+0000 7f7c87000640 1 -- 172.21.15.137:0/3897606930 wait complete. 2024-04-25T02:19:53.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 -- 172.21.15.137:0/425404526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 msgr2=0x7f9bb8102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/425404526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8102ae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009900 tx=0x7f9ba802a480 comp rx=0 tx=0).stop 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 -- 172.21.15.137:0/425404526 shutdown_connections 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/425404526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb810bb20 0x7f9bb810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/425404526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb8103020 0x7f9bb810b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/425404526 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8102ae0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 -- 172.21.15.137:0/425404526 >> 172.21.15.137:0/425404526 conn(0x7f9bb80fbf60 msgr2=0x7f9bb80fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 -- 172.21.15.137:0/425404526 shutdown_connections 2024-04-25T02:19:53.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.968+0000 7f9bb7e00640 1 -- 172.21.15.137:0/425404526 wait complete. 2024-04-25T02:19:53.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.969+0000 7f9bb7e00640 1 Processor -- start 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.969+0000 7f9bb7e00640 1 -- start start 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb8103020 0x7f9bb8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb810bb20 0x7f9bb819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8111a40 con 0x7f9bb8102700 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb81118c0 con 0x7f9bb8103020 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb8111bc0 con 0x7f9bb810bb20 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33744/0 (socket says 172.21.15.137:33744) 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 -- 172.21.15.137:0/806170023 learned_addr learned my addr 172.21.15.137:0/806170023 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:53.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb7400640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb810bb20 0x7f9bb819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6000640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb8103020 0x7f9bb8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 -- 172.21.15.137:0/806170023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb810bb20 msgr2=0x7f9bb819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb810bb20 0x7f9bb819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 -- 172.21.15.137:0/806170023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb8103020 msgr2=0x7f9bb8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb8103020 0x7f9bb8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.970+0000 7f9bb6a00640 1 -- 172.21.15.137:0/806170023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb819cf30 con 0x7f9bb8102700 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9bb6a00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8006010 tx=0x7f9ba80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba803f030 con 0x7f9bb8102700 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb819d1c0 con 0x7f9bb8102700 2024-04-25T02:19:53.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba8003d00 con 0x7f9bb8102700 2024-04-25T02:19:53.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8035070 con 0x7f9bb8102700 2024-04-25T02:19:53.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.971+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb81a4ab0 con 0x7f9bb8102700 2024-04-25T02:19:53.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.972+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb804fd50 con 0x7f9bb8102700 2024-04-25T02:19:53.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.974+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9ba8042030 con 0x7f9bb8102700 2024-04-25T02:19:53.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.976+0000 7f9baf400640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 0x7f9b9c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:53.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.976+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f9ba80ef7c0 con 0x7f9bb8102700 2024-04-25T02:19:53.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.976+0000 7f9bb6000640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 0x7f9b9c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:53.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.977+0000 7f9bb6000640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 0x7f9b9c0a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80fe580 tx=0x7f9ba0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:53.982+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9ba80bbd30 con 0x7f9bb8102700 2024-04-25T02:19:54.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:53 smithi137 ceph-mon[28303]: pgmap v316: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:54.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:53 smithi163 ceph-mon[32577]: pgmap v316: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:54.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:53 smithi174 ceph-mon[33171]: pgmap v316: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:54.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.203+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 --> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9bb8061b80 con 0x7f9b9c0a2cf0 2024-04-25T02:19:54.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.217+0000 7f9baf400640 1 -- 172.21.15.137:0/806170023 <== mgr.15126 v2:172.21.15.137:6800/3051730287 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9bb8061b80 con 0x7f9b9c0a2cf0 2024-04-25T02:19:54.220 INFO:teuthology.orchestra.run.smithi137.stdout:/ 1m 6m3h 2024-04-25T02:19:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.219+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 msgr2=0x7f9b9c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.219+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 0x7f9b9c0a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80fe580 tx=0x7f9ba0005f90 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.219+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 msgr2=0x7f9bb8197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.219+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8006010 tx=0x7f9ba80042f0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 shutdown_connections 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9b9c0a2cf0 0x7f9b9c0a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bb810bb20 0x7f9bb819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bb8103020 0x7f9bb8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 --2- 172.21.15.137:0/806170023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9bb8102700 0x7f9bb8197f40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 >> 172.21.15.137:0/806170023 conn(0x7f9bb80fbf60 msgr2=0x7f9bb80fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 shutdown_connections 2024-04-25T02:19:54.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.220+0000 7f9bb7e00640 1 -- 172.21.15.137:0/806170023 wait complete. 2024-04-25T02:19:54.242 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-25T02:19:54.254 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-25T02:19:54.254 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-04-25T02:19:54.258 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T02:19:54.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3654206748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a581042e0 msgr2=0x7f2a581107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3654206748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a581042e0 0x7f2a581107f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009cd0 tx=0x7f2a5002a8f0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3654206748 shutdown_connections 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3654206748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a581042e0 0x7f2a581107f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3654206748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a58103920 0x7f2a58103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3654206748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58109930 0x7f2a58109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.467+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3654206748 >> 172.21.15.137:0/3654206748 conn(0x7f2a580ff3f0 msgr2=0x7f2a58101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:54.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.468+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3654206748 shutdown_connections 2024-04-25T02:19:54.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.468+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3654206748 wait complete. 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.468+0000 7f2a5dc00640 1 Processor -- start 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 -- start start 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58103920 0x7f2a5819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 0x7f2a5819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58113e80 con 0x7f2a58109930 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58113d00 con 0x7f2a581042e0 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a5dc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58114000 con 0x7f2a58103920 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a57400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 0x7f2a5819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a56000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a56000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:38100/0 (socket says 172.21.15.137:38100) 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a56000640 1 -- 172.21.15.137:0/3985138579 learned_addr learned my addr 172.21.15.137:0/3985138579 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.469+0000 7f2a56a00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58103920 0x7f2a5819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 -- 172.21.15.137:0/3985138579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58103920 msgr2=0x7f2a5819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58103920 0x7f2a5819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 -- 172.21.15.137:0/3985138579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 msgr2=0x7f2a5819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 -- 172.21.15.137:0/3985138579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5819f310 con 0x7f2a58109930 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a56000640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a57400640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 0x7f2a5819ebe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a5002ae10 tx=0x7f2a50003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50030ed0 con 0x7f2a58109930 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a50040070 con 0x7f2a58109930 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50045af0 con 0x7f2a58109930 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.470+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5819f5a0 con 0x7f2a58109930 2024-04-25T02:19:54.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.471+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a581a6e90 con 0x7f2a58109930 2024-04-25T02:19:54.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.472+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a58105060 con 0x7f2a58109930 2024-04-25T02:19:54.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.474+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f2a50045cd0 con 0x7f2a58109930 2024-04-25T02:19:54.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.475+0000 7f2a4f400640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 0x7f2a3c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.475+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f2a500f0320 con 0x7f2a58109930 2024-04-25T02:19:54.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.475+0000 7f2a56a00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 0x7f2a3c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.476+0000 7f2a56a00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 0x7f2a3c0a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800bb60 tx=0x7f2a4800b390 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:54.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.479+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f2a500bd080 con 0x7f2a58109930 2024-04-25T02:19:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.679+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a581a70f0 con 0x7f2a58109930 2024-04-25T02:19:54.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.682+0000 7f2a4f400640 1 -- 172.21.15.137:0/3985138579 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23149 (secure 0 0 0) 0x7f2a500bc980 con 0x7f2a58109930 2024-04-25T02:19:54.686 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:19:54.686 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":96,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:19:12.641048+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:19:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 msgr2=0x7f2a3c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 0x7f2a3c0a51c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800bb60 tx=0x7f2a4800b390 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 msgr2=0x7f2a5819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 0x7f2a5819ebe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a5002ae10 tx=0x7f2a50003f10 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 shutdown_connections 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2a3c0a2d00 0x7f2a3c0a51c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a58109930 0x7f2a5819ebe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a581042e0 0x7f2a5819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 --2- 172.21.15.137:0/3985138579 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a58103920 0x7f2a5819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 >> 172.21.15.137:0/3985138579 conn(0x7f2a580ff3f0 msgr2=0x7f2a580ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 shutdown_connections 2024-04-25T02:19:54.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.685+0000 7f2a5dc00640 1 -- 172.21.15.137:0/3985138579 wait complete. 2024-04-25T02:19:54.706 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 95, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:19:54.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:19:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 -- 172.21.15.137:0/3448560488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 msgr2=0x7f3728103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 --2- 172.21.15.137:0/3448560488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f3728103c70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3714009930 tx=0x7f371402a420 comp rx=0 tx=0).stop 2024-04-25T02:19:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 -- 172.21.15.137:0/3448560488 shutdown_connections 2024-04-25T02:19:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 --2- 172.21.15.137:0/3448560488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 0x7f37281106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 --2- 172.21.15.137:0/3448560488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f3728103c70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 --2- 172.21.15.137:0/3448560488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 0x7f3728109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.896+0000 7f3727200640 1 -- 172.21.15.137:0/3448560488 >> 172.21.15.137:0/3448560488 conn(0x7f37280ff280 msgr2=0x7f37281016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.897+0000 7f3727200640 1 -- 172.21.15.137:0/3448560488 shutdown_connections 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.897+0000 7f3727200640 1 -- 172.21.15.137:0/3448560488 wait complete. 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.897+0000 7f3727200640 1 Processor -- start 2024-04-25T02:19:54.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 -- start start 2024-04-25T02:19:54.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 0x7f372819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 0x7f372819ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113d80 con 0x7f37281037f0 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113c00 con 0x7f3728109800 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3727200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113f00 con 0x7f37281041b0 2024-04-25T02:19:54.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3725e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3725e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33780/0 (socket says 172.21.15.137:33780) 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3725e00640 1 -- 172.21.15.137:0/2331878606 learned_addr learned my addr 172.21.15.137:0/2331878606 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3725400640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 0x7f372819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.898+0000 7f3726800640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 0x7f372819ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 -- 172.21.15.137:0/2331878606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 msgr2=0x7f372819a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 0x7f372819a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 -- 172.21.15.137:0/2331878606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 msgr2=0x7f372819ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:54.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 0x7f372819ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 -- 172.21.15.137:0/2331878606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372819f1b0 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3725e00640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f371800e9f0 tx=0x7f371800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371800cd80 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3718010930 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718018b00 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372819f4a0 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.899+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281a6d30 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.900+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37280688d0 con 0x7f37281037f0 2024-04-25T02:19:54.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.902+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f3718018ca0 con 0x7f37281037f0 2024-04-25T02:19:54.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.904+0000 7f371ea00640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 0x7f370c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.904+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f37180cf750 con 0x7f37281037f0 2024-04-25T02:19:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.904+0000 7f3725400640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 0x7f370c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:54.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.905+0000 7f3725400640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 0x7f370c0a5240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3714006010 tx=0x7f3714005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:54.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:54.908+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f371809bcc0 con 0x7f37281037f0 2024-04-25T02:19:55.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:54 smithi137 ceph-mon[28303]: from='client.15999 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:55.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:54 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3985138579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:19:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.106+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f372810bd80 con 0x7f37281037f0 2024-04-25T02:19:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.107+0000 7f371ea00640 1 -- 172.21.15.137:0/2331878606 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f371809ffc0 con 0x7f37281037f0 2024-04-25T02:19:55.110 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 msgr2=0x7f370c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 0x7f370c0a5240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3714006010 tx=0x7f3714005e80 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 msgr2=0x7f372819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f371800e9f0 tx=0x7f371800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 shutdown_connections 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f370c0a2d80 0x7f370c0a5240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3728109800 0x7f372819ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37281041b0 0x7f372819a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 --2- 172.21.15.137:0/2331878606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f37281037f0 0x7f372819a1c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 >> 172.21.15.137:0/2331878606 conn(0x7f37280ff280 msgr2=0x7f37280ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:55.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 shutdown_connections 2024-04-25T02:19:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.110+0000 7f3727200640 1 -- 172.21.15.137:0/2331878606 wait complete. 2024-04-25T02:19:55.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:19:55.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:54 smithi163 ceph-mon[32577]: from='client.15999 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:55.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:54 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3985138579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:19:55.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:54 smithi174 ceph-mon[33171]: from='client.15999 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:55.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:54 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3985138579' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:19:55.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 -- 172.21.15.137:0/3018428546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c1125e0 msgr2=0x7f9c3c1149d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 --2- 172.21.15.137:0/3018428546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1149d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009ca0 tx=0x7f9c3402a950 comp rx=0 tx=0).stop 2024-04-25T02:19:55.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 -- 172.21.15.137:0/3018428546 shutdown_connections 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 --2- 172.21.15.137:0/3018428546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1149d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 --2- 172.21.15.137:0/3018428546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c074400 0x7f9c3c1120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 --2- 172.21.15.137:0/3018428546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 -- 172.21.15.137:0/3018428546 >> 172.21.15.137:0/3018428546 conn(0x7f9c3c0fd0e0 msgr2=0x7f9c3c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 -- 172.21.15.137:0/3018428546 shutdown_connections 2024-04-25T02:19:55.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.329+0000 7f9c3b200640 1 -- 172.21.15.137:0/3018428546 wait complete. 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 Processor -- start 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 -- start start 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 0x7f9c3c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c118150 con 0x7f9c3c073ae0 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c117fd0 con 0x7f9c3c1125e0 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c3b200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c1182d0 con 0x7f9c3c074400 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.330+0000 7f9c39e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33796/0 (socket says 172.21.15.137:33796) 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 -- 172.21.15.137:0/1575777162 learned_addr learned my addr 172.21.15.137:0/1575777162 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:55.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c3a800640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39400640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 0x7f9c3c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 -- 172.21.15.137:0/1575777162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 msgr2=0x7f9c3c19ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 0x7f9c3c19ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 -- 172.21.15.137:0/1575777162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c1125e0 msgr2=0x7f9c3c1a2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1a2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 -- 172.21.15.137:0/1575777162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c1a3580 con 0x7f9c3c073ae0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39400640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 0x7f9c3c19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.331+0000 7f9c39e00640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00e9f0 tx=0x7f9c2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.332+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00cd80 con 0x7f9c3c073ae0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.332+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9c2c010930 con 0x7f9c3c073ae0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.332+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c1a3870 con 0x7f9c3c073ae0 2024-04-25T02:19:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.332+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c018b00 con 0x7f9c3c073ae0 2024-04-25T02:19:55.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.332+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c1ab100 con 0x7f9c3c073ae0 2024-04-25T02:19:55.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.333+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3c067bf0 con 0x7f9c3c073ae0 2024-04-25T02:19:55.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.335+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9c2c018ca0 con 0x7f9c3c073ae0 2024-04-25T02:19:55.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.336+0000 7f9c32a00640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 0x7f9c200a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.336+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f9c2c0cf880 con 0x7f9c3c073ae0 2024-04-25T02:19:55.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.336+0000 7f9c39400640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 0x7f9c200a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.337+0000 7f9c39400640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 0x7f9c200a51c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ff700 tx=0x7f9c28005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:55.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.340+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9c2c09c4a0 con 0x7f9c3c073ae0 2024-04-25T02:19:55.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.541+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9c3c1ab2d0 con 0x7f9c3c073ae0 2024-04-25T02:19:55.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.541+0000 7f9c32a00640 1 -- 172.21.15.137:0/1575777162 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) ==== 104+0+11 (secure 0 0 0) 0x7f9c2c09bda0 con 0x7f9c3c073ae0 2024-04-25T02:19:55.545 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 msgr2=0x7f9c200a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 0x7f9c200a51c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0ff700 tx=0x7f9c28005f90 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 msgr2=0x7f9c3c19e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00e9f0 tx=0x7f9c2c00eeb0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 shutdown_connections 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f9c200a2d00 0x7f9c200a51c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c3c1125e0 0x7f9c3c1a2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c3c074400 0x7f9c3c19ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 --2- 172.21.15.137:0/1575777162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c3c073ae0 0x7f9c3c19e590 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 >> 172.21.15.137:0/1575777162 conn(0x7f9c3c0fd0e0 msgr2=0x7f9c3c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 shutdown_connections 2024-04-25T02:19:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.544+0000 7f9c3b200640 1 -- 172.21.15.137:0/1575777162 wait complete. 2024-04-25T02:19:55.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:19:55.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 -- 172.21.15.137:0/2706684869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194100d60 msgr2=0x7f919410d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 --2- 172.21.15.137:0/2706684869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194100d60 0x7f919410d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f917c009900 tx=0x7f917c02a3f0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 -- 172.21.15.137:0/2706684869 shutdown_connections 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 --2- 172.21.15.137:0/2706684869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f919410df60 0x7f9194110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 --2- 172.21.15.137:0/2706684869 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9194100d60 0x7f919410d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 --2- 172.21.15.137:0/2706684869 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91941003b0 0x7f9194100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 -- 172.21.15.137:0/2706684869 >> 172.21.15.137:0/2706684869 conn(0x7f91940fbfc0 msgr2=0x7f91940fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 -- 172.21.15.137:0/2706684869 shutdown_connections 2024-04-25T02:19:55.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.771+0000 7f919a400640 1 -- 172.21.15.137:0/2706684869 wait complete. 2024-04-25T02:19:55.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 Processor -- start 2024-04-25T02:19:55.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 -- start start 2024-04-25T02:19:55.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 0x7f919419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f919410df60 0x7f919419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9194113d80 con 0x7f91941003b0 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9194113c00 con 0x7f919410df60 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f919a400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9194113f00 con 0x7f9194100d60 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f9199000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f9199000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33814/0 (socket says 172.21.15.137:33814) 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.772+0000 7f9199000640 1 -- 172.21.15.137:0/3122231722 learned_addr learned my addr 172.21.15.137:0/3122231722 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199a00640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f919410df60 0x7f919419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f918be00640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 0x7f919419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 -- 172.21.15.137:0/3122231722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 msgr2=0x7f919419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 0x7f919419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 -- 172.21.15.137:0/3122231722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f919410df60 msgr2=0x7f919419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f919410df60 0x7f919419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 -- 172.21.15.137:0/3122231722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919419f210 con 0x7f91941003b0 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f918be00640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 0x7f919419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:19:55.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9199000640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f918400e9f0 tx=0x7f918400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:55.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918400cd80 con 0x7f91941003b0 2024-04-25T02:19:55.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9184010930 con 0x7f91941003b0 2024-04-25T02:19:55.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184018b00 con 0x7f91941003b0 2024-04-25T02:19:55.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.773+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919419f500 con 0x7f91941003b0 2024-04-25T02:19:55.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.774+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91941a6d90 con 0x7f91941003b0 2024-04-25T02:19:55.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.775+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91940691b0 con 0x7f91941003b0 2024-04-25T02:19:55.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.776+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9184018ca0 con 0x7f91941003b0 2024-04-25T02:19:55.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.778+0000 7f9192000640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 0x7f91780a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:55.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.778+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f91840cf8e0 con 0x7f91941003b0 2024-04-25T02:19:55.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.778+0000 7f918be00640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 0x7f91780a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:55.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.779+0000 7f918be00640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 0x7f91780a51c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f917c000c00 tx=0x7f917c005a40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:55.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.782+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f918409c4a0 con 0x7f91941003b0 2024-04-25T02:19:55.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.982+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91941a6fc0 con 0x7f91941003b0 2024-04-25T02:19:55.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.983+0000 7f9192000640 1 -- 172.21.15.137:0/3122231722 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) ==== 100+0+11 (secure 0 0 0) 0x7f918409bda0 con 0x7f91941003b0 2024-04-25T02:19:55.987 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:19:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.985+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 msgr2=0x7f91780a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.985+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 0x7f91780a51c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f917c000c00 tx=0x7f917c005a40 comp rx=0 tx=0).stop 2024-04-25T02:19:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 msgr2=0x7f919419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f918400e9f0 tx=0x7f918400eeb0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 shutdown_connections 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f91780a2d00 0x7f91780a51c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f919410df60 0x7f919419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9194100d60 0x7f919419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 --2- 172.21.15.137:0/3122231722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91941003b0 0x7f919419a220 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 >> 172.21.15.137:0/3122231722 conn(0x7f91940fbfc0 msgr2=0x7f91940ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 shutdown_connections 2024-04-25T02:19:55.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:55.986+0000 7f919a400640 1 -- 172.21.15.137:0/3122231722 wait complete. 2024-04-25T02:19:56.004 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:55 smithi137 ceph-mon[28303]: from='client.16005 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:56.004 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:55 smithi137 ceph-mon[28303]: pgmap v317: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:56.004 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:55 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2331878606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.004 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:55 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1575777162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T02:19:56.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:55 smithi163 ceph-mon[32577]: from='client.16005 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:56.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:55 smithi163 ceph-mon[32577]: pgmap v317: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:56.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:55 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2331878606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:55 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1575777162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:55 smithi174 ceph-mon[33171]: from='client.16005 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T02:19:56.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:55 smithi174 ceph-mon[33171]: pgmap v317: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:19:56.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:55 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2331878606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:55 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1575777162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:19:56.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 -- 172.21.15.137:0/3147780873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5818103920 msgr2=0x7f5818103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:56.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 --2- 172.21.15.137:0/3147780873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5818103920 0x7f5818103da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5804009930 tx=0x7f580402a420 comp rx=0 tx=0).stop 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 -- 172.21.15.137:0/3147780873 shutdown_connections 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 --2- 172.21.15.137:0/3147780873 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58181042e0 0x7f58181107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 --2- 172.21.15.137:0/3147780873 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5818103920 0x7f5818103da0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 --2- 172.21.15.137:0/3147780873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818109930 0x7f5818109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 -- 172.21.15.137:0/3147780873 >> 172.21.15.137:0/3147780873 conn(0x7f58180ff3f0 msgr2=0x7f5818101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 -- 172.21.15.137:0/3147780873 shutdown_connections 2024-04-25T02:19:56.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.176+0000 7f581ce00640 1 -- 172.21.15.137:0/3147780873 wait complete. 2024-04-25T02:19:56.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.177+0000 7f581ce00640 1 Processor -- start 2024-04-25T02:19:56.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.177+0000 7f581ce00640 1 -- start start 2024-04-25T02:19:56.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58181042e0 0x7f581819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5818109930 0x7f581819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5818113e30 con 0x7f5818103920 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f5818113cb0 con 0x7f5818109930 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f581ce00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5818113fb0 con 0x7f58181042e0 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:33828/0 (socket says 172.21.15.137:33828) 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 -- 172.21.15.137:0/877135701 learned_addr learned my addr 172.21.15.137:0/877135701 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815400640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58181042e0 0x7f581819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5816800640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5818109930 0x7f581819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 -- 172.21.15.137:0/877135701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58181042e0 msgr2=0x7f581819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58181042e0 0x7f581819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 -- 172.21.15.137:0/877135701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5818109930 msgr2=0x7f581819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5818109930 0x7f581819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.178+0000 7f5815e00640 1 -- 172.21.15.137:0/877135701 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581819f340 con 0x7f5818103920 2024-04-25T02:19:56.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f5815e00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f580800e9f0 tx=0x7f580800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580800cd80 con 0x7f5818103920 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5808010930 con 0x7f5818103920 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581819f630 con 0x7f5818103920 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808018b00 con 0x7f5818103920 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.179+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58181a6ec0 con 0x7f5818103920 2024-04-25T02:19:56.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.180+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818068560 con 0x7f5818103920 2024-04-25T02:19:56.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.182+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f5808018ca0 con 0x7f5818103920 2024-04-25T02:19:56.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.184+0000 7f580ea00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 0x7f57fc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:19:56.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.184+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8513+0+0 (secure 0 0 0) 0x7f58080cf7c0 con 0x7f5818103920 2024-04-25T02:19:56.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.184+0000 7f5815400640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 0x7f57fc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:19:56.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.185+0000 7f5815400640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 0x7f57fc0a51c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5804009900 tx=0x7f58040058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:19:56.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.188+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f580809bd30 con 0x7f5818103920 2024-04-25T02:19:56.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.433+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f581819b6a0 con 0x7f5818103920 2024-04-25T02:19:56.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.450+0000 7f580ea00640 1 -- 172.21.15.137:0/877135701 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740913 (secure 0 0 0) 0x7f58080a0030 con 0x7f5818103920 2024-04-25T02:19:56.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:19:56.467 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "epoch": 26, 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "active_gid": 15126, 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "active_name": "x", 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "active_addrs": { 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6800", 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3051730287 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.468 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:6801", 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3051730287 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "active_addr": "172.21.15.137:6801/3051730287", 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "active_change": "2024-04-25T02:09:41.978310+0000", 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "available": true, 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "standbys": [ 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "gid": 25205, 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "y", 2024-04-25T02:19:56.469 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_features": 4540701547738038271, 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "available_modules": [ 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "alerts", 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.470 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.471 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.472 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.473 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.474 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.475 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_destination": { 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_destination", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.476 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email address to send alerts to", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_from_name": { 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_from_name", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "Ceph", 2024-04-25T02:19:56.477 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email From: name", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_host": { 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_host", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.478 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP server", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_password": { 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_password", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.479 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Password to authenticate with", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_port": { 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_port", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "465", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP port", 2024-04-25T02:19:56.480 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_sender": { 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_sender", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP envelope sender", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.481 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_ssl": { 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_ssl", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.482 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_user": { 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_user", 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.483 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "User to authenticate as", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "balancer", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "active": { 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "active", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.485 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_time": { 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_time", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0000", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.486 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_weekday": { 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_weekday", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:56.487 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_max_iterations": { 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_max_iterations", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "25", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.488 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "250", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_metrics": { 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_metrics", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.489 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_step": { 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_step", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.5", 2024-04-25T02:19:56.490 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0.001", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "0.999", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "aggressiveness of optimization", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "end_time": { 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_time", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2359", 2024-04-25T02:19:56.491 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "end_weekday": { 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_weekday", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:56.492 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.493 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.494 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.496 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.497 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "min_score": { 2024-04-25T02:19:56.498 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_score", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:56.499 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "upmap", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "crush-compat", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "none", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "read", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap", 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap-read" 2024-04-25T02:19:56.500 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Balancer mode", 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_ids": { 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_ids", 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.501 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.502 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.503 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_deviation": { 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_deviation", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.504 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_optimizations": { 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_optimizations", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.505 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_down_multiplier": { 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_down_multiplier", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.506 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_refresh_rate": { 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_refresh_rate", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "20", 2024-04-25T02:19:56.507 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_starting_port": { 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_starting_port", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4721", 2024-04-25T02:19:56.508 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_ptrace": { 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_ptrace", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.509 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_interval": { 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_interval", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.510 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_memory_target_ratio": { 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T02:19:56.511 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.7", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.513 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm_log_destination": { 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm_log_destination", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "file", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "file,syslog", 2024-04-25T02:19:56.514 INFO:teuthology.orchestra.run.smithi137.stdout: "syslog" 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "cgroups_split": { 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cgroups_split", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "config_checks_enabled": { 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_checks_enabled", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.516 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "config_dashboard": { 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_dashboard", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.517 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_alertmanager": { 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_alertmanager", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.518 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_base": { 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_base", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.519 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Container image name, without the tag", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_elasticsearch": { 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_elasticsearch", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.520 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "elasticsearch container image", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_grafana": { 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_grafana", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.521 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_haproxy": { 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_haproxy", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.522 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "HAproxy container image", 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_agent": { 2024-04-25T02:19:56.523 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_agent", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger agent container image", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_collector": { 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_collector", 2024-04-25T02:19:56.524 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger collector container image", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_query": { 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_query", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger query container image", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_keepalived": { 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_keepalived", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Keepalived container image", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_loki": { 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_loki", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T02:19:56.527 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Loki container image", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_node_exporter": { 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_node_exporter", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T02:19:56.528 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_nvmeof": { 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_nvmeof", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T02:19:56.529 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Nvme-of container image", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_prometheus": { 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_prometheus", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T02:19:56.530 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_promtail": { 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_promtail", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T02:19:56.531 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Promtail container image", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_samba": { 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_samba", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.532 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Samba/SMB container image", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_snmp_gateway": { 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_snmp_gateway", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.533 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SNMP Gateway container image", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "container_init": { 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_init", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.534 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "daemon_cache_timeout": { 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "daemon_cache_timeout", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.535 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "default_cephadm_command_timeout": { 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.536 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "900", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "default_registry": { 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_registry", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io", 2024-04-25T02:19:56.537 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "device_cache_timeout": { 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_cache_timeout", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.538 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1800", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache device inventory", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "device_enhanced_scan": { 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_enhanced_scan", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.539 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "facts_cache_timeout": { 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "facts_cache_timeout", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.540 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache host facts data", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "grafana_dashboards_path": { 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "grafana_dashboards_path", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.541 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "host_check_interval": { 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "host_check_interval", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.542 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to perform a host check", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "hw_monitoring": { 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hw_monitoring", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.543 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "inventory_list_all": { 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "inventory_list_all", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.544 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.545 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.546 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "log_refresh_metadata": { 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_refresh_metadata", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.547 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.549 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.550 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.551 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "*", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.552 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "max_count_per_host": { 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_count_per_host", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.553 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of daemons per service per host", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "max_osd_draining_count": { 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_osd_draining_count", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.554 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "migration_current": { 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "migration_current", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "internal - do not modify", 2024-04-25T02:19:56.555 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "root", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm-package", 2024-04-25T02:19:56.556 INFO:teuthology.orchestra.run.smithi137.stdout: "root" 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "oob_default_addr": { 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "oob_default_addr", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "169.254.1.1", 2024-04-25T02:19:56.557 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "prometheus_alerts_path": { 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus_alerts_path", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.558 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_insecure": { 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_insecure", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.559 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_password": { 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_password", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.560 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_url": { 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_url", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.561 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_username": { 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_username", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.562 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "secure_monitoring_stack": { 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "secure_monitoring_stack", 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.563 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.564 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "service_discovery_port": { 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "service_discovery_port", 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.565 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8765", 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "cephadm service discovery port", 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.566 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "ssh_config_file": { 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssh_config_file", 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.567 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.568 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "use_agent": { 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_agent", 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.569 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.570 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "use_repo_digest": { 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_repo_digest", 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.571 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.572 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_failed_host_check": { 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_failed_host_check", 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.573 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_daemons": { 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_daemons", 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.575 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.576 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_hosts": { 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_hosts", 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.577 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.578 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crash", 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.579 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.580 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.581 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.582 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.583 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "retain_interval": { 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retain_interval", 2024-04-25T02:19:56.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "31536000", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_recent_interval": { 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_recent_interval", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.585 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1209600", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.586 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dashboard", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.587 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.588 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_ENABLED": { 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.590 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.591 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.592 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.593 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.594 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.595 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T02:19:56.596 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.597 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.598 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.598 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.598 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.598 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.599 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.600 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.601 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.602 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.602 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.602 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.602 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.602 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.603 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.604 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.605 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.606 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.606 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.606 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.606 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.606 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T02:19:56.607 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.608 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.609 INFO:teuthology.orchestra.run.smithi137.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T02:19:56.610 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T02:19:56.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.610 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.610 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.610 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.612 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.614 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.614 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.614 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.614 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.615 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_URL": { 2024-04-25T02:19:56.616 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_URL", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.618 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.619 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.620 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.621 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.622 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.623 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.624 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.625 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.626 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.627 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.628 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.629 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.630 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.631 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.632 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.633 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.634 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.635 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "45", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.636 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.637 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.638 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.641 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T02:19:56.642 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "cross_origin_url": { 2024-04-25T02:19:56.643 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cross_origin_url", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "crt_file": { 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crt_file", 2024-04-25T02:19:56.644 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "debug": { 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "debug", 2024-04-25T02:19:56.645 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable/disable debug options", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "jwt_token_ttl": { 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "jwt_token_ttl", 2024-04-25T02:19:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "28800", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:56.647 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.648 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.650 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.651 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.652 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "motd": { 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "motd", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "The message of the day", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect_resolve_ip_addr": { 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.654 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.655 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.656 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8080", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.657 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl_server_port": { 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl_server_port", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.658 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8443", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.659 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "redirect", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect" 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:56.660 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "url_prefix": { 2024-04-25T02:19:56.661 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url_prefix", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "devicehealth", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_monitoring": { 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_monitoring", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.663 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "monitor device health metrics", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.664 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.665 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.666 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.667 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.668 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "mark_out_threshold": { 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mark_out_threshold", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2419200", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_name": { 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_name", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "device_health_metrics", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.670 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "retention_period": { 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retention_period", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15552000", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain device health metrics", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_frequency": { 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_frequency", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.672 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "self_heal": { 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "self_heal", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.673 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.674 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_threshold": { 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_threshold", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7257600", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "diskprediction_local", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.676 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.677 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.678 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.679 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.680 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "predict_interval": { 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predict_interval", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.681 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "predictor_model": { 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predictor_model", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "prophetstor", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.682 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "influx", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": false, 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "influxdb python module not found", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "batch_size": { 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "batch_size", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5000", 2024-04-25T02:19:56.684 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "database": { 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "database", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "ceph", 2024-04-25T02:19:56.685 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": { 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hostname", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.686 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server hostname", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "30", 2024-04-25T02:19:56.687 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "5", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.688 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.691 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.692 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "password": { 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "password", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.693 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "password of InfluxDB server user", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "port": { 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "port", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8086", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.694 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server port", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "false", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.695 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "threads": { 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threads", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "32", 2024-04-25T02:19:56.696 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "username": { 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "username", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.697 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "username of InfluxDB server user", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "verify_ssl": { 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "verify_ssl", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "true", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "insights", 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.699 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.700 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.701 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.702 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.703 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.704 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "iostat", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.705 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.706 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.707 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.708 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.709 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "k8sevents", 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_event_retention_days": { 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ceph_event_retention_days", 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.710 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "config_check_secs": { 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_check_secs", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.711 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "10", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.713 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.714 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.715 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.716 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "localpool", 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.717 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "failure_domain": { 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "failure_domain", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "host", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "failure domain for any created local pool", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T02:19:56.718 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.719 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.720 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.721 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.723 INFO:teuthology.orchestra.run.smithi137.stdout: "min_size": { 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_size", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default min_size for any created local pool", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "num_rep": { 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "num_rep", 2024-04-25T02:19:56.724 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default replica count for any created local pool", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_num": { 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_num", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.725 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "128", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "prefix": { 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prefix", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.726 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name prefix for any created local pool", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "subtree": { 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "subtree", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "rack", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mds_autoscaler", 2024-04-25T02:19:56.728 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.729 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.730 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.731 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.732 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirroring", 2024-04-25T02:19:56.733 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.734 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.735 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.736 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.737 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "nfs", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "fail_fs": { 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "fail_fs", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.744 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.745 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.746 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.747 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.748 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.749 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator": { 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm", 2024-04-25T02:19:56.750 INFO:teuthology.orchestra.run.smithi137.stdout: "rook", 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "test_orchestrator" 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Orchestrator backend", 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_perf_query", 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.751 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.752 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.753 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.754 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.755 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_support", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.757 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.758 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.759 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.760 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.761 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_autoscaler", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.762 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.763 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.764 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.765 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.766 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "threshold": { 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threshold", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.767 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1.0", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "scaling threshold", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "progress", 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.768 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_pg_recovery_event": { 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_pg_recovery_event", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.770 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.771 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.772 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.773 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.774 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "max_completed_events": { 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_completed_events", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.775 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "50", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "number of past completed events to remember", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.776 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long the module is going to sleep", 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus", 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "cache": { 2024-04-25T02:19:56.777 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cache", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "exclude_perf_counters": { 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "exclude_perf_counters", 2024-04-25T02:19:56.778 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.779 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.780 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.781 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.782 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.783 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools": { 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "300", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.785 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_interval": { 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_interval", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15.0", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.786 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.787 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "9283", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.788 INFO:teuthology.orchestra.run.smithi137.stdout: "stale_cache_strategy": { 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stale_cache_strategy", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "log", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.789 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "default", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "default", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "error" 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.790 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.791 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_support", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.792 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.793 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.794 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.795 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.796 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_snap_create": { 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_snap_create", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.797 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "mirror_snapshot_schedule": { 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.798 INFO:teuthology.orchestra.run.smithi137.stdout: "trash_purge_schedule": { 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "trash_purge_schedule", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.799 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "restful", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_auth": { 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_auth", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.800 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.801 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.802 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.803 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.804 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.805 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.806 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.807 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.808 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rgw", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.809 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.810 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.811 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.812 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.813 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rook", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.814 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.815 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.816 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.817 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.818 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "storage_class": { 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "storage_class", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "local", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.819 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "selftest", 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.820 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.821 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.822 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.823 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.824 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "roption1": { 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption1", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.825 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "roption2": { 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption2", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "xyz", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.826 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption1": { 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption1", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.827 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption2": { 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption2", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.828 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption3": { 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption3", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.829 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption4": { 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption4", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.830 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption5": { 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption5", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.831 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption6": { 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption6", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption7": { 2024-04-25T02:19:56.832 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption7", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "42", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "testkey": { 2024-04-25T02:19:56.833 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testkey", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "testlkey": { 2024-04-25T02:19:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testlkey", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "testnewline": { 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testnewline", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.835 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snap_schedule", 2024-04-25T02:19:56.836 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_m_granularity": { 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_m_granularity", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.837 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "dump_on_update": { 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dump_on_update", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "dump database to debug log on update", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.838 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.839 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.840 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.841 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.842 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stats", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.843 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.844 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.845 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.846 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.847 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "status", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.848 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.849 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.850 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.851 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.852 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telegraf", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "address": { 2024-04-25T02:19:56.853 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "address", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.854 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.855 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.856 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.857 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.858 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.859 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.860 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telemetry", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_basic": { 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_basic", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.861 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_crash": { 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_crash", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.862 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_device": { 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_device", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.863 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_ident": { 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_ident", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_perf": { 2024-04-25T02:19:56.864 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_perf", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "contact": { 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "contact", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.865 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "description": { 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "description", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.866 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "device_url": { 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_url", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.867 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.868 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "24", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "8", 2024-04-25T02:19:56.869 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "last_opt_revision": { 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "last_opt_revision", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.870 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard": { 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.871 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard_description": { 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard_description", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.872 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.873 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.874 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.875 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.876 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "organization": { 2024-04-25T02:19:56.877 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "organization", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "proxy": { 2024-04-25T02:19:56.878 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "proxy", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "url": { 2024-04-25T02:19:56.879 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.880 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "test_orchestrator", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.881 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.882 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.883 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.884 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.885 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "volumes", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.886 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.887 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.888 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.889 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.890 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_clones": { 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_clones", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.891 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "periodic_async_work": { 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "periodic_async_work", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.892 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Periodically check for async work", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_delay": { 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_delay", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.893 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_no_wait": { 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.894 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix", 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "discovery_interval": { 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "discovery_interval", 2024-04-25T02:19:56.895 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "100", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "identifier": { 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "identifier", 2024-04-25T02:19:56.896 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.897 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.898 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.899 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.900 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.901 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.902 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.903 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.904 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_host": { 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_host", 2024-04-25T02:19:56.905 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_port": { 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_port", 2024-04-25T02:19:56.906 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10051", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_sender": { 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_sender", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.907 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.908 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "gid": 25252, 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "z", 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_features": 4540701547738038271, 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "available_modules": [ 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "alerts", 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.909 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.910 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.911 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.912 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.913 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.914 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_destination": { 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_destination", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.915 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email address to send alerts to", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_from_name": { 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_from_name", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.916 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "Ceph", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email From: name", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_host": { 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_host", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.917 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP server", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_password": { 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_password", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Password to authenticate with", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_port": { 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_port", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.919 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "465", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP port", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_sender": { 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_sender", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.920 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP envelope sender", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_ssl": { 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_ssl", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.921 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_user": { 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_user", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.922 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "User to authenticate as", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "balancer", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.923 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "active": { 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "active", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.924 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_time": { 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_time", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0000", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.925 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_weekday": { 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_weekday", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_max_iterations": { 2024-04-25T02:19:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_max_iterations", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "25", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "250", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_metrics": { 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_metrics", 2024-04-25T02:19:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_step": { 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_step", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.5", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0.001", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "0.999", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "aggressiveness of optimization", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "end_time": { 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_time", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2359", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "end_weekday": { 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_weekday", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.931 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.932 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.933 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.934 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.935 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "min_score": { 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_score", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.936 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "upmap", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "crush-compat", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "none", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "read", 2024-04-25T02:19:56.937 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap-read" 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Balancer mode", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_ids": { 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_ids", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.938 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.939 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_deviation": { 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_deviation", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.940 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_optimizations": { 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_optimizations", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.941 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_down_multiplier": { 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_down_multiplier", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.942 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_refresh_rate": { 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_refresh_rate", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.943 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "20", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_starting_port": { 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_starting_port", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4721", 2024-04-25T02:19:56.944 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_ptrace": { 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_ptrace", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.945 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_interval": { 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_interval", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.946 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_memory_target_ratio": { 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.7", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.947 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm_log_destination": { 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm_log_destination", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.948 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "file", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "file,syslog", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "syslog" 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "cgroups_split": { 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cgroups_split", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.949 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "config_checks_enabled": { 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_checks_enabled", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.950 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "config_dashboard": { 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_dashboard", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.951 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_alertmanager": { 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_alertmanager", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.952 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_base": { 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_base", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.953 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Container image name, without the tag", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_elasticsearch": { 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_elasticsearch", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.954 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "elasticsearch container image", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_grafana": { 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_grafana", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.955 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_haproxy": { 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_haproxy", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T02:19:56.956 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "HAproxy container image", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_agent": { 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_agent", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T02:19:56.957 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger agent container image", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_collector": { 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_collector", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.958 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.959 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.959 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger collector container image", 2024-04-25T02:19:56.959 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.959 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_query": { 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_query", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.961 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger query container image", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_keepalived": { 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_keepalived", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.962 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Keepalived container image", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_loki": { 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_loki", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.963 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Loki container image", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_node_exporter": { 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_node_exporter", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.964 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_nvmeof": { 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_nvmeof", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Nvme-of container image", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.965 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_prometheus": { 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_prometheus", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.966 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_promtail": { 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_promtail", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Promtail container image", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.967 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_samba": { 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_samba", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Samba/SMB container image", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_snmp_gateway": { 2024-04-25T02:19:56.968 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_snmp_gateway", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SNMP Gateway container image", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "container_init": { 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_init", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.969 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "daemon_cache_timeout": { 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "daemon_cache_timeout", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.970 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "default_cephadm_command_timeout": { 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.971 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "900", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "default_registry": { 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_registry", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.972 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "device_cache_timeout": { 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_cache_timeout", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.973 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1800", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache device inventory", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "device_enhanced_scan": { 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_enhanced_scan", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.974 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "facts_cache_timeout": { 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "facts_cache_timeout", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.975 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache host facts data", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "grafana_dashboards_path": { 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "grafana_dashboards_path", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.976 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "host_check_interval": { 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "host_check_interval", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to perform a host check", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.977 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "hw_monitoring": { 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hw_monitoring", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.978 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "inventory_list_all": { 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "inventory_list_all", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:56.979 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.980 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "log_refresh_metadata": { 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_refresh_metadata", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.981 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.982 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:56.983 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.984 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.985 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "*", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.986 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max_count_per_host": { 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_count_per_host", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.987 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of daemons per service per host", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "max_osd_draining_count": { 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_osd_draining_count", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T02:19:56.988 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "migration_current": { 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "migration_current", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "internal - do not modify", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.989 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "root", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm-package", 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "root" 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:56.990 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "oob_default_addr": { 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "oob_default_addr", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "169.254.1.1", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T02:19:56.991 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "prometheus_alerts_path": { 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus_alerts_path", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.992 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_insecure": { 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_insecure", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.993 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_password": { 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_password", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.994 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_url": { 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_url", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.995 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_username": { 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_username", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.996 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "secure_monitoring_stack": { 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "secure_monitoring_stack", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.997 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "service_discovery_port": { 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "service_discovery_port", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8765", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "cephadm service discovery port", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.998 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "ssh_config_file": { 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssh_config_file", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:56.999 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "use_agent": { 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_agent", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.000 INFO:teuthology.orchestra.run.smithi137.stdout: "use_repo_digest": { 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_repo_digest", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_failed_host_check": { 2024-04-25T02:19:57.001 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_failed_host_check", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_daemons": { 2024-04-25T02:19:57.002 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_daemons", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_hosts": { 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_hosts", 2024-04-25T02:19:57.003 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.004 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crash", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.005 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.006 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.007 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.008 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.009 INFO:teuthology.orchestra.run.smithi137.stdout: "retain_interval": { 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retain_interval", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "31536000", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.010 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_recent_interval": { 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_recent_interval", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1209600", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dashboard", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.012 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.013 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.014 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_ENABLED": { 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.015 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.016 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.017 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.018 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.019 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.023 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.024 INFO:teuthology.orchestra.run.smithi137.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T02:19:57.025 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.026 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_URL": { 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_URL", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.027 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.028 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.029 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.030 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.031 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.032 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.033 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.034 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.035 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.036 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.037 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.038 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.039 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T02:19:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T02:19:57.041 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T02:19:57.042 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T02:19:57.043 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.044 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.045 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "45", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.046 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.047 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.048 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.049 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.050 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.051 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.052 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "cross_origin_url": { 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cross_origin_url", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.053 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "crt_file": { 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crt_file", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.054 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "debug": { 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "debug", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.055 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable/disable debug options", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "jwt_token_ttl": { 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "jwt_token_ttl", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "28800", 2024-04-25T02:19:57.056 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.057 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.058 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.059 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.060 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.061 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.062 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "motd": { 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "motd", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.063 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "The message of the day", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect_resolve_ip_addr": { 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.064 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.065 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8080", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.067 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl_server_port": { 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl_server_port", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8443", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.068 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "redirect", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect" 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.069 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.070 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "url_prefix": { 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url_prefix", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.071 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "devicehealth", 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_monitoring": { 2024-04-25T02:19:57.072 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_monitoring", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "monitor device health metrics", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.073 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.074 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.075 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.077 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "mark_out_threshold": { 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mark_out_threshold", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2419200", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.078 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_name": { 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_name", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "device_health_metrics", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.079 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "retention_period": { 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retention_period", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15552000", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.080 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain device health metrics", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_frequency": { 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_frequency", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T02:19:57.081 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "self_heal": { 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "self_heal", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T02:19:57.082 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.083 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_threshold": { 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_threshold", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7257600", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.084 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "diskprediction_local", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.085 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.086 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.087 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.088 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.089 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "predict_interval": { 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predict_interval", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.090 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "predictor_model": { 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predictor_model", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "prophetstor", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.091 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.092 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "influx", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": false, 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "influxdb python module not found", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "batch_size": { 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "batch_size", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.093 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5000", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "database": { 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "database", 2024-04-25T02:19:57.094 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "ceph", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": { 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hostname", 2024-04-25T02:19:57.095 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server hostname", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.096 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "30", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "5", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.097 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.098 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.099 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.100 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.101 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "password": { 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "password", 2024-04-25T02:19:57.102 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "password of InfluxDB server user", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "port": { 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "port", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.103 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8086", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server port", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.104 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "false", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "threads": { 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threads", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.105 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "32", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "username": { 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "username", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.106 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "username of InfluxDB server user", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "verify_ssl": { 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "verify_ssl", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.107 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "true", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "insights", 2024-04-25T02:19:57.108 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.109 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.110 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.111 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.112 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.113 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "iostat", 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.114 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.115 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.116 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.118 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "k8sevents", 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.119 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_event_retention_days": { 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ceph_event_retention_days", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.120 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "config_check_secs": { 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_check_secs", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "10", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.121 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.122 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.125 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.126 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.127 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.128 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "localpool", 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.129 INFO:teuthology.orchestra.run.smithi137.stdout: "failure_domain": { 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "failure_domain", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "host", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "failure domain for any created local pool", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.130 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.131 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.132 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.133 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.134 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "min_size": { 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_size", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.135 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default min_size for any created local pool", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "num_rep": { 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "num_rep", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.136 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default replica count for any created local pool", 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_num": { 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_num", 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.137 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "128", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "prefix": { 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prefix", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.138 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name prefix for any created local pool", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "subtree": { 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "subtree", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.139 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "rack", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mds_autoscaler", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.142 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.143 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.144 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.145 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirroring", 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.146 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.147 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.148 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.149 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.150 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "nfs", 2024-04-25T02:19:57.151 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.152 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.153 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.154 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.155 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.156 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "fail_fs": { 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "fail_fs", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.157 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.158 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.159 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.160 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.161 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator": { 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:57.162 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "rook", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "test_orchestrator" 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Orchestrator backend", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.163 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_perf_query", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.164 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.165 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.166 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.167 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.168 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_support", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.169 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.170 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.171 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.172 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.173 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_autoscaler", 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.174 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.175 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.176 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.177 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.178 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.179 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "threshold": { 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threshold", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.180 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1.0", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "scaling threshold", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "progress", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.181 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_pg_recovery_event": { 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_pg_recovery_event", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.182 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.183 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.184 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.185 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.186 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.187 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.188 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "max_completed_events": { 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_completed_events", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "50", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "number of past completed events to remember", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.189 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long the module is going to sleep", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.190 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus", 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "cache": { 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cache", 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.191 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "exclude_perf_counters": { 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "exclude_perf_counters", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.192 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.193 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.194 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.195 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.196 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.197 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools": { 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.198 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "300", 2024-04-25T02:19:57.199 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_interval": { 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_interval", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15.0", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.200 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:57.201 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "9283", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.202 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "stale_cache_strategy": { 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stale_cache_strategy", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "log", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.203 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "default", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.204 INFO:teuthology.orchestra.run.smithi137.stdout: "default", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "error" 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:57.205 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_support", 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.206 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.207 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.208 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.209 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.210 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_snap_create": { 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_snap_create", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.211 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "mirror_snapshot_schedule": { 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.212 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "trash_purge_schedule": { 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "trash_purge_schedule", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.213 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "restful", 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_auth": { 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_auth", 2024-04-25T02:19:57.214 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.216 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.217 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.218 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.219 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.220 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.221 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.222 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rgw", 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.223 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.224 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.225 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.226 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.227 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.228 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rook", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.229 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.230 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.231 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.232 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.233 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "storage_class": { 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "storage_class", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "local", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.234 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "selftest", 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.235 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.236 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.238 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.239 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "roption1": { 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption1", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.240 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "roption2": { 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption2", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "xyz", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.241 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption1": { 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption1", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.242 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption2": { 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption2", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.243 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption3": { 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption3", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.244 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption4": { 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption4", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.245 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption5": { 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption5", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.246 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption6": { 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption6", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.247 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption7": { 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption7", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "42", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.248 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "testkey": { 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testkey", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.249 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "testlkey": { 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testlkey", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "testnewline": { 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testnewline", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snap_schedule", 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_m_granularity": { 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_m_granularity", 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "dump_on_update": { 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dump_on_update", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.253 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "dump database to debug log on update", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.254 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.255 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.256 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.257 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.258 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stats", 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.259 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.261 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.262 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.263 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.264 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "status", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.265 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.266 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.267 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.268 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.269 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telegraf", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "address": { 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "address", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.270 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.271 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.272 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.273 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.274 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.275 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.276 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telemetry", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.277 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_basic": { 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_basic", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.278 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_crash": { 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_crash", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_device": { 2024-04-25T02:19:57.279 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_device", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_ident": { 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_ident", 2024-04-25T02:19:57.280 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_perf": { 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_perf", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.281 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "contact": { 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "contact", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.282 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "description": { 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "description", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.283 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "device_url": { 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_url", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T02:19:57.284 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.285 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "24", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "8", 2024-04-25T02:19:57.286 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "last_opt_revision": { 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "last_opt_revision", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.287 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard": { 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.288 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard_description": { 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard_description", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.289 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.290 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.291 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.292 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.293 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.294 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "organization": { 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "organization", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.295 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "proxy": { 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "proxy", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.296 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "url": { 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.297 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "test_orchestrator", 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.298 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.299 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.300 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.301 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.302 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "volumes", 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.305 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.306 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.307 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.308 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_clones": { 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_clones", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.309 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "periodic_async_work": { 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "periodic_async_work", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Periodically check for async work", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.310 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_delay": { 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_delay", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.311 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_no_wait": { 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.312 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "discovery_interval": { 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "discovery_interval", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "100", 2024-04-25T02:19:57.313 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "identifier": { 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "identifier", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.314 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.315 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.316 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.317 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.318 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.319 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.320 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_host": { 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_host", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.321 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_port": { 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_port", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10051", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.322 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_sender": { 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_sender", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.323 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "modules": [ 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "dashboard", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "iostat", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "nfs", 2024-04-25T02:19:57.324 INFO:teuthology.orchestra.run.smithi137.stdout: "restful", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "snap_schedule" 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "available_modules": [ 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "alerts", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.325 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.326 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.327 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.329 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.330 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.331 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_destination": { 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_destination", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.332 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email address to send alerts to", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_from_name": { 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_from_name", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "Ceph", 2024-04-25T02:19:57.333 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Email From: name", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_host": { 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_host", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.334 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP server", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_password": { 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_password", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.335 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Password to authenticate with", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_port": { 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_port", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "465", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.336 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP port", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_sender": { 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_sender", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SMTP envelope sender", 2024-04-25T02:19:57.337 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_ssl": { 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_ssl", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T02:19:57.338 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "smtp_user": { 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "smtp_user", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "User to authenticate as", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.339 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "balancer", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "active": { 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "active", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.340 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_time": { 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_time", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0000", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "begin_weekday": { 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "begin_weekday", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:57.342 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_max_iterations": { 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_max_iterations", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "25", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "250", 2024-04-25T02:19:57.343 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_metrics": { 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_metrics", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.344 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_compat_step": { 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crush_compat_step", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.5", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0.001", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "0.999", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "aggressiveness of optimization", 2024-04-25T02:19:57.345 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "end_time": { 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_time", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2359", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T02:19:57.346 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "end_weekday": { 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "end_weekday", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "0", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "6", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.347 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.348 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.349 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.350 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.351 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.352 INFO:teuthology.orchestra.run.smithi137.stdout: "min_score": { 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_score", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:57.353 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "upmap", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "crush-compat", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "none", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "read", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap", 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap-read" 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.354 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Balancer mode", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_ids": { 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_ids", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T02:19:57.355 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T02:19:57.356 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_deviation": { 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_deviation", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.357 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "upmap_max_optimizations": { 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "upmap_max_optimizations", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.358 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm", 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_down_multiplier": { 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_down_multiplier", 2024-04-25T02:19:57.359 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_refresh_rate": { 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_refresh_rate", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.360 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "20", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "agent_starting_port": { 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "agent_starting_port", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.361 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4721", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_ptrace": { 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_ptrace", 2024-04-25T02:19:57.362 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_interval": { 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_interval", 2024-04-25T02:19:57.363 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "autotune_memory_target_ratio": { 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T02:19:57.364 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0.7", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm_log_destination": { 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cephadm_log_destination", 2024-04-25T02:19:57.365 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "file", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "file,syslog", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "syslog" 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.366 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "cgroups_split": { 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cgroups_split", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.367 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "config_checks_enabled": { 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_checks_enabled", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.368 INFO:teuthology.orchestra.run.smithi137.stdout: "config_dashboard": { 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_dashboard", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.369 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_alertmanager": { 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_alertmanager", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.370 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_base": { 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_base", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Container image name, without the tag", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.371 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_elasticsearch": { 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_elasticsearch", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "elasticsearch container image", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.372 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_grafana": { 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_grafana", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_haproxy": { 2024-04-25T02:19:57.373 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_haproxy", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "HAproxy container image", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.374 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_agent": { 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_agent", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger agent container image", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.375 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_collector": { 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_collector", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger collector container image", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.376 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_jaeger_query": { 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_jaeger_query", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Jaeger query container image", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_keepalived": { 2024-04-25T02:19:57.377 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_keepalived", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Keepalived container image", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_loki": { 2024-04-25T02:19:57.378 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_loki", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Loki container image", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_node_exporter": { 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_node_exporter", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.379 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_nvmeof": { 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_nvmeof", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.380 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Nvme-of container image", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_prometheus": { 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_prometheus", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.381 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Prometheus container image", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_promtail": { 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_promtail", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.382 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Promtail container image", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_samba": { 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_samba", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.383 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Samba/SMB container image", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image_snmp_gateway": { 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_image_snmp_gateway", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.384 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "SNMP Gateway container image", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "container_init": { 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "container_init", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.385 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "daemon_cache_timeout": { 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "daemon_cache_timeout", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.386 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "default_cephadm_command_timeout": { 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.387 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "900", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "default_registry": { 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "default_registry", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "docker.io", 2024-04-25T02:19:57.388 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "device_cache_timeout": { 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_cache_timeout", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1800", 2024-04-25T02:19:57.389 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache device inventory", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "device_enhanced_scan": { 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_enhanced_scan", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.390 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "facts_cache_timeout": { 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "facts_cache_timeout", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.391 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "seconds to cache host facts data", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "grafana_dashboards_path": { 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "grafana_dashboards_path", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T02:19:57.392 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "host_check_interval": { 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "host_check_interval", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.393 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to perform a host check", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "hw_monitoring": { 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hw_monitoring", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.394 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "inventory_list_all": { 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "inventory_list_all", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.395 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "log_refresh_metadata": { 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_refresh_metadata", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.397 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.398 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.400 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.401 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T02:19:57.402 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "*", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.403 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "max_count_per_host": { 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_count_per_host", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of daemons per service per host", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "max_osd_draining_count": { 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_osd_draining_count", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.405 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "migration_current": { 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "migration_current", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "internal - do not modify", 2024-04-25T02:19:57.406 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": { 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mode", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "root", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm-package", 2024-04-25T02:19:57.407 INFO:teuthology.orchestra.run.smithi137.stdout: "root" 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "oob_default_addr": { 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "oob_default_addr", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "169.254.1.1", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.408 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "prometheus_alerts_path": { 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus_alerts_path", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.409 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_insecure": { 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_insecure", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.410 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_password": { 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_password", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.411 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_url": { 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_url", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.412 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "registry_username": { 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "registry_username", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T02:19:57.413 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "secure_monitoring_stack": { 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "secure_monitoring_stack", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.414 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "service_discovery_port": { 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "service_discovery_port", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8765", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.415 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "cephadm service discovery port", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "ssh_config_file": { 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssh_config_file", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.416 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "use_agent": { 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_agent", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.417 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "use_repo_digest": { 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "use_repo_digest", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.418 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_failed_host_check": { 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_failed_host_check", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.419 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_daemons": { 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_daemons", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.420 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_on_stray_hosts": { 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_on_stray_hosts", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.421 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crash", 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.422 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.423 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.424 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.425 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.426 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "retain_interval": { 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retain_interval", 2024-04-25T02:19:57.427 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "31536000", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_recent_interval": { 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_recent_interval", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.428 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1209600", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.429 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dashboard", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.430 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.431 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.432 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_ENABLED": { 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.433 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.434 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.435 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.436 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.437 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.438 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.439 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.440 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.441 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.442 INFO:teuthology.orchestra.run.smithi137.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T02:19:57.443 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T02:19:57.444 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_URL": { 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_URL", 2024-04-25T02:19:57.445 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T02:19:57.446 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T02:19:57.447 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T02:19:57.448 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T02:19:57.449 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T02:19:57.450 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T02:19:57.451 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.452 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.453 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.454 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.455 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.456 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.457 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.458 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.459 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.460 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T02:19:57.461 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.462 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8", 2024-04-25T02:19:57.463 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "45", 2024-04-25T02:19:57.464 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.465 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "admin", 2024-04-25T02:19:57.466 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.467 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.468 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.469 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.470 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.471 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "cross_origin_url": { 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cross_origin_url", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.472 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "crt_file": { 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "crt_file", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.473 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "debug": { 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "debug", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.474 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Enable/disable debug options", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "jwt_token_ttl": { 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "jwt_token_ttl", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "28800", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.475 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.476 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.477 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.478 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.480 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.481 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "motd": { 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "motd", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.482 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "The message of the day", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect_resolve_ip_addr": { 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.483 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.484 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8080", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.485 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.486 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl_server_port": { 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl_server_port", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8443", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.487 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "redirect", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.488 INFO:teuthology.orchestra.run.smithi137.stdout: "redirect" 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:57.489 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "url_prefix": { 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url_prefix", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.490 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "devicehealth", 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_monitoring": { 2024-04-25T02:19:57.491 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_monitoring", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "monitor device health metrics", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.492 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.493 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.494 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.495 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.496 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.497 INFO:teuthology.orchestra.run.smithi137.stdout: "mark_out_threshold": { 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mark_out_threshold", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "2419200", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.498 INFO:teuthology.orchestra.run.smithi137.stdout: "pool_name": { 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pool_name", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "device_health_metrics", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.499 INFO:teuthology.orchestra.run.smithi137.stdout: "retention_period": { 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "retention_period", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15552000", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long to retain device health metrics", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_frequency": { 2024-04-25T02:19:57.500 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_frequency", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "self_heal": { 2024-04-25T02:19:57.501 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "self_heal", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.502 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "warn_threshold": { 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "warn_threshold", 2024-04-25T02:19:57.503 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7257600", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.504 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "diskprediction_local", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.505 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.506 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.507 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.508 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.509 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "predict_interval": { 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predict_interval", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "86400", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.510 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "predictor_model": { 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "predictor_model", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "prophetstor", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.511 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "600", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.512 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "influx", 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": false, 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "influxdb python module not found", 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "batch_size": { 2024-04-25T02:19:57.513 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "batch_size", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5000", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "database": { 2024-04-25T02:19:57.514 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "database", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "ceph", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.515 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": { 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "hostname", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server hostname", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "30", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "5", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.518 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.519 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.520 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "password": { 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "password", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "password of InfluxDB server user", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "port": { 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "port", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "8086", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "InfluxDB server port", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "ssl": { 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ssl", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "false", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.525 INFO:teuthology.orchestra.run.smithi137.stdout: "threads": { 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threads", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "32", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "username": { 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "username", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "username of InfluxDB server user", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.527 INFO:teuthology.orchestra.run.smithi137.stdout: "verify_ssl": { 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "verify_ssl", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "true", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.528 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "insights", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.529 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.530 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.531 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.532 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.533 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "iostat", 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.534 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.535 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.536 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.537 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.538 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "k8sevents", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.539 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_event_retention_days": { 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "ceph_event_retention_days", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "7", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.540 INFO:teuthology.orchestra.run.smithi137.stdout: "config_check_secs": { 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "config_check_secs", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "10", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.541 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.542 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.543 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.544 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.545 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.546 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "localpool", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "failure_domain": { 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "failure_domain", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "host", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.547 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "failure domain for any created local pool", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.548 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.549 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.550 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.551 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.552 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "min_size": { 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "min_size", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.553 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default min_size for any created local pool", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "num_rep": { 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "num_rep", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.554 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default replica count for any created local pool", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_num": { 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_num", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "128", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.555 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "prefix": { 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prefix", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.556 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "name prefix for any created local pool", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "subtree": { 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "subtree", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "rack", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T02:19:57.557 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mds_autoscaler", 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.558 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.559 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.560 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.561 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.562 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirroring", 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.563 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.564 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.565 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.566 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.567 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.568 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "nfs", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.569 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.570 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.571 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.572 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.573 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "fail_fs": { 2024-04-25T02:19:57.574 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "fail_fs", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.575 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.576 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.577 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.578 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.579 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.580 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator": { 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "orchestrator", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "rook", 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "test_orchestrator" 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.581 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Orchestrator backend", 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_perf_query", 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.582 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.583 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.584 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.585 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.586 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "osd_support", 2024-04-25T02:19:57.587 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.588 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.589 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.590 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.591 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.592 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "pg_autoscaler", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.593 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.594 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.595 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.596 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.597 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.598 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "threshold": { 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "threshold", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "3.0", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1.0", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.599 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "scaling threshold", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "progress", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_pg_recovery_event": { 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_pg_recovery_event", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.600 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.601 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.602 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.603 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.604 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.605 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.606 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "max_completed_events": { 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_completed_events", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "50", 2024-04-25T02:19:57.607 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "number of past completed events to remember", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "sleep_interval": { 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "sleep_interval", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "5", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.608 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "how long the module is going to sleep", 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "prometheus", 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "cache": { 2024-04-25T02:19:57.609 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "cache", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.610 INFO:teuthology.orchestra.run.smithi137.stdout: "exclude_perf_counters": { 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "exclude_perf_counters", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.611 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.612 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.613 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.614 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.615 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools": { 2024-04-25T02:19:57.616 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T02:19:57.617 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "300", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "scrape_interval": { 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "scrape_interval", 2024-04-25T02:19:57.618 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15.0", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.619 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "::", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.620 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "9283", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "stale_cache_strategy": { 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stale_cache_strategy", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.621 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "log", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_behaviour": { 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_behaviour", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.622 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "default", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "default", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "error" 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "standby_error_status_code": { 2024-04-25T02:19:57.623 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "standby_error_status_code", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "500", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "400", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "599", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.624 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_support", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.625 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.626 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.627 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.628 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.629 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_snap_create": { 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_snap_create", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.630 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "mirror_snapshot_schedule": { 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.631 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "trash_purge_schedule": { 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "trash_purge_schedule", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.632 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "restful", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_auth": { 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enable_auth", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.633 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "key_file": { 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "key_file", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.634 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.635 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.636 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.637 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.638 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "server_addr": { 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_addr", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.640 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "server_port": { 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "server_port", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.641 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rgw", 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.642 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.643 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.644 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.645 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.646 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.647 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rook", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.648 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.649 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.650 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.651 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.652 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "storage_class": { 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "storage_class", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "local", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.653 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "selftest", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.654 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.655 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.656 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.657 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.658 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "roption1": { 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption1", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.659 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "roption2": { 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "roption2", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "xyz", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.660 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption1": { 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption1", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.661 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption2": { 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption2", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.662 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption3": { 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption3", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "float", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.663 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption4": { 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption4", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.664 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption5": { 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption5", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.665 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption6": { 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption6", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.666 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "rwoption7": { 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rwoption7", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "1", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "42", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.667 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "testkey": { 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testkey", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.668 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "testlkey": { 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testlkey", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.669 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "testnewline": { 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "testnewline", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.670 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snap_schedule", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "allow_m_granularity": { 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "allow_m_granularity", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.671 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "dump_on_update": { 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "dump_on_update", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.672 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "dump database to debug log on update", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.673 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.674 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.675 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.676 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.677 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "stats", 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.678 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.679 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.680 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.682 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "status", 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.683 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.684 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.685 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.686 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.687 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telegraf", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "address": { 2024-04-25T02:19:57.688 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "address", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.689 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "15", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.690 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.691 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.692 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.693 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.694 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.695 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "telemetry", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_basic": { 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_basic", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.696 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_crash": { 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_crash", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T02:19:57.697 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_device": { 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_device", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T02:19:57.698 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_ident": { 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_ident", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.699 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "channel_perf": { 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "channel_perf", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T02:19:57.700 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "contact": { 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "contact", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.701 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "description": { 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "description", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.702 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "device_url": { 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "device_url", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.703 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "enabled": { 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "enabled", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.704 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "24", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "8", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.705 INFO:teuthology.orchestra.run.smithi137.stdout: "last_opt_revision": { 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "last_opt_revision", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "1", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.706 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard": { 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "leaderboard_description": { 2024-04-25T02:19:57.707 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "leaderboard_description", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.708 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.709 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.710 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.711 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.712 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "organization": { 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "organization", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "proxy": { 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "proxy", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.714 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "url": { 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "url", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.715 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "test_orchestrator", 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.716 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.717 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.718 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.719 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.720 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "volumes", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.721 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.722 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.723 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.724 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.725 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "max_concurrent_clones": { 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "max_concurrent_clones", 2024-04-25T02:19:57.726 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "4", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "periodic_async_work": { 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "periodic_async_work", 2024-04-25T02:19:57.727 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Periodically check for async work", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_delay": { 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_delay", 2024-04-25T02:19:57.728 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "0", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "snapshot_clone_no_wait": { 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.729 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "True", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "can_run": true, 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "error_string": "", 2024-04-25T02:19:57.730 INFO:teuthology.orchestra.run.smithi137.stdout: "module_options": { 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "discovery_interval": { 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "discovery_interval", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "uint", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "100", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.731 INFO:teuthology.orchestra.run.smithi137.stdout: "identifier": { 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "identifier", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "interval": { 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "interval", 2024-04-25T02:19:57.732 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "secs", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "60", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "log_level": { 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_level", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.733 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.734 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster": { 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.735 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_cluster_level": { 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_cluster_level", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "info", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [ 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "critical", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "debug", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "error", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "info", 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "warning" 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.736 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": { 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "log_to_file", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "bool", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 1, 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "False", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.737 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_host": { 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_host", 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.738 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_port": { 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_port", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "int", 2024-04-25T02:19:57.741 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "10051", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "zabbix_sender": { 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "zabbix_sender", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "str", 2024-04-25T02:19:57.742 INFO:teuthology.orchestra.run.smithi137.stdout: "level": "advanced", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "flags": 0, 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "min": "", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "max": "", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "enum_allowed": [], 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "desc": "", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "long_desc": "", 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "tags": [], 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "see_also": [] 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "services": { 2024-04-25T02:19:57.743 INFO:teuthology.orchestra.run.smithi137.stdout: "dashboard": "https://172.21.15.137:8443/" 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "always_on_modules": { 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "octopus": [ 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "balancer", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "crash", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "devicehealth", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_autoscaler", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "progress", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_support", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "status", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "telemetry", 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "volumes" 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "pacific": [ 2024-04-25T02:19:57.744 INFO:teuthology.orchestra.run.smithi137.stdout: "balancer", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "crash", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "devicehealth", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_autoscaler", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "progress", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_support", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "status", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "telemetry", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "volumes" 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "quincy": [ 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "balancer", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "crash", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "devicehealth", 2024-04-25T02:19:57.745 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_autoscaler", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "progress", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_support", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "status", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "telemetry", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "volumes" 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "reef": [ 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "balancer", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "crash", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "devicehealth", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator", 2024-04-25T02:19:57.746 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_autoscaler", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "progress", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_support", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "status", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "telemetry", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "volumes" 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "squid": [ 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "balancer", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "crash", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "devicehealth", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "orchestrator", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "pg_autoscaler", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "progress", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_support", 2024-04-25T02:19:57.747 INFO:teuthology.orchestra.run.smithi137.stdout: "status", 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "telemetry", 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "volumes" 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "last_failure_osd_epoch": 88, 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "active_clients": [ 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "devicehealth", 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 4063008137 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.748 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "libcephsqlite", 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3561543421 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "rbd_support", 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.749 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2417577568 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snap_schedule", 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2114695129 2024-04-25T02:19:57.750 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "snap_schedule", 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1168449130 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.751 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "volumes", 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v2", 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 3315470672 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-25T02:19:57.752 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:19:57.753 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3122231722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:19:57.753 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:56 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/877135701' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T02:19:57.754 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3122231722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:19:57.754 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:56 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/877135701' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T02:19:57.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 msgr2=0x7f57fc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:57.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 0x7f57fc0a51c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5804009900 tx=0x7f58040058d0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 msgr2=0x7f581819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f580800e9f0 tx=0x7f580800eeb0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 shutdown_connections 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f57fc0a2d00 0x7f57fc0a51c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5818109930 0x7f581819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58181042e0 0x7f581819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 --2- 172.21.15.137:0/877135701 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5818103920 0x7f581819a350 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.464+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 >> 172.21.15.137:0/877135701 conn(0x7f58180ff3f0 msgr2=0x7f58180ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.465+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 shutdown_connections 2024-04-25T02:19:57.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:19:56.465+0000 7f581ce00640 1 -- 172.21.15.137:0/877135701 wait complete. 2024-04-25T02:19:57.794 DEBUG:tasks.check_counter:Getting stats from a 2024-04-25T02:19:57.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-25T02:19:57.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3122231722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:19:57.795 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:56 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/877135701' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-25T02:19:58.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:57 smithi137 ceph-mon[28303]: pgmap v318: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:58.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:57 smithi163 ceph-mon[32577]: pgmap v318: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:58.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:57 smithi174 ceph-mon[33171]: pgmap v318: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:19:58.266 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:19:59.981 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:19:59 smithi137 ceph-mon[28303]: pgmap v319: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-04-25T02:20:00.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:19:59 smithi163 ceph-mon[32577]: pgmap v319: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-04-25T02:20:00.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:19:59 smithi174 ceph-mon[33171]: pgmap v319: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-04-25T02:20:00.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:19:59.999+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-04-25T02:20:00.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:19:59.999+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-04-25T02:20:00.279 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:19:59.999+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : mds.c(mds.2): Metadata damage detected 2024-04-25T02:20:00.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:19:59.999+0000 7fc1a6200700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-04-25T02:20:00.484 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:20:00.484 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:00.484 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 0, 2024-04-25T02:20:00.484 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2, 2024-04-25T02:20:00.484 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 0, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 0, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.004513906, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.000920176, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.485 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 218, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 207, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1579888, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 127264, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:00.486 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.099139441, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.032505292, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.082768331, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.009532859, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 206, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.021221784, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000103018 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1579888, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 127264 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 160, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 3392, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 183760, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.033560331, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.023411051, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.004361444, 2024-04-25T02:20:00.488 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 158, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.029063078, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000183943 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 183760 2024-04-25T02:20:00.489 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:00.490 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:00.491 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:00.492 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 148977, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 30, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-04-25T02:20:00.493 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-25T02:20:00.494 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 220, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1549188, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 220, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 220, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1549188, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:00.495 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:00.496 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:00.496 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:20:01.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-mon[28303]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-04-25T02:20:01.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-mon[28303]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-04-25T02:20:01.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-mon[28303]: mds.c(mds.2): Metadata damage detected 2024-04-25T02:20:01.031 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:00 smithi137 ceph-mon[28303]: mds.i(mds.1): Metadata damage detected 2024-04-25T02:20:01.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:00 smithi163 ceph-mon[32577]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-04-25T02:20:01.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:00 smithi163 ceph-mon[32577]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-04-25T02:20:01.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:00 smithi163 ceph-mon[32577]: mds.c(mds.2): Metadata damage detected 2024-04-25T02:20:01.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:00 smithi163 ceph-mon[32577]: mds.i(mds.1): Metadata damage detected 2024-04-25T02:20:01.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:00 smithi174 ceph-mon[33171]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-04-25T02:20:01.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:00 smithi174 ceph-mon[33171]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-04-25T02:20:01.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:00 smithi174 ceph-mon[33171]: mds.c(mds.2): Metadata damage detected 2024-04-25T02:20:01.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:00 smithi174 ceph-mon[33171]: mds.i(mds.1): Metadata damage detected 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-04-25T02:20:01.296 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-04-25T02:20:01.296 DEBUG:tasks.check_counter:Getting stats from d 2024-04-25T02:20:01.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-25T02:20:01.714 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:20:02.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:01 smithi137 ceph-mon[28303]: pgmap v320: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-25T02:20:02.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:01 smithi163 ceph-mon[32577]: pgmap v320: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-25T02:20:02.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:01 smithi174 ceph-mon[33171]: pgmap v320: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 0, 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2, 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 0, 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 0, 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:03.819 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.003960157, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.000862613, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:03.820 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 225, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 214, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1581792, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 131744, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.107222808, 2024-04-25T02:20:03.821 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.033687181, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.094790973, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.010121756, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 213, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.021153766, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000099313 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:03.822 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1581792, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 131744 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 166, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 3392, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 184816, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.035355304, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.024994964, 2024-04-25T02:20:03.823 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.004712070, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 164, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.031563088, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000192457 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-25T02:20:03.824 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 184816 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:03.825 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:03.826 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:03.827 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 148994, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 31, 2024-04-25T02:20:03.828 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:03.829 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-25T02:20:03.830 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 227, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1550098, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 227, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 227, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1550098, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:03.831 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:03.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:03.832 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:03.832 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:20:04.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:03 smithi137 ceph-mon[28303]: pgmap v321: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T02:20:04.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:03 smithi163 ceph-mon[32577]: pgmap v321: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T02:20:04.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:03 smithi174 ceph-mon[33171]: pgmap v321: 97 pgs: 97 active+clean; 19 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-25T02:20:04.517 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-25T02:20:04.517 DEBUG:tasks.check_counter:Getting stats from g 2024-04-25T02:20:04.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-25T02:20:04.961 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:20:05.990 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:05 smithi163 ceph-mon[32577]: pgmap v322: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T02:20:05.990 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:05 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:20:06.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:05 smithi137 ceph-mon[28303]: pgmap v322: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T02:20:06.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:05 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:20:06.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:05 smithi174 ceph-mon[33171]: pgmap v322: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-25T02:20:06.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:05 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 221, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 210, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1580704, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 129184, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.100259410, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.031644121, 2024-04-25T02:20:07.016 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.078780437, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.009722920, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 209, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.020465295, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000097920 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.017 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1580704, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 129184 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 6, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 162, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 3392, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 184112, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.035758576, 2024-04-25T02:20:07.018 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.025349998, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.004796184, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 160, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.035946519, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000224665 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:07.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 184112 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 0, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 2, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 0, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 0, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.000824403, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.000627880, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:07.020 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-04-25T02:20:07.021 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:07.022 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:07.023 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 148977, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 30, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:07.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-25T02:20:07.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 223, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1549578, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 223, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 223, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1549578, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:07.026 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:07.027 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:07.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:07.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:07.027 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:06 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:06 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:06 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-04-25T02:20:07.858 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-04-25T02:20:07.859 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-04-25T02:20:07.859 DEBUG:tasks.check_counter:Getting stats from j 2024-04-25T02:20:07.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: pgmap v323: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.132 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.133 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:07 smithi137 ceph-mon[28303]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: pgmap v323: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:07 smithi163 ceph-mon[32577]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T02:20:08.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: pgmap v323: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-25T02:20:08.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:08.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:07 smithi174 ceph-mon[33171]: osdmap e97: 12 total, 12 up, 12 in 2024-04-25T02:20:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.a/config 2024-04-25T02:20:09.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:08 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:20:09.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:08 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:20:09.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:08 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:20:09.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:08 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:20:09.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:08 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:20:09.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:08 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:20:09.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:08 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:20:09.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:08 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:20:09.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:08 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi163 to 176.2M 2024-04-25T02:20:09.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:08 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi163 to 184780288: error parsing value: Value '184780288' is below minimum 939524096 2024-04-25T02:20:09.207 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:08 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi174 to 176.2M 2024-04-25T02:20:09.208 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:08 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi174 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-25T02:20:10.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:09 smithi163 ceph-mon[32577]: pgmap v325: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-25T02:20:10.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:09 smithi174 ceph-mon[33171]: pgmap v325: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-25T02:20:10.188 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:09 smithi137 ceph-mon[28303]: pgmap v325: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 227, 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 216, 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 1582336, 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 133024, 2024-04-25T02:20:10.712 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.112492385, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.033200042, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.099351718, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.010050881, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 215, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.021951668, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000102100 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:10.713 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 1582336, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 133024 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 2, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 165, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 320, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 184544, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 5, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.035070588, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.024874494, 2024-04-25T02:20:10.714 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.004842596, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 162, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.033773907, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000208480 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 184544 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.715 INFO:teuthology.orchestra.run.smithi137.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_messages": 4, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages": 4, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_bytes": 3072, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_bytes": 448, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_total_time": 0.001552153, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_send_time": 0.000057265, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_recv_time": 0.001444106, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 3, 2024-04-25T02:20:10.716 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.001472843, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000490947 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "cct": { 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "total_workers": 0, 2024-04-25T02:20:10.717 INFO:teuthology.orchestra.run.smithi137.stdout: "unhealthy_workers": 0 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool": { 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:10.718 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:10.719 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_bytes": 149745, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_anon_items": 31, 2024-04-25T02:20:10.720 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "pgmap_items": 0, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:10.721 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_co_items": 2, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_1_items": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "unittest_2_items": 0 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "val": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "max": 104857600, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "get_started": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "get": 229, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "get_sum": 1550358, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "get_or_fail_success": 229, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "take": 0, 2024-04-25T02:20:10.722 INFO:teuthology.orchestra.run.smithi137.stdout: "take_sum": 0, 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "put": 229, 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "put_sum": 1550358, 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "wait": { 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "avgcount": 0, 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "sum": 0.000000000, 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: "avgtime": 0.000000000 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-25T02:20:10.723 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-25T02:20:11.467 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-25T02:20:11.467 DEBUG:tasks.check_counter:Getting stats from b 2024-04-25T02:20:11.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-25T02:20:11.717 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:20:12.086 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:11 smithi163 ceph-mon[32577]: pgmap v326: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:12.086 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:11 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:12.087 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:11 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:12.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:11 smithi174 ceph-mon[33171]: pgmap v326: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:12.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:11 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:12.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:11 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:12.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:11 smithi137 ceph-mon[28303]: pgmap v326: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:12.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:11 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:12.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:11 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:20:13.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:20:13.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:13.140 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:12 smithi163 ceph-mon[32577]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T02:20:13.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:13.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:12 smithi174 ceph-mon[33171]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T02:20:13.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: from='mgr.15126 ' entity='mgr.x' 2024-04-25T02:20:13.281 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:12 smithi137 ceph-mon[28303]: osdmap e98: 12 total, 12 up, 12 in 2024-04-25T02:20:13.538 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-25T02:20:13.538 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:13.538 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 17661, 2024-04-25T02:20:13.538 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 23564, 2024-04-25T02:20:13.538 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 6567372, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 54417834, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 15, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 6, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 1.348966332, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.547110537, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.464174726, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.316651934, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 23560, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 5.979138702, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000253783 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:13.539 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 22514, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.002895127, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000128 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 2034320, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 244656 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 52668, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 98263, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 19006614, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 88755383, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 70, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 3.203349388, 2024-04-25T02:20:13.540 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 1.545373268, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 1.730154020, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.401909409, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 98260, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 10.982021024, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000111764 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 63093, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.015017018, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000238 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 102096, 2024-04-25T02:20:13.541 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 563600 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 18764, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 25600, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 5246254, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 45721218, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 9, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 1.433796105, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.646597917, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.429710412, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.323724095, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 25602, 2024-04-25T02:20:13.542 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 7.862421141, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000307101 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 22009, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.003095461, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000140 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 46544, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 5344 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2024-04-25T02:20:13.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5319, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 28.197576762, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.005301292 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:13.544 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 18547, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 2.630494520, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000141828 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 24249, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 24205, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 24205, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 59.972217853, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002477678 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 44, 2024-04-25T02:20:13.545 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 1902, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 13, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 2, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 8591, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 5650, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 2628, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 313, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 519, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 488, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 3, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 3, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 10, 2024-04-25T02:20:13.546 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 25250, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 24595, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 11, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 45, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 473, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 44, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 278, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 3666, 2024-04-25T02:20:13.547 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 4, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 234, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 6, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 3666, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 306, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 4, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 302, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 3360, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 88, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 2491, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 23781, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:13.548 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 15556, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 12256, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 95, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 13054 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update": 1233, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update_receipt": 33, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_try_discover": 22, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_send_discover": 22, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_handle_discover": 2496, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 329, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:13.549 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 11140, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 10811, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 4, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 45, 2024-04-25T02:20:13.550 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 15, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evlrg": 0, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 55051, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 48748, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 48748, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 6303, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 9086, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 77, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 69, 2024-04-25T02:20:13.551 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 69, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 8, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "segmjr": 1, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 11, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 110038856, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 121480352, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1768, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 66.143567866, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.037411520 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.552 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 4056, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 15356, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 11300, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 398, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 758, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 360, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 8591, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 23380, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 14789, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 3, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 11635, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 11632, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 118488, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 231804 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.553 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 29014, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 723, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 24249, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 81, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 1692, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 11000, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 23.130950069, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002102813 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 169, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.069603850, 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000411857 2024-04-25T02:20:13.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 246, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.089574624, 2024-04-25T02:20:13.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000364124 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000288214, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000288214 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 11, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.003659119, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000332647 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 623, 2024-04-25T02:20:13.558 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.507956066, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000815338 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 11, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.803174076, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.163924916 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1, 2024-04-25T02:20:13.559 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000390302, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000390302 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 961, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.381956323, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001438039 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.002160172, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001080086 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:13.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 605, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 12.639183787, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.020891212 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.561 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.024172521, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.004834504 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 27, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 3.700063637, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.137039393 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.562 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 8, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.021132104, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002641513 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 10535, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 16.597952989, 2024-04-25T02:20:13.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001575505 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 2, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 6, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 4, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 2, 2024-04-25T02:20:13.565 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 128, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 64, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 621, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 120, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 120, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:13.566 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:13.567 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 2918176, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 4781, 2024-04-25T02:20:13.568 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 1672, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 19, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 8152, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 170, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 16473552, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 263526, 2024-04-25T02:20:13.569 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 31635, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 140519306, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 32, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 31635, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "op_latency": { 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 31635, 2024-04-25T02:20:13.570 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 2390.183546015, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.075555035 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op_inflight": 0, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 31635, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 59642 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 31635, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 3835, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 27800, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 1189, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 12216, 2024-04-25T02:20:13.571 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 165, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 1929, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 139, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 13, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 11477, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 3670, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 24432, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:13.572 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2024-04-25T02:20:13.573 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 98, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 14, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2024-04-25T02:20:13.574 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 3963, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 0, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 449 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "osd-slow-ops": { 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_ops_count": 0 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2024-04-25T02:20:13.575 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 40, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 10, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed_ops": 10901, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 10811, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 89089, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 23375202, 2024-04-25T02:20:13.576 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 89089, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 89089, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 23375202, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:13.577 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 31635, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 141639801, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 31635, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 141639801, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.578 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 31635, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 31635, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 31635, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 31635, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.579 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 10811, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 1120495, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 10811, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 161, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1120495, 2024-04-25T02:20:13.580 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x55896d85a500": { 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 55051, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 117286048, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 55051, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:13.581 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 1768, 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 117286048, 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:13.582 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-25T02:20:14.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:13 smithi163 ceph-mon[32577]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:20:14.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:13 smithi163 ceph-mon[32577]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:20:14.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:13 smithi163 ceph-mon[32577]: pgmap v327: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:14.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:13 smithi174 ceph-mon[33171]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:20:14.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:13 smithi174 ceph-mon[33171]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:20:14.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:13 smithi174 ceph-mon[33171]: pgmap v327: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:14.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:13 smithi137 ceph-mon[28303]: Adjusting osd_memory_target on smithi137 to 176.4M 2024-04-25T02:20:14.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:13 smithi137 ceph-mon[28303]: Unable to set osd_memory_target on smithi137 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-04-25T02:20:14.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:13 smithi137 ceph-mon[28303]: pgmap v327: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-25T02:20:14.322 INFO:tasks.check_counter:Daemon mds.b mds.exported=45 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds.imported=44 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1233 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=33 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-04-25T02:20:14.323 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-04-25T02:20:14.323 DEBUG:tasks.check_counter:Getting stats from e 2024-04-25T02:20:14.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-25T02:20:14.570 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:20:15.937 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:15 smithi163 ceph-mon[32577]: pgmap v329: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:20:16.161 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-25T02:20:16.161 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:16.161 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 825, 2024-04-25T02:20:16.161 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 827, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 3091878, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 262414, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 6, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 2, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.073777519, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.029513524, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.017928071, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.018607446, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 825, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.033999424, 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000041211 2024-04-25T02:20:16.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 935, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 914, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 1814598, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 352389, 2024-04-25T02:20:16.163 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.107243683, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.031776613, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.050802912, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.028914929, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 913, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.037862821, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000041470 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.164 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 1647296, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 136144 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 777, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 939, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 262272, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 773852, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 7, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 4, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.100991191, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.034778456, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.024908643, 2024-04-25T02:20:16.165 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.030169418, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 936, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.073965509, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000079022 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 528992 2024-04-25T02:20:16.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3861, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.108075849, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000027991 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:16.167 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 0, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 0, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2024-04-25T02:20:16.168 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 356, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 356, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 356, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 1, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 0, 2024-04-25T02:20:16.169 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 1, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:16.170 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T02:20:16.171 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 0 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update_receipt": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_try_discover": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_send_discover": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_handle_discover": 0, 2024-04-25T02:20:16.172 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 0, 2024-04-25T02:20:16.173 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evlrg": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 1570, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 0, 2024-04-25T02:20:16.174 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 3, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "segmjr": 2, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 7070225, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 7068137, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 1570 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.175 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 20, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 512, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 492, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 6, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 111, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 105, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 356, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 760, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 404, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 0, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 0, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 0, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 51852, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 215420 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.176 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.178 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.179 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.180 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.181 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2024-04-25T02:20:16.181 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:15 smithi174 ceph-mon[33171]: pgmap v329: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.182 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.183 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.184 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.185 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2024-04-25T02:20:16.186 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2024-04-25T02:20:16.187 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 2, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 4, 2024-04-25T02:20:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 2, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 3, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 2805, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:16.189 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:16.190 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:16.191 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 190037, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 69, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 8032, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 167, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:16.192 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 312211, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 2286, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 2275, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 21, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 3, 2024-04-25T02:20:16.193 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 2275, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_latency": { 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2275, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.988953080, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000874265 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_inflight": 0, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2275, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 2276 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 2275, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 2275, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 0, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2024-04-25T02:20:16.194 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 1448, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 825, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1, 2024-04-25T02:20:16.195 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2024-04-25T02:20:16.196 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 98, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 13, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 5, 2024-04-25T02:20:16.197 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 5, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 2, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 0 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "osd-slow-ops": { 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_ops_count": 0 2024-04-25T02:20:16.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed_ops": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 2533, 2024-04-25T02:20:16.199 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 4924642, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 2533, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2533, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 4924642, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:16.200 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 2275, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 2875926, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2275, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 2875926, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 2275, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 2275, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2275, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 2275, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.202 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:16.203 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x556ab11d26e0": { 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:16.204 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:16.205 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-25T02:20:16.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:15 smithi137 ceph-mon[28303]: pgmap v329: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-25T02:20:16.826 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T02:20:16.826 DEBUG:tasks.check_counter:Getting stats from h 2024-04-25T02:20:16.826 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-25T02:20:17.068 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:20:18.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:17 smithi163 ceph-mon[32577]: pgmap v330: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2024-04-25T02:20:18.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:17 smithi174 ceph-mon[33171]: pgmap v330: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2024-04-25T02:20:18.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:17 smithi137 ceph-mon[28303]: pgmap v330: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 236 B/s wr, 7 op/s 2024-04-25T02:20:18.725 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-25T02:20:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 2283, 2024-04-25T02:20:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2283, 2024-04-25T02:20:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 2981411, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 725177, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 6, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 2, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.176831345, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.055672551, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.046014317, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.060894811, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2282, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.072443914, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000031745 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 256, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 235, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 1647580, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 136202, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 3, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 2, 2024-04-25T02:20:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.046698837, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.014280132, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.036741482, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.005505478, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 234, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.012595253, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000053825 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 1647024, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 135504 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 3, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 166, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 588, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 530302, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 7, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 4, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.010291326, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.006226902, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.002094189, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000015490, 2024-04-25T02:20:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 163, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.023925015, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000146779 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 529984 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3864, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.090736030, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000023482 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2024-04-25T02:20:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 0, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 0, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2024-04-25T02:20:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 316, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 316, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 316, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 0, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 1, 2024-04-25T02:20:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 0, 2024-04-25T02:20:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 0 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update_receipt": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_try_discover": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_send_discover": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_handle_discover": 0, 2024-04-25T02:20:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T02:20:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evlrg": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 1184, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2024-04-25T02:20:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 3, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "segmjr": 2, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 6529448, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 6527360, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 1184 2024-04-25T02:20:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 13, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 421, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 408, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 6, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 105, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 99, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 316, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 665, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 349, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 0, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 0, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 0, 2024-04-25T02:20:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 51712, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 215420 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2024-04-25T02:20:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2024-04-25T02:20:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 2, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 4, 2024-04-25T02:20:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 2, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 3, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 2809, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 181639, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 57, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 8032, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 167, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 266626, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 1965, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 2282, 2024-04-25T02:20:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 21, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 3, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 2282, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_latency": { 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2282, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.621961714, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000710763 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_inflight": 0, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2282, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 2283 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 2282, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 2282, 2024-04-25T02:20:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 1454, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 826, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2024-04-25T02:20:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2024-04-25T02:20:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2024-04-25T02:20:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 98, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 13, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 4, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 4, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 2, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 0 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2024-04-25T02:20:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "osd-slow-ops": { 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_ops_count": 0 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed_ops": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 0, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 2538, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 4385118, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 2538, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2538, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 4385118, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 2282, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 2335149, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2282, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 2335149, 2024-04-25T02:20:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 2282, 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 2282, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2282, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 2282, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x56164fcfa6e0": { 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-25T02:20:19.499 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-25T02:20:19.499 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-25T02:20:19.499 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-04-25T02:20:19.499 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-04-25T02:20:19.500 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-04-25T02:20:19.500 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-25T02:20:19.500 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T02:20:19.500 DEBUG:tasks.check_counter:Getting stats from k 2024-04-25T02:20:19.500 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-25T02:20:19.740 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.b/config 2024-04-25T02:20:20.091 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:19 smithi163 ceph-mon[32577]: pgmap v331: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:20:20.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:19 smithi174 ceph-mon[33171]: pgmap v331: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:20:20.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:19 smithi137 ceph-mon[28303]: pgmap v331: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-25T02:20:21.417 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 231, 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 220, 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 1583424, 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 135584, 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:21.418 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.047397096, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.014509747, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.035020086, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.005715642, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 219, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.011568053, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000052822 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:21.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 1583424, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 135584 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 7, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 172, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 3552, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 263888, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 6, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.012546737, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.008124972, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.002038089, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:21.420 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 170, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.026933250, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000158430 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 3552, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 263888 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 0, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2, 2024-04-25T02:20:21.421 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 0, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 0, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.000381663, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.000315894, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:21.422 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:21.423 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:21.424 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:21.425 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 148714, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 30, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:21.426 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 2, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 234, 2024-04-25T02:20:21.427 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 1550905, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 234, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 234, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1550905, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-04-25T02:20:21.428 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-04-25T02:20:22.078 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:21 smithi163 ceph-mon[32577]: pgmap v332: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-04-25T02:20:22.106 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-04-25T02:20:22.106 DEBUG:tasks.check_counter:Getting stats from c 2024-04-25T02:20:22.107 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-25T02:20:22.134 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:21 smithi174 ceph-mon[33171]: pgmap v332: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:22.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:21 smithi137 ceph-mon[28303]: pgmap v332: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:22.356 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:20:24.134 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:23 smithi174 ceph-mon[33171]: pgmap v333: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:24.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:23 smithi163 ceph-mon[32577]: pgmap v333: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 15346, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 8706, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 7883599, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 5026499, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 13, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.651146727, 2024-04-25T02:20:24.179 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.248729108, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.535805630, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.016754328, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 8707, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.167578718, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000019246 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 22846, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.003075126, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000134 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1657888, 2024-04-25T02:20:24.180 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 153728 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1397, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2576, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 461201, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 1526404, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 16, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 9, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.100107190, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.046418655, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.058119829, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.005347809, 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:24.181 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2573, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.068190209, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000026502 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1555, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000534894, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000343 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 214528 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:24.182 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 290, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 437, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 110780, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 496843, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 14, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 7, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.028395284, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.010878007, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.009634991, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.005598066, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 434, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.045876600, 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000105706 2024-04-25T02:20:24.183 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 51, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000010091, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000197 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 6896, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 326576 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 508, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.417837351, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000822514 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 671, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.035493158, 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000052895 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.185 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 667, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 665, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 665, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.935601455, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001406919 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 2, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 11, 2024-04-25T02:20:24.186 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 53, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 7, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 32, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 14, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 40, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 1314, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 1, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 1, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 4, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 2656, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 1580, 2024-04-25T02:20:24.187 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 614, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 25, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 171, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 25, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 236, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 69, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:24.188 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 47, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 326299, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 3, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 69, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 1, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 1, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 68, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 48, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 474, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:24.189 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 368, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 317, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 21, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 653 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 56, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 1902, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 1243, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 1293, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 64, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 3, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:24.190 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 330, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 327, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 25, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-04-25T02:20:24.191 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 1570, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 1570, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 3, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 3, 2024-04-25T02:20:24.192 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 7070225, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 175, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.450235146, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002572772 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 46, 2024-04-25T02:20:24.193 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 1070, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 1024, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 33, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 753, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 720, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 53, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 1832, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 1779, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 1, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 357, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 356, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 59232, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 223612 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-04-25T02:20:24.194 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 1169, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 60, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 667, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 26, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 531, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 94, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.124056918, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001319754 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000206014, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000206014 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.195 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 197, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.071680355, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000363859 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:24.196 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000184426, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000184426 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:24.197 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-04-25T02:20:24.198 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.199 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-04-25T02:20:24.200 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 42, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.027798935, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000661879 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.201 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.041584385, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.010396096 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.202 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.203 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.204 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 326, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.670090422, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002055492 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.205 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 4, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 459, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 229, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 623, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.206 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:24.207 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:24.208 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 325664, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 152, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 704, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 8, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:24.209 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 167, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 198600, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 1555, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.210 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 753, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 2964446, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 33, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 753, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 753, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2.953959745, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.003922921 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 753, 2024-04-25T02:20:24.211 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 829 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 753, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 103, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 650, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 34, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 209, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 36, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-04-25T02:20:24.212 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 339, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 69, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-04-25T02:20:24.213 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-04-25T02:20:24.214 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 98, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 13, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-04-25T02:20:24.215 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 81, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 31 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-04-25T02:20:24.216 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 10, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 10, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 327, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 327, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 17029, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 6922759, 2024-04-25T02:20:24.217 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 17029, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 17029, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 6922759, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:24.218 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 753, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2998225, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 753, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2998225, 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:24.219 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 753, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 753, 2024-04-25T02:20:24.220 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 753, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 753, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 327, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 33779, 2024-04-25T02:20:24.221 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 327, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 34, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 33779, 2024-04-25T02:20:24.222 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55c0421f8500": { 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1570, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 2875921, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:24.223 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1570, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 175, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2875921, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:24.224 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-25T02:20:24.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:23 smithi137 ceph-mon[28303]: pgmap v333: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds.exported=25 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds.imported=25 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=56 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=1902 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=3 2024-04-25T02:20:25.000 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-25T02:20:25.001 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T02:20:25.001 DEBUG:tasks.check_counter:Getting stats from f 2024-04-25T02:20:25.001 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:20:25.924 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:25 smithi174 ceph-mon[33171]: pgmap v334: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:20:26.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:25 smithi163 ceph-mon[32577]: pgmap v334: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:20:26.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:25 smithi137 ceph-mon[28303]: pgmap v334: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 88 B/s wr, 7 op/s 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1716, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1718, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 50684707, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 545698, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 8, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-04-25T02:20:27.034 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.194713570, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.054061323, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.070011948, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.054168532, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1716, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.072617765, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000042318 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.035 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 581, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 746, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 42095485, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 716140, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 9, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.082268767, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.026111024, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.030744454, 2024-04-25T02:20:27.036 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.018460183, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 743, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.051327433, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000069081 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 531952 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:27.037 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 567, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 544, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 26894103, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 235023, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 5, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 4, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.088250074, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.024132201, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.057502267, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.014163292, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 544, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.026773993, 2024-04-25T02:20:27.038 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000049216 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1651072, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 138032 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-04-25T02:20:27.039 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4206, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.268182424, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000063761 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.040 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-04-25T02:20:27.041 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 19990, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 11519, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 8471, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 3535, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 2, 2024-04-25T02:20:27.042 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:27.043 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 234, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 6, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-04-25T02:20:27.044 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-04-25T02:20:27.045 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:27.046 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 55051, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-04-25T02:20:27.047 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 8, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 15, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 110038856, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 121480352, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 121480240, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.048 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 55051 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 4051, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 15337, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 11286, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 393, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 743, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 350, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 19990, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 23361, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 3371, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-04-25T02:20:27.049 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 88168, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 215420 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.050 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-04-25T02:20:27.051 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-04-25T02:20:27.052 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.053 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.054 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.055 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.056 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:27.057 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.058 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.059 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.060 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.061 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 6, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 4, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 5, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 4362, 2024-04-25T02:20:27.062 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:27.063 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:27.064 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 390928, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 4408, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-04-25T02:20:27.065 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 167, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 24213113, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 281031, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:27.066 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 2600, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 26, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 4, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 2600, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2600, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.911973877, 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000735374 2024-04-25T02:20:27.067 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2600, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2601 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 2600, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 2600, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 1646, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 951, 2024-04-25T02:20:27.068 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 2, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:27.069 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-04-25T02:20:27.070 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 98, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 13, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 10, 2024-04-25T02:20:27.071 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 10, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-04-25T02:20:27.072 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:27.073 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2860, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 119400652, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2860, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2860, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 119400652, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.074 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2600, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 117297037, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2600, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 117297037, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.075 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2600, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2600, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2600, 2024-04-25T02:20:27.076 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2600, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:27.077 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55847290e6e0": { 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:27.078 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.079 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:27.080 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-25T02:20:27.933 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-25T02:20:27.934 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T02:20:27.934 DEBUG:tasks.check_counter:Getting stats from i 2024-04-25T02:20:27.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-25T02:20:28.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:27 smithi163 ceph-mon[32577]: pgmap v335: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:28.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:27 smithi174 ceph-mon[33171]: pgmap v335: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:28.182 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:20:28.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:27 smithi137 ceph-mon[28303]: pgmap v335: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 15664, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 8789, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 8059502, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 4506389, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 9, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-04-25T02:20:29.836 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.657838925, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.254454626, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.537425982, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.018537997, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 8788, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.165217418, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000018800 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 23290, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.002925172, 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000125 2024-04-25T02:20:29.837 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1664704, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 168160 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1084, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2077, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 356203, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 1278776, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 25, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 8, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.082055163, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.036001101, 2024-04-25T02:20:29.838 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.050329589, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.003211261, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2075, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.057381823, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000027653 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1294, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000383527, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000296 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 5088, 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 137344 2024-04-25T02:20:29.839 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 244, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 376, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 96296, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 481921, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 8, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 6, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.026384225, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.011092599, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.006537217, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.006248987, 2024-04-25T02:20:29.840 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 374, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.048927084, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000130821 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 320496 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-04-25T02:20:29.841 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 411, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.337062193, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000820102 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-04-25T02:20:29.842 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 601, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.025689171, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000042744 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 565, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 560, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 560, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.997881885, 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.001781931 2024-04-25T02:20:29.843 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 5, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 11, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 35, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 4, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 18, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 13, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 26, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 1282, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 1, 2024-04-25T02:20:29.844 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 1, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 4, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 2437, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 1465, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 1, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 610, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 19, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 107, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 20, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 237, 2024-04-25T02:20:29.845 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 16, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 47, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 326299, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 3, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 16, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 1, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 1, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 15, 2024-04-25T02:20:29.846 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 2, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 49, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 396, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 263, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 200, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 20, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 553 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 50, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 1926, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 1257, 2024-04-25T02:20:29.847 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 1312, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 67, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 3, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 291, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 288, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-04-25T02:20:29.848 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 19, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 1184, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 1184, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-04-25T02:20:29.849 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 3, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 3, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 6529448, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 143, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.618335656, 2024-04-25T02:20:29.850 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.004324025 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 34, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 987, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 953, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 28, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 760, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 732, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 35, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 1780, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 1745, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 1, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 311, 2024-04-25T02:20:29.851 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 310, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 61580, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 223612 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 987, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 70, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 565, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 26, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 455, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 54, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.109773570, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002032843 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.852 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.001077014, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000359004 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.853 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 174, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.062659394, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000360111 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.854 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.855 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.856 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.857 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 38, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.024011111, 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000631871 2024-04-25T02:20:29.858 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.859 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 8, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.142153187, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.017769148 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.860 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.861 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.862 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 283, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.658207609, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002325821 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-04-25T02:20:29.863 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 4, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 431, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 215, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 636, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:29.864 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:29.865 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:29.866 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 324916, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 140, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 176, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 2, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:29.867 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8032, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 167, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 149570, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 1234, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-04-25T02:20:29.868 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 626, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 2420524, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 28, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 626, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 626, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 4.096944133, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.006544639 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-04-25T02:20:29.869 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 626, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 702 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 626, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 49, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 577, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 33, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 176, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 35, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-04-25T02:20:29.870 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 300, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 16, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T02:20:29.871 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-04-25T02:20:29.872 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 98, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 13, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 12, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 12, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 84, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 28 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-04-25T02:20:29.873 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "osd-slow-ops": { 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 10, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 10, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 288, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 288, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.874 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 16988, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 6978922, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 16988, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 16988, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 6978922, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.875 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 626, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2450044, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 626, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2450044, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.876 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 626, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 626, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 626, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 626, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.877 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 288, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 29520, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 288, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:29.878 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 33, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 29520, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55b5dd710500": { 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1184, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 2335144, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1184, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:29.879 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 143, 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2335144, 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:29.880 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-25T02:20:30.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:29 smithi163 ceph-mon[32577]: pgmap v336: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:20:30.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:29 smithi174 ceph-mon[33171]: pgmap v336: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:20:30.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:29 smithi137 ceph-mon[28303]: pgmap v336: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-25T02:20:30.589 INFO:tasks.check_counter:Daemon mds.i mds.exported=19 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds.imported=20 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=50 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1926 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=3 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-25T02:20:30.590 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-25T02:20:30.590 DEBUG:tasks.check_counter:Getting stats from l 2024-04-25T02:20:30.590 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551 shell --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-25T02:20:30.826 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/mon.c/config 2024-04-25T02:20:32.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:31 smithi163 ceph-mon[32577]: pgmap v337: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:20:32.141 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:31 smithi174 ceph-mon[33171]: pgmap v337: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:20:32.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:31 smithi137 ceph-mon[28303]: pgmap v337: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 239, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 226, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1587584, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 138592, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 0, 2024-04-25T02:20:32.512 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.047613814, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.014959216, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.034770157, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.005805337, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 226, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.012147224, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000053748 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.513 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1587584, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 138592 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 3, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 173, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 480, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 263792, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.011789381, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.007839113, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.001569352, 2024-04-25T02:20:32.514 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 169, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.032337074, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000191343 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 480, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 263792 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T02:20:32.515 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 0, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 0, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 0, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 2, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.000243950, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.000000000, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.000178648, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:32.516 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 0, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-04-25T02:20:32.517 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-04-25T02:20:32.518 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-04-25T02:20:32.519 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 148692, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 30, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-04-25T02:20:32.520 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 928, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 2, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-04-25T02:20:32.521 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 238, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1551425, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 238, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 238, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1551425, 2024-04-25T02:20:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-04-25T02:20:32.523 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-04-25T02:20:33.225 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-04-25T02:20:33.225 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-04-25T02:20:33.226 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-04-25T02:20:33.226 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-04-25T02:20:33.226 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-04-25T02:20:33.226 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-04-25T02:20:33.226 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-04-25T02:20:33.226 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T02:20:33.241 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:20:33.241 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:20:33.241 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:20:33.304 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:20:33.304 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:20:33.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.565+0000 7f7885400640 1 -- 172.21.15.137:0/3470285621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7880108580 msgr2=0x7f78801149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.565+0000 7f7885400640 1 --2- 172.21.15.137:0/3470285621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7880108580 0x7f78801149f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7878009900 tx=0x7f787802a480 comp rx=0 tx=0).stop 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 -- 172.21.15.137:0/3470285621 shutdown_connections 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 --2- 172.21.15.137:0/3470285621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7880108580 0x7f78801149f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 --2- 172.21.15.137:0/3470285621 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 0x7f7880108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 --2- 172.21.15.137:0/3470285621 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f788010dc50 0x7f788010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 -- 172.21.15.137:0/3470285621 >> 172.21.15.137:0/3470285621 conn(0x7f78800772c0 msgr2=0x7f78800796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 -- 172.21.15.137:0/3470285621 shutdown_connections 2024-04-25T02:20:33.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.566+0000 7f7885400640 1 -- 172.21.15.137:0/3470285621 wait complete. 2024-04-25T02:20:33.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 Processor -- start 2024-04-25T02:20:33.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 -- start start 2024-04-25T02:20:33.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 0x7f788019e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:33.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7880108580 0x7f788019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78801180e0 con 0x7f788010dc50 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7880117f60 con 0x7f7880108580 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.567+0000 7f7885400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7880118260 con 0x7f7880107be0 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46394/0 (socket says 172.21.15.137:46394) 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 -- 172.21.15.137:0/2577571265 learned_addr learned my addr 172.21.15.137:0/2577571265 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f787fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 0x7f788019e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f787f400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7880108580 0x7f788019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 -- 172.21.15.137:0/2577571265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 msgr2=0x7f788019e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 0x7f788019e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 -- 172.21.15.137:0/2577571265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7880108580 msgr2=0x7f788019ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7880108580 0x7f788019ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 -- 172.21.15.137:0/2577571265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78801a34b0 con 0x7f788010dc50 2024-04-25T02:20:33.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.568+0000 7f7884a00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7878004770 tx=0x7f78780329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.569+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787803f030 con 0x7f788010dc50 2024-04-25T02:20:33.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.569+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7878032dc0 con 0x7f788010dc50 2024-04-25T02:20:33.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.569+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78801a3740 con 0x7f788010dc50 2024-04-25T02:20:33.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.569+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878035070 con 0x7f788010dc50 2024-04-25T02:20:33.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.569+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78801ab030 con 0x7f788010dc50 2024-04-25T02:20:33.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.570+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78800688d0 con 0x7f788010dc50 2024-04-25T02:20:33.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.572+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f7878042030 con 0x7f788010dc50 2024-04-25T02:20:33.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.573+0000 7f787cc00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 0x7f78640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:33.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.574+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f78780ef6c0 con 0x7f788010dc50 2024-04-25T02:20:33.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.574+0000 7f787fe00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 0x7f78640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:33.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.574+0000 7f787fe00640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 0x7f78640a51c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7870005fd0 tx=0x7f7870009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.578+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f78780bbc30 con 0x7f788010dc50 2024-04-25T02:20:33.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.780+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78801ab200 con 0x7f788010dc50 2024-04-25T02:20:33.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.782+0000 7f787cc00640 1 -- 172.21.15.137:0/2577571265 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+23149 (secure 0 0 0) 0x7f78780bff30 con 0x7f788010dc50 2024-04-25T02:20:33.785 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:20:33.786 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":98,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:20:12.664864+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.784+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 msgr2=0x7f78640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.784+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 0x7f78640a51c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7870005fd0 tx=0x7f7870009500 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.784+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 msgr2=0x7f78801a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.784+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7878004770 tx=0x7f78780329c0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 shutdown_connections 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f78640a2d00 0x7f78640a51c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f788010dc50 0x7f78801a2d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7880108580 0x7f788019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 --2- 172.21.15.137:0/2577571265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7880107be0 0x7f788019e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 >> 172.21.15.137:0/2577571265 conn(0x7f78800772c0 msgr2=0x7f78800787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 shutdown_connections 2024-04-25T02:20:33.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:33.785+0000 7f7885400640 1 -- 172.21.15.137:0/2577571265 wait complete. 2024-04-25T02:20:33.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:02:10.947973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:07:17.190881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:07:18.334399+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T02:20:33.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:20:34.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.011+0000 7fc4bae00640 1 -- 172.21.15.137:0/4108333948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 msgr2=0x7fc4b4114aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.011+0000 7fc4bae00640 1 --2- 172.21.15.137:0/4108333948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b4114aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009900 tx=0x7fc4ac02a480 comp rx=0 tx=0).stop 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 -- 172.21.15.137:0/4108333948 shutdown_connections 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 --2- 172.21.15.137:0/4108333948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b4114aa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 --2- 172.21.15.137:0/4108333948 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b4107ce0 0x7fc4b4108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 --2- 172.21.15.137:0/4108333948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b410dd00 0x7fc4b410e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 -- 172.21.15.137:0/4108333948 >> 172.21.15.137:0/4108333948 conn(0x7fc4b4077560 msgr2=0x7fc4b4106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 -- 172.21.15.137:0/4108333948 shutdown_connections 2024-04-25T02:20:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.012+0000 7fc4bae00640 1 -- 172.21.15.137:0/4108333948 wait complete. 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 Processor -- start 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 -- start start 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 0x7fc4b419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b410dd00 0x7fc4b41a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4118190 con 0x7fc4b4108680 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4118010 con 0x7fc4b410dd00 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.013+0000 7fc4bae00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4118310 con 0x7fc4b4107ce0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 0x7fc4b419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9000640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46420/0 (socket says 172.21.15.137:46420) 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4ba400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b410dd00 0x7fc4b41a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9000640 1 -- 172.21.15.137:0/2387767195 learned_addr learned my addr 172.21.15.137:0/2387767195 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 -- 172.21.15.137:0/2387767195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b410dd00 msgr2=0x7fc4b41a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b410dd00 0x7fc4b41a2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 -- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 msgr2=0x7fc4b419ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 -- 172.21.15.137:0/2387767195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b41a3470 con 0x7fc4b4107ce0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9000640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.014+0000 7fc4b9a00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 0x7fc4b419e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800eb00 tx=0x7fc4a800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.015+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8010430 con 0x7fc4b4107ce0 2024-04-25T02:20:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.015+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b41a3760 con 0x7fc4b4107ce0 2024-04-25T02:20:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.015+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4a8010ad0 con 0x7fc4b4107ce0 2024-04-25T02:20:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.015+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8017c10 con 0x7fc4b4107ce0 2024-04-25T02:20:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.015+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b41aaff0 con 0x7fc4b4107ce0 2024-04-25T02:20:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.016+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b40688d0 con 0x7fc4b4107ce0 2024-04-25T02:20:34.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.018+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fc4a8010c80 con 0x7fc4b4107ce0 2024-04-25T02:20:34.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.019+0000 7fc4b2000640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 0x7fc49c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.019+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7fc4a80cfe50 con 0x7fc4b4107ce0 2024-04-25T02:20:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.020+0000 7fc4b9000640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 0x7fc49c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.020+0000 7fc4b9000640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 0x7fc49c0a51c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4077af0 tx=0x7fc4a0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.024+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fc4a809ca10 con 0x7fc4b4107ce0 2024-04-25T02:20:34.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:33 smithi163 ceph-mon[32577]: pgmap v338: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:34.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:33 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2577571265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:34.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:33 smithi174 ceph-mon[33171]: pgmap v338: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:34.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:33 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2577571265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:34.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.224+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4b41ab250 con 0x7fc4b4107ce0 2024-04-25T02:20:34.228 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-25T02:20:34.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.225+0000 7fc4b2000640 1 -- 172.21.15.137:0/2387767195 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7fc4a809c310 con 0x7fc4b4107ce0 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.227+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 msgr2=0x7fc49c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.227+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 0x7fc49c0a51c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4077af0 tx=0x7fc4a0005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.227+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 msgr2=0x7fc4b419e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.227+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 0x7fc4b419e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800eb00 tx=0x7fc4a800c2d0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 shutdown_connections 2024-04-25T02:20:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fc49c0a2d00 0x7fc49c0a51c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4b410dd00 0x7fc4b41a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4b4108680 0x7fc4b419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 --2- 172.21.15.137:0/2387767195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4b4107ce0 0x7fc4b419e4d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 >> 172.21.15.137:0/2387767195 conn(0x7fc4b4077560 msgr2=0x7fc4b40782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 shutdown_connections 2024-04-25T02:20:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.228+0000 7fc4bae00640 1 -- 172.21.15.137:0/2387767195 wait complete. 2024-04-25T02:20:34.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:33 smithi137 ceph-mon[28303]: pgmap v338: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:34.247 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:33 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2577571265' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:34.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:20:34.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 -- 172.21.15.137:0/739517654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 msgr2=0x7f2ed8109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 --2- 172.21.15.137:0/739517654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed8109be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009be0 tx=0x7f2ecc02a6d0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 -- 172.21.15.137:0/739517654 shutdown_connections 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 --2- 172.21.15.137:0/739517654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81041b0 0x7f2ed81106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 --2- 172.21.15.137:0/739517654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81037f0 0x7f2ed8103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 --2- 172.21.15.137:0/739517654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed8109be0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 -- 172.21.15.137:0/739517654 >> 172.21.15.137:0/739517654 conn(0x7f2ed80ff280 msgr2=0x7f2ed81016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 -- 172.21.15.137:0/739517654 shutdown_connections 2024-04-25T02:20:34.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.452+0000 7f2ede600640 1 -- 172.21.15.137:0/739517654 wait complete. 2024-04-25T02:20:34.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.453+0000 7f2ede600640 1 Processor -- start 2024-04-25T02:20:34.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.453+0000 7f2ede600640 1 -- start start 2024-04-25T02:20:34.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81041b0 0x7f2ed819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8113cf0 con 0x7f2ed81037f0 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8113b70 con 0x7f2ed8109800 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ede600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8113e70 con 0x7f2ed81041b0 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46436/0 (socket says 172.21.15.137:46436) 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 -- 172.21.15.137:0/2999424600 learned_addr learned my addr 172.21.15.137:0/2999424600 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2ed7e00640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81041b0 0x7f2ed819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2eddc00640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 -- 172.21.15.137:0/2999424600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81041b0 msgr2=0x7f2ed819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81041b0 0x7f2ed819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 -- 172.21.15.137:0/2999424600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 msgr2=0x7f2ed819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.454+0000 7f2edd200640 1 -- 172.21.15.137:0/2999424600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed819f180 con 0x7f2ed81037f0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2edd200640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004af0 tx=0x7f2ecc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc041020 con 0x7f2ed81037f0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed819f410 con 0x7f2ed81037f0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2ecc0308a0 con 0x7f2ed81037f0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed81a6d00 con 0x7f2ed81037f0 2024-04-25T02:20:34.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.455+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc036040 con 0x7f2ed81037f0 2024-04-25T02:20:34.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.456+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed8068480 con 0x7f2ed81037f0 2024-04-25T02:20:34.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.458+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f2ecc044020 con 0x7f2ed81037f0 2024-04-25T02:20:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.460+0000 7f2ed5600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 0x7f2ec00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.461+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f2ecc0effc0 con 0x7f2ed81037f0 2024-04-25T02:20:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.461+0000 7f2ed7e00640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 0x7f2ec00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.461+0000 7f2ed7e00640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 0x7f2ec00a51c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8108d20 tx=0x7f2ec4009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.465+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f2ecc04b020 con 0x7f2ed81037f0 2024-04-25T02:20:34.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.664+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ed81a6ed0 con 0x7f2ed81037f0 2024-04-25T02:20:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.665+0000 7f2ed5600640 1 -- 172.21.15.137:0/2999424600 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) ==== 104+0+11 (secure 0 0 0) 0x7f2ecc0bcc90 con 0x7f2ed81037f0 2024-04-25T02:20:34.668 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-25T02:20:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 msgr2=0x7f2ec00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 0x7f2ec00a51c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8108d20 tx=0x7f2ec4009260 comp rx=0 tx=0).stop 2024-04-25T02:20:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 msgr2=0x7f2ed819a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc004af0 tx=0x7f2ecc003c20 comp rx=0 tx=0).stop 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 shutdown_connections 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f2ec00a2d00 0x7f2ec00a51c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ed8109800 0x7f2ed819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ed81041b0 0x7f2ed819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 --2- 172.21.15.137:0/2999424600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed81037f0 0x7f2ed819a190 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 >> 172.21.15.137:0/2999424600 conn(0x7f2ed80ff280 msgr2=0x7f2ed80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 shutdown_connections 2024-04-25T02:20:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.668+0000 7f2ede600640 1 -- 172.21.15.137:0/2999424600 wait complete. 2024-04-25T02:20:34.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:20:34.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 -- 172.21.15.137:0/1620956385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100540 msgr2=0x7f7754100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 --2- 172.21.15.137:0/1620956385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100540 0x7f7754100920 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7744009900 tx=0x7f774402a400 comp rx=0 tx=0).stop 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 -- 172.21.15.137:0/1620956385 shutdown_connections 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 --2- 172.21.15.137:0/1620956385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f77541104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 --2- 172.21.15.137:0/1620956385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100e60 0x7f775410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 --2- 172.21.15.137:0/1620956385 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100540 0x7f7754100920 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 -- 172.21.15.137:0/1620956385 >> 172.21.15.137:0/1620956385 conn(0x7f7754077740 msgr2=0x7f7754077b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 -- 172.21.15.137:0/1620956385 shutdown_connections 2024-04-25T02:20:34.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.889+0000 7f775a200640 1 -- 172.21.15.137:0/1620956385 wait complete. 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.890+0000 7f775a200640 1 Processor -- start 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.890+0000 7f775a200640 1 -- start start 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100540 0x7f775419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f775419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7754113e90 con 0x7f7754100e60 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f7754113d10 con 0x7f775410e0f0 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f775a200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7754114010 con 0x7f7754100540 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46444/0 (socket says 172.21.15.137:46444) 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 -- 172.21.15.137:0/39490931 learned_addr learned my addr 172.21.15.137:0/39490931 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7753e00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f775419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7753400640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100540 0x7f775419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 -- 172.21.15.137:0/39490931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100540 msgr2=0x7f775419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100540 0x7f775419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.891+0000 7f7752a00640 1 -- 172.21.15.137:0/39490931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 msgr2=0x7f775419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f7752a00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f775419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f7752a00640 1 -- 172.21.15.137:0/39490931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775419f2e0 con 0x7f7754100e60 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f7753e00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f775419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f7752a00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9f0 tx=0x7f774000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774000cd80 con 0x7f7754100e60 2024-04-25T02:20:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7740005520 con 0x7f7754100e60 2024-04-25T02:20:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775419f5d0 con 0x7f7754100e60 2024-04-25T02:20:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740010690 con 0x7f7754100e60 2024-04-25T02:20:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.892+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77541a6e60 con 0x7f7754100e60 2024-04-25T02:20:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.894+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7754068560 con 0x7f7754100e60 2024-04-25T02:20:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.896+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f77400046c0 con 0x7f7754100e60 2024-04-25T02:20:34.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.897+0000 7f774be00640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 0x7f77380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:34.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.898+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f77400cf8c0 con 0x7f7754100e60 2024-04-25T02:20:34.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.898+0000 7f7753400640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 0x7f77380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:34.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.899+0000 7f7753400640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 0x7f77380a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744005e80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:34.902+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f774009c480 con 0x7f7754100e60 2024-04-25T02:20:35.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2387767195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.030 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:34 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2999424600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.102+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f775402d170 con 0x7f7754100e60 2024-04-25T02:20:35.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.103+0000 7f774be00640 1 -- 172.21.15.137:0/39490931 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) ==== 100+0+11 (secure 0 0 0) 0x7f774009bd80 con 0x7f7754100e60 2024-04-25T02:20:35.106 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.105+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 msgr2=0x7f77380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.105+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 0x7f77380a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744005e80 comp rx=0 tx=0).stop 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.105+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 msgr2=0x7f775419a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.105+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9f0 tx=0x7f774000edf0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 shutdown_connections 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f77380a2d00 0x7f77380a51c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f775410e0f0 0x7f775419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7754100e60 0x7f775419a830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 --2- 172.21.15.137:0/39490931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7754100540 0x7f775419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 >> 172.21.15.137:0/39490931 conn(0x7f7754077740 msgr2=0x7f775410f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 shutdown_connections 2024-04-25T02:20:35.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.106+0000 7f775a200640 1 -- 172.21.15.137:0/39490931 wait complete. 2024-04-25T02:20:35.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:20:35.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2387767195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:34 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2999424600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2387767195' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:34 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2999424600' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 -- 172.21.15.137:0/1856081788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 msgr2=0x7f9684103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 --2- 172.21.15.137:0/1856081788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f9684103da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9670009860 tx=0x7f967002a340 comp rx=0 tx=0).stop 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 -- 172.21.15.137:0/1856081788 shutdown_connections 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 --2- 172.21.15.137:0/1856081788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f96841042e0 0x7f96841107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 --2- 172.21.15.137:0/1856081788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f9684103da0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 --2- 172.21.15.137:0/1856081788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9684109930 0x7f9684109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 -- 172.21.15.137:0/1856081788 >> 172.21.15.137:0/1856081788 conn(0x7f96840ff3b0 msgr2=0x7f96841017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.336+0000 7f9689e00640 1 -- 172.21.15.137:0/1856081788 shutdown_connections 2024-04-25T02:20:35.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.337+0000 7f9689e00640 1 -- 172.21.15.137:0/1856081788 wait complete. 2024-04-25T02:20:35.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.337+0000 7f9689e00640 1 Processor -- start 2024-04-25T02:20:35.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 -- start start 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96841042e0 0x7f968419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 0x7f968419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9684113e60 con 0x7f96841042e0 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f9684113ce0 con 0x7f9684103920 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9689e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9684113fe0 con 0x7f9684109930 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9682a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9682a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:59676/0 (socket says 172.21.15.137:59676) 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9682a00640 1 -- 172.21.15.137:0/4098346757 learned_addr learned my addr 172.21.15.137:0/4098346757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9682000640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96841042e0 0x7f968419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.338+0000 7f9683400640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 0x7f968419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 -- 172.21.15.137:0/4098346757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 msgr2=0x7f968419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 0x7f968419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 -- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96841042e0 msgr2=0x7f968419a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96841042e0 0x7f968419a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 -- 172.21.15.137:0/4098346757 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968419f2e0 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9683400640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 0x7f968419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9682a00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f967400e9c0 tx=0x7f967400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967400ccc0 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968419f5d0 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9674005520 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674010690 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.339+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841a6e60 con 0x7f9684103920 2024-04-25T02:20:35.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.340+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9684068560 con 0x7f9684103920 2024-04-25T02:20:35.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.343+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f96740046c0 con 0x7f9684103920 2024-04-25T02:20:35.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.344+0000 7f9688a00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 0x7f96680a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:35.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.344+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f96740cf950 con 0x7f9684103920 2024-04-25T02:20:35.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.344+0000 7f9682000640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 0x7f96680a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:35.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.345+0000 7f9682000640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 0x7f96680a51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f967002a930 tx=0x7f96700056d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.347+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f9674053740 con 0x7f9684103920 2024-04-25T02:20:35.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.560+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f968419b640 con 0x7f9684103920 2024-04-25T02:20:35.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.561+0000 7f9688a00640 1 -- 172.21.15.137:0/4098346757 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v98) ==== 81+0+956 (secure 0 0 0) 0x7f967409c510 con 0x7f9684103920 2024-04-25T02:20:35.564 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6801/205966009 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6800/205966009 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/652761516 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/2811873727 2024-04-26T01:59:26.231648+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6801/1454150812 2024-04-26T01:59:26.231648+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/16164329 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6800/1454150812 2024-04-26T01:59:26.231648+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/3398591634 2024-04-26T01:59:26.231648+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/1248132211 2024-04-26T01:58:53.335832+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6801/3009931509 2024-04-26T01:58:53.335832+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/3780953419 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/4170175592 2024-04-26T01:58:53.335832+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6800/3009931509 2024-04-26T01:58:53.335832+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/797325498 2024-04-26T01:58:53.335832+0000 2024-04-25T02:20:35.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/1200236983 2024-04-26T02:09:41.978067+0000 2024-04-25T02:20:35.566 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:0/1909466669 2024-04-26T01:59:26.231648+0000 2024-04-25T02:20:35.566 INFO:teuthology.orchestra.run.smithi137.stderr:listed 16 entries 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 msgr2=0x7f96680a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 0x7f96680a51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f967002a930 tx=0x7f96700056d0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 msgr2=0x7f968419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f967400e9c0 tx=0x7f967400ee80 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 shutdown_connections 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f96680a2d00 0x7f96680a51c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9684109930 0x7f968419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96841042e0 0x7f968419a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 --2- 172.21.15.137:0/4098346757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9684103920 0x7f968419a340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.564+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 >> 172.21.15.137:0/4098346757 conn(0x7f96840ff3b0 msgr2=0x7f96840ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.565+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 shutdown_connections 2024-04-25T02:20:35.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:35.565+0000 7f9689e00640 1 -- 172.21.15.137:0/4098346757 wait complete. 2024-04-25T02:20:35.587 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T02:20:35.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:35.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:35.707 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:20:35.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:35.708 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:35.794 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-25T02:20:35.871 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:20:35.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:35.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:35.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:35.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-25T02:20:36.060 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T02:20:36.060 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-25T02:20:36.060 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:20:36.096 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/05f1a22a12ff988a37a947e1a87634b6b927d13bff76036bc02d26cbc6a85544/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/05f1a22a12ff988a37a947e1a87634b6b927d13bff76036bc02d26cbc6a85544/diff,workdir=/var/lib/containers/storage/overlay/05f1a22a12ff988a37a947e1a87634b6b927d13bff76036bc02d26cbc6a85544/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/25157b1d8fa921e5e28fee2e18c67f26f7f8df2be9d6dccfef71143fe3193550/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/25157b1d8fa921e5e28fee2e18c67f26f7f8df2be9d6dccfef71143fe3193550/diff,workdir=/var/lib/containers/storage/overlay/25157b1d8fa921e5e28fee2e18c67f26f7f8df2be9d6dccfef71143fe3193550/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/2d79fe23c7f096ff5398724cebade1469fa0fbbce00a6b3cb7326e43a491de65/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/2d79fe23c7f096ff5398724cebade1469fa0fbbce00a6b3cb7326e43a491de65/diff,workdir=/var/lib/containers/storage/overlay/2d79fe23c7f096ff5398724cebade1469fa0fbbce00a6b3cb7326e43a491de65/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8c03c300f5e6d27288229b9ef1abca5040e436fe80c3cb18852c52ad2b4e673f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/8c03c300f5e6d27288229b9ef1abca5040e436fe80c3cb18852c52ad2b4e673f/diff,workdir=/var/lib/containers/storage/overlay/8c03c300f5e6d27288229b9ef1abca5040e436fe80c3cb18852c52ad2b4e673f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a7df116d7021240833604d56539b94fed1b447f3466cb06f27643741a6b33b6b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/a7df116d7021240833604d56539b94fed1b447f3466cb06f27643741a6b33b6b/diff,workdir=/var/lib/containers/storage/overlay/a7df116d7021240833604d56539b94fed1b447f3466cb06f27643741a6b33b6b/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/22a0a2cf83d6815750c71501be5a96ff8e2b96095494dc2e2b7187a70faf2712/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/22a0a2cf83d6815750c71501be5a96ff8e2b96095494dc2e2b7187a70faf2712/diff,workdir=/var/lib/containers/storage/overlay/22a0a2cf83d6815750c71501be5a96ff8e2b96095494dc2e2b7187a70faf2712/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2146d299e433d5cb5f7121c298f2f07f963ad3091b8f36b85f7ef28446cadc11/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/2146d299e433d5cb5f7121c298f2f07f963ad3091b8f36b85f7ef28446cadc11/diff,workdir=/var/lib/containers/storage/overlay/2146d299e433d5cb5f7121c298f2f07f963ad3091b8f36b85f7ef28446cadc11/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7db94756b38b93c94d8f4dba7286c913fc531c4c712ad7955787025f47f03937/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/7db94756b38b93c94d8f4dba7286c913fc531c4c712ad7955787025f47f03937/diff,workdir=/var/lib/containers/storage/overlay/7db94756b38b93c94d8f4dba7286c913fc531c4c712ad7955787025f47f03937/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7b379d47d53d6f59c01d7eee048bc1ebd26cc49bb24a9ce171d467a836df02ba/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/7b379d47d53d6f59c01d7eee048bc1ebd26cc49bb24a9ce171d467a836df02ba/diff,workdir=/var/lib/containers/storage/overlay/7b379d47d53d6f59c01d7eee048bc1ebd26cc49bb24a9ce171d467a836df02ba/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f7431c533f5f78858c8eb5149a9d375de88ec1260e2ff72d43469143de93d3b9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/MITGRDBLLTLVQ4EDGMZGQJ3V6B:/var/lib/containers/storage/overlay/l/5R4VWA37JZBMNHZBWEPMIAKNSJ,upperdir=/var/lib/containers/storage/overlay/f7431c533f5f78858c8eb5149a9d375de88ec1260e2ff72d43469143de93d3b9/diff,workdir=/var/lib/containers/storage/overlay/f7431c533f5f78858c8eb5149a9d375de88ec1260e2ff72d43469143de93d3b9/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 2024-04-25T02:20:36.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.097 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-25T02:20:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:35 smithi163 ceph-mon[32577]: pgmap v339: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:20:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:35 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/39490931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:20:36.139 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:35 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4098346757' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:20:36.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:35 smithi174 ceph-mon[33171]: pgmap v339: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:20:36.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:35 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/39490931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:20:36.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:35 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4098346757' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:20:36.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-25T02:20:36.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:35 smithi137 ceph-mon[28303]: pgmap v339: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-25T02:20:36.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:35 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/39490931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-25T02:20:36.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:35 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4098346757' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T02:20:36.309 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-25T02:20:36.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:20:36.313 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T02:20:36.323 INFO:tasks.cephadm:Teardown begin 2024-04-25T02:20:36.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:20:36.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 -- 172.21.15.137:0/2890258050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880108580 msgr2=0x7fe8801149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 --2- 172.21.15.137:0/2890258050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880108580 0x7fe8801149f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe878009ca0 tx=0x7fe87802a950 comp rx=0 tx=0).stop 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 -- 172.21.15.137:0/2890258050 shutdown_connections 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 --2- 172.21.15.137:0/2890258050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880108580 0x7fe8801149f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 --2- 172.21.15.137:0/2890258050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880107be0 0x7fe880108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 --2- 172.21.15.137:0/2890258050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe88010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 -- 172.21.15.137:0/2890258050 >> 172.21.15.137:0/2890258050 conn(0x7fe8800772c0 msgr2=0x7fe8800796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 -- 172.21.15.137:0/2890258050 shutdown_connections 2024-04-25T02:20:36.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.524+0000 7fe884c00640 1 -- 172.21.15.137:0/2890258050 wait complete. 2024-04-25T02:20:36.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.525+0000 7fe884c00640 1 Processor -- start 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 -- start start 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880108580 0x7fe88019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe8801a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801180e0 con 0x7fe880108580 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fe880117f60 con 0x7fe880107be0 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe884c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe880118260 con 0x7fe88010dc50 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe87f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe877e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880108580 0x7fe88019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe87f400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:59698/0 (socket says 172.21.15.137:59698) 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe87f400640 1 -- 172.21.15.137:0/112089799 learned_addr learned my addr 172.21.15.137:0/112089799 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.526+0000 7fe87fe00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe8801a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 -- 172.21.15.137:0/112089799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 msgr2=0x7fe8801a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe8801a2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 -- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880108580 msgr2=0x7fe88019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880108580 0x7fe88019e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 -- 172.21.15.137:0/112089799 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801a3470 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87fe00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe8801a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87f400640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e9f0 tx=0x7fe87000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87000cd80 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe870005520 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870010690 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8801a3760 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.527+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801aaff0 con 0x7fe880107be0 2024-04-25T02:20:36.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.528+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8800688d0 con 0x7fe880107be0 2024-04-25T02:20:36.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.530+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fe8700046c0 con 0x7fe880107be0 2024-04-25T02:20:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.532+0000 7fe87cc00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 0x7fe8640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.532+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7fe8700cf8e0 con 0x7fe880107be0 2024-04-25T02:20:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.532+0000 7fe877e00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 0x7fe8640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.533+0000 7fe877e00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 0x7fe8640a5240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe88010d170 tx=0x7fe868005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.536+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fe87009c4a0 con 0x7fe880107be0 2024-04-25T02:20:36.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.762+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8801ab290 con 0x7fe880107be0 2024-04-25T02:20:36.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.763+0000 7fe87cc00640 1 -- 172.21.15.137:0/112089799 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7fe87009bda0 con 0x7fe880107be0 2024-04-25T02:20:36.767 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:20:36.767 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:15:25.652008+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":70,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:20:36.767 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 32 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 msgr2=0x7fe8640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 0x7fe8640a5240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe88010d170 tx=0x7fe868005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 msgr2=0x7fe88019e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e9f0 tx=0x7fe87000edf0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 shutdown_connections 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fe8640a2d80 0x7fe8640a5240 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe88010dc50 0x7fe8801a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe880108580 0x7fe88019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 --2- 172.21.15.137:0/112089799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe880107be0 0x7fe88019e480 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 >> 172.21.15.137:0/112089799 conn(0x7fe8800772c0 msgr2=0x7fe880078760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 shutdown_connections 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.766+0000 7fe884c00640 1 -- 172.21.15.137:0/112089799 wait complete. 2024-04-25T02:20:36.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 -- 172.21.15.137:0/2005294423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054107be0 msgr2=0x7f1054108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 --2- 172.21.15.137:0/2005294423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054107be0 0x7f1054108040 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f103c009900 tx=0x7f103c02a480 comp rx=0 tx=0).stop 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 -- 172.21.15.137:0/2005294423 shutdown_connections 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 --2- 172.21.15.137:0/2005294423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1054108580 0x7f10541149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 --2- 172.21.15.137:0/2005294423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054107be0 0x7f1054108040 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 --2- 172.21.15.137:0/2005294423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f105410dc50 0x7f105410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 -- 172.21.15.137:0/2005294423 >> 172.21.15.137:0/2005294423 conn(0x7f10540772c0 msgr2=0x7f10540796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 -- 172.21.15.137:0/2005294423 shutdown_connections 2024-04-25T02:20:36.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.979+0000 7f1058a00640 1 -- 172.21.15.137:0/2005294423 wait complete. 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.980+0000 7f1058a00640 1 Processor -- start 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 -- start start 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1054107be0 0x7f105419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f105410dc50 0x7f10541a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1054118090 con 0x7f1054108580 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f1054117f10 con 0x7f105410dc50 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1058a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1054118210 con 0x7f1054107be0 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f104aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f104aa00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46488/0 (socket says 172.21.15.137:46488) 2024-04-25T02:20:36.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f104aa00640 1 -- 172.21.15.137:0/4012486820 learned_addr learned my addr 172.21.15.137:0/4012486820 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1053400640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1054107be0 0x7f105419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.981+0000 7f1053e00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f105410dc50 0x7f10541a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 -- 172.21.15.137:0/4012486820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1054107be0 msgr2=0x7f105419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1054107be0 0x7f105419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 -- 172.21.15.137:0/4012486820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f105410dc50 msgr2=0x7f10541a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f105410dc50 0x7f10541a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 -- 172.21.15.137:0/4012486820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541a34c0 con 0x7f1054108580 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f104aa00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c03f030 con 0x7f1054108580 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f103c0044c0 con 0x7f1054108580 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c035070 con 0x7f1054108580 2024-04-25T02:20:36.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541a3750 con 0x7f1054108580 2024-04-25T02:20:36.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.982+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541ab040 con 0x7f1054108580 2024-04-25T02:20:36.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.983+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10540688d0 con 0x7f1054108580 2024-04-25T02:20:36.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.985+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f103c042030 con 0x7f1054108580 2024-04-25T02:20:36.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.987+0000 7f1050c00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 0x7f10380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:36.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.987+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7f103c0ef7a0 con 0x7f1054108580 2024-04-25T02:20:36.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.987+0000 7f1053400640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 0x7f10380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:36.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.988+0000 7f1053400640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 0x7f10380a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1044009bd0 tx=0x7f1044005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:36.991+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f103c0bc360 con 0x7f1054108580 2024-04-25T02:20:37.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:36 smithi174 ceph-mon[33171]: pgmap v340: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:37.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:36 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/112089799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:37.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.213+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f105419f820 con 0x7f1054108580 2024-04-25T02:20:37.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.215+0000 7f1050c00640 1 -- 172.21.15.137:0/4012486820 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7f103c0bbc60 con 0x7f1054108580 2024-04-25T02:20:37.219 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:20:37.219 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14388,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3709487068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3709487068},{"type":"v1","addr":"172.21.15.137:6835","nonce":3709487068}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14400,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3865493572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3865493572},{"type":"v1","addr":"172.21.15.137:6837","nonce":3865493572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14454,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6839/4129277647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6838","nonce":4129277647},{"type":"v1","addr":"172.21.15.137:6839","nonce":4129277647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14466,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6841/3132066952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6840","nonce":3132066952},{"type":"v1","addr":"172.21.15.137:6841","nonce":3132066952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24440,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6833/1032553485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":1032553485},{"type":"v1","addr":"172.21.15.163:6833","nonce":1032553485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/82630736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":82630736},{"type":"v1","addr":"172.21.15.174:6833","nonce":82630736}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T02:07:18.852775+0000","modified":"2024-04-25T02:15:25.652008+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24559,"mds_2":24538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6835/2970303147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":2970303147},{"type":"v1","addr":"172.21.15.163:6835","nonce":2970303147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6837/432820443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":432820443},{"type":"v1","addr":"172.21.15.163:6837","nonce":432820443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/1300618267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1300618267},{"type":"v1","addr":"172.21.15.174:6835","nonce":1300618267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":72,"addr":"172.21.15.174:6837/1033703342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":1033703342},{"type":"v1","addr":"172.21.15.174:6837","nonce":1033703342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":70,"addr":"172.21.15.174:6839/695835924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":695835924},{"type":"v1","addr":"172.21.15.174:6839","nonce":695835924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6839/2170091547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":2170091547},{"type":"v1","addr":"172.21.15.163:6839","nonce":2170091547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24559]},"id":1}]} 2024-04-25T02:20:37.219 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 32 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 msgr2=0x7f10380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 0x7f10380a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1044009bd0 tx=0x7f1044005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 msgr2=0x7f105419ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f103c006010 tx=0x7f103c0040c0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 shutdown_connections 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f10380a2d00 0x7f10380a51c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f105410dc50 0x7f10541a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1054108580 0x7f105419ea10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 --2- 172.21.15.137:0/4012486820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1054107be0 0x7f105419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.217+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 >> 172.21.15.137:0/4012486820 conn(0x7f10540772c0 msgr2=0x7f10540789f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:37.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.218+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 shutdown_connections 2024-04-25T02:20:37.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.218+0000 7f1058a00640 1 -- 172.21.15.137:0/4012486820 wait complete. 2024-04-25T02:20:37.235 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:36 smithi137 ceph-mon[28303]: pgmap v340: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:37.235 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:36 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/112089799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:37.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:37.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:36 smithi163 ceph-mon[32577]: pgmap v340: 97 pgs: 97 active+clean; 19 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-25T02:20:37.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:36 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/112089799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:37.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 -- 172.21.15.137:0/3331194939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb554069290 msgr2=0x7fb55410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 --2- 172.21.15.137:0/3331194939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb554069290 0x7fb55410e3b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009cd0 tx=0x7fb54c02a8e0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 -- 172.21.15.137:0/3331194939 shutdown_connections 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 --2- 172.21.15.137:0/3331194939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb554069290 0x7fb55410e3b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 --2- 172.21.15.137:0/3331194939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 0x7fb554068d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 --2- 172.21.15.137:0/3331194939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb5541075f0 0x7fb5541079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 -- 172.21.15.137:0/3331194939 >> 172.21.15.137:0/3331194939 conn(0x7fb554075f80 msgr2=0x7fb554076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 -- 172.21.15.137:0/3331194939 shutdown_connections 2024-04-25T02:20:37.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.411+0000 7fb559600640 1 -- 172.21.15.137:0/3331194939 wait complete. 2024-04-25T02:20:37.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 Processor -- start 2024-04-25T02:20:37.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 -- start start 2024-04-25T02:20:37.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 0x7fb554197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb554069290 0x7fb554198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb554111a70 con 0x7fb5541075f0 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fb5541118f0 con 0x7fb554069290 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.412+0000 7fb559600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb554111bf0 con 0x7fb5540688d0 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46514/0 (socket says 172.21.15.137:46514) 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 -- 172.21.15.137:0/2336191425 learned_addr learned my addr 172.21.15.137:0/2336191425 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb553e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 0x7fb554197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb54be00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb554069290 0x7fb554198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 -- 172.21.15.137:0/2336191425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 msgr2=0x7fb554197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 0x7fb554197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 -- 172.21.15.137:0/2336191425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb554069290 msgr2=0x7fb554198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb554069290 0x7fb554198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 -- 172.21.15.137:0/2336191425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55419ce00 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.413+0000 7fb558c00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009ca0 tx=0x7fb54c003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.414+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c031bc0 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.414+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb54c031d60 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.414+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c030b90 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.414+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55419d090 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.414+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5541a4980 con 0x7fb5541075f0 2024-04-25T02:20:37.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.415+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb554068480 con 0x7fb5541075f0 2024-04-25T02:20:37.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.417+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fb54c0046b0 con 0x7fb5541075f0 2024-04-25T02:20:37.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.419+0000 7fb551600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 0x7fb5380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.419+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7fb54c02e030 con 0x7fb5541075f0 2024-04-25T02:20:37.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.419+0000 7fb553e00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 0x7fb5380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.420+0000 7fb553e00640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 0x7fb5380a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5540774e0 tx=0x7fb544005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.423+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fb54c0bd020 con 0x7fb5541075f0 2024-04-25T02:20:37.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.621+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5541099a0 con 0x7fb5541075f0 2024-04-25T02:20:37.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.624+0000 7fb551600640 1 -- 172.21.15.137:0/2336191425 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+23149 (secure 0 0 0) 0x7fb54c0bc920 con 0x7fb5541075f0 2024-04-25T02:20:37.627 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-25T02:20:37.628 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":98,"fsid":"19106f5e-02a7-11ef-bc93-c7b262605968","created":"2024-04-25T01:58:20.233191+0000","modified":"2024-04-25T02:20:12.664864+0000","last_up_change":"2024-04-25T02:06:17.900332+0000","last_in_change":"2024-04-25T02:05:56.915885+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:02:10.947973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:07:17.190881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T02:07:18.334399+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9e559d91-361d-49dd-8183-384013ae9660","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6803","nonce":3540238189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6805","nonce":3540238189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6809","nonce":3540238189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":3540238189},{"type":"v1","addr":"172.21.15.137:6807","nonce":3540238189}]},"public_addr":"172.21.15.137:6803/3540238189","cluster_addr":"172.21.15.137:6805/3540238189","heartbeat_back_addr":"172.21.15.137:6809/3540238189","heartbeat_front_addr":"172.21.15.137:6807/3540238189","state":["exists","up"]},{"osd":1,"uuid":"30f001bf-a25c-4c29-be9a-d5b9c20ff743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6801","nonce":1976154605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6803","nonce":1976154605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6807","nonce":1976154605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1976154605},{"type":"v1","addr":"172.21.15.163:6805","nonce":1976154605}]},"public_addr":"172.21.15.163:6801/1976154605","cluster_addr":"172.21.15.163:6803/1976154605","heartbeat_back_addr":"172.21.15.163:6807/1976154605","heartbeat_front_addr":"172.21.15.163:6805/1976154605","state":["exists","up"]},{"osd":2,"uuid":"d1acbadd-93be-4154-b3c1-1fb8b007154b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6801","nonce":2383666582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6803","nonce":2383666582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6807","nonce":2383666582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":2383666582},{"type":"v1","addr":"172.21.15.174:6805","nonce":2383666582}]},"public_addr":"172.21.15.174:6801/2383666582","cluster_addr":"172.21.15.174:6803/2383666582","heartbeat_back_addr":"172.21.15.174:6807/2383666582","heartbeat_front_addr":"172.21.15.174:6805/2383666582","state":["exists","up"]},{"osd":3,"uuid":"e53d03ce-79d0-490e-b2d7-6767e008fa8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6811","nonce":2967583331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6813","nonce":2967583331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6817","nonce":2967583331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":2967583331},{"type":"v1","addr":"172.21.15.137:6815","nonce":2967583331}]},"public_addr":"172.21.15.137:6811/2967583331","cluster_addr":"172.21.15.137:6813/2967583331","heartbeat_back_addr":"172.21.15.137:6817/2967583331","heartbeat_front_addr":"172.21.15.137:6815/2967583331","state":["exists","up"]},{"osd":4,"uuid":"3d77d217-ffdb-41c9-aeb0-ee27621608dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6809","nonce":2824580331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6811","nonce":2824580331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6815","nonce":2824580331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2824580331},{"type":"v1","addr":"172.21.15.163:6813","nonce":2824580331}]},"public_addr":"172.21.15.163:6809/2824580331","cluster_addr":"172.21.15.163:6811/2824580331","heartbeat_back_addr":"172.21.15.163:6815/2824580331","heartbeat_front_addr":"172.21.15.163:6813/2824580331","state":["exists","up"]},{"osd":5,"uuid":"e4948650-970a-4d7d-ad93-1735d9fffdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6809","nonce":586542310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6811","nonce":586542310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6815","nonce":586542310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":586542310},{"type":"v1","addr":"172.21.15.174:6813","nonce":586542310}]},"public_addr":"172.21.15.174:6809/586542310","cluster_addr":"172.21.15.174:6811/586542310","heartbeat_back_addr":"172.21.15.174:6815/586542310","heartbeat_front_addr":"172.21.15.174:6813/586542310","state":["exists","up"]},{"osd":6,"uuid":"e22c068f-0298-47f3-a90b-8735effc8206","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6819","nonce":2828658472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6821","nonce":2828658472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6825","nonce":2828658472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":2828658472},{"type":"v1","addr":"172.21.15.137:6823","nonce":2828658472}]},"public_addr":"172.21.15.137:6819/2828658472","cluster_addr":"172.21.15.137:6821/2828658472","heartbeat_back_addr":"172.21.15.137:6825/2828658472","heartbeat_front_addr":"172.21.15.137:6823/2828658472","state":["exists","up"]},{"osd":7,"uuid":"967eb934-6a0b-4f22-8bc7-5c0da457ffd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6817","nonce":1494568625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6819","nonce":1494568625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6823","nonce":1494568625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":1494568625},{"type":"v1","addr":"172.21.15.163:6821","nonce":1494568625}]},"public_addr":"172.21.15.163:6817/1494568625","cluster_addr":"172.21.15.163:6819/1494568625","heartbeat_back_addr":"172.21.15.163:6823/1494568625","heartbeat_front_addr":"172.21.15.163:6821/1494568625","state":["exists","up"]},{"osd":8,"uuid":"574d3bea-4097-4bf7-ac49-a60fbe0b1f7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6817","nonce":2804246192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6819","nonce":2804246192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6823","nonce":2804246192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2804246192},{"type":"v1","addr":"172.21.15.174:6821","nonce":2804246192}]},"public_addr":"172.21.15.174:6817/2804246192","cluster_addr":"172.21.15.174:6819/2804246192","heartbeat_back_addr":"172.21.15.174:6823/2804246192","heartbeat_front_addr":"172.21.15.174:6821/2804246192","state":["exists","up"]},{"osd":9,"uuid":"53182274-54d4-4bf5-a2da-0edf8abc688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6826","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6827","nonce":2280455179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6829","nonce":2280455179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6833","nonce":2280455179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":2280455179},{"type":"v1","addr":"172.21.15.137:6831","nonce":2280455179}]},"public_addr":"172.21.15.137:6827/2280455179","cluster_addr":"172.21.15.137:6829/2280455179","heartbeat_back_addr":"172.21.15.137:6833/2280455179","heartbeat_front_addr":"172.21.15.137:6831/2280455179","state":["exists","up"]},{"osd":10,"uuid":"e169cc70-dd4a-44da-966d-8cf065db66d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6825","nonce":2960962752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6827","nonce":2960962752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6831","nonce":2960962752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":2960962752},{"type":"v1","addr":"172.21.15.163:6829","nonce":2960962752}]},"public_addr":"172.21.15.163:6825/2960962752","cluster_addr":"172.21.15.163:6827/2960962752","heartbeat_back_addr":"172.21.15.163:6831/2960962752","heartbeat_front_addr":"172.21.15.163:6829/2960962752","state":["exists","up"]},{"osd":11,"uuid":"64dcd982-78ef-4b76-9014-0a2b668457fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6825","nonce":2420568301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6827","nonce":2420568301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6831","nonce":2420568301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":2420568301},{"type":"v1","addr":"172.21.15.174:6829","nonce":2420568301}]},"public_addr":"172.21.15.174:6825/2420568301","cluster_addr":"172.21.15.174:6827/2420568301","heartbeat_back_addr":"172.21.15.174:6831/2420568301","heartbeat_front_addr":"172.21.15.174:6829/2420568301","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:17.927056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:01:42.972633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:06.978494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:02:39.158660+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:04.131667+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:03:28.555496+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:01.122791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:26.488032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:04:51.559470+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:24.271164+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:05:49.638914+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:06:15.261987+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6801/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/205966009":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/652761516":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/2811873727":"2024-04-26T01:59:26.231648+0000","172.21.15.137:6801/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/16164329":"2024-04-26T02:09:41.978067+0000","172.21.15.137:6800/1454150812":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/3398591634":"2024-04-26T01:59:26.231648+0000","172.21.15.137:0/1248132211":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6801/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/3780953419":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/4170175592":"2024-04-26T01:58:53.335832+0000","172.21.15.137:6800/3009931509":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/797325498":"2024-04-26T01:58:53.335832+0000","172.21.15.137:0/1200236983":"2024-04-26T02:09:41.978067+0000","172.21.15.137:0/1909466669":"2024-04-26T01:59:26.231648+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:20:37.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 msgr2=0x7fb5380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 0x7fb5380a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5540774e0 tx=0x7fb544005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 msgr2=0x7fb55419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009ca0 tx=0x7fb54c003ea0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 shutdown_connections 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fb5380a2d00 0x7fb5380a51c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5541075f0 0x7fb55419c6d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb554069290 0x7fb554198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 --2- 172.21.15.137:0/2336191425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5540688d0 0x7fb554197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 >> 172.21.15.137:0/2336191425 conn(0x7fb554075f80 msgr2=0x7fb5540ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 shutdown_connections 2024-04-25T02:20:37.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.627+0000 7fb559600640 1 -- 172.21.15.137:0/2336191425 wait complete. 2024-04-25T02:20:37.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 -- 172.21.15.137:0/35905299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 msgr2=0x7fa5c0110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/35905299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c0110270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009ca0 tx=0x7fa5b802a950 comp rx=0 tx=0).stop 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 -- 172.21.15.137:0/35905299 shutdown_connections 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/35905299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c0110270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/35905299 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0074490 0x7fa5c010d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/35905299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0073b70 0x7fa5c0073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 -- 172.21.15.137:0/35905299 >> 172.21.15.137:0/35905299 conn(0x7fa5c00fd110 msgr2=0x7fa5c00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 -- 172.21.15.137:0/35905299 shutdown_connections 2024-04-25T02:20:37.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.822+0000 7fa5bfe00640 1 -- 172.21.15.137:0/35905299 wait complete. 2024-04-25T02:20:37.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.823+0000 7fa5bfe00640 1 Processor -- start 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.823+0000 7fa5bfe00640 1 -- start start 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 0x7fa5c019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0113d30 con 0x7fa5c010de20 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0113bb0 con 0x7fa5c0073b70 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bfe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0113eb0 con 0x7fa5c0074490 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bea00640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.137:59768/0 (socket says 172.21.15.137:59768) 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bea00640 1 -- 172.21.15.137:0/4061221105 learned_addr learned my addr 172.21.15.137:0/4061221105 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5be000640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 0x7fa5c019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 -- 172.21.15.137:0/4061221105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 msgr2=0x7fa5c019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 0x7fa5c019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 -- 172.21.15.137:0/4061221105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 msgr2=0x7fa5c019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5bf400640 1 -- 172.21.15.137:0/4061221105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c019f0e0 con 0x7fa5c010de20 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.824+0000 7fa5be000640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 0x7fa5c019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5bea00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5bf400640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c019e9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5b802af40 tx=0x7fa5b802fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8034040 con 0x7fa5c010de20 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5b8030940 con 0x7fa5c010de20 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c019f370 con 0x7fa5c010de20 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8004780 con 0x7fa5c010de20 2024-04-25T02:20:37.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.825+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c01a6c60 con 0x7fa5c010de20 2024-04-25T02:20:37.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.826+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c0068480 con 0x7fa5c010de20 2024-04-25T02:20:37.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.828+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fa5b8037020 con 0x7fa5c010de20 2024-04-25T02:20:37.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.830+0000 7fa5b7400640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 0x7fa5a40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:37.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.830+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8513+0+0 (secure 0 0 0) 0x7fa5b80f00e0 con 0x7fa5c010de20 2024-04-25T02:20:37.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.830+0000 7fa5bea00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 0x7fa5a40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:37.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.831+0000 7fa5bea00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 0x7fa5a40a51c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0011550 tx=0x7fa5b0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:37.834+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7fa5b80bcdb0 con 0x7fa5c010de20 2024-04-25T02:20:38.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.079+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa5c01a6e30 con 0x7fa5c010de20 2024-04-25T02:20:38.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.083+0000 7fa5b7400640 1 -- 172.21.15.137:0/4061221105 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7fa5b80bc6b0 con 0x7fa5c010de20 2024-04-25T02:20:38.087 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 msgr2=0x7fa5a40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 0x7fa5a40a51c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0011550 tx=0x7fa5b0005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 msgr2=0x7fa5c019e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c019e9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5b802af40 tx=0x7fa5b802fc30 comp rx=0 tx=0).stop 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 shutdown_connections 2024-04-25T02:20:38.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7fa5a40a2d00 0x7fa5a40a51c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5c010de20 0x7fa5c019e9b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5c0074490 0x7fa5c019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 --2- 172.21.15.137:0/4061221105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5c0073b70 0x7fa5c019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 >> 172.21.15.137:0/4061221105 conn(0x7fa5c00fd110 msgr2=0x7fa5c0110040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 shutdown_connections 2024-04-25T02:20:38.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.087+0000 7fa5bfe00640 1 -- 172.21.15.137:0/4061221105 wait complete. 2024-04-25T02:20:38.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:20:38.164 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:37 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4012486820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.164 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:37 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/2336191425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.164 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:20:38.081+0000 7fc1a3000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:20:38.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:37 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4012486820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:37 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/2336191425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.174 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mds[63376]: -- 172.21.15.174:0/4177390717 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afb2d41a40 con 0x55afb2d14c00 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: starting mds.f at 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mds[63685]: -- 172.21.15.174:0/1877458485 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645cc30ba40 con 0x5645cc2dec00 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: starting mds.c at 2024-04-25T02:20:38.175 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.176 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.176 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: starting mds.i at 2024-04-25T02:20:38.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 -- 172.21.15.137:0/2641204446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 msgr2=0x7f3ee0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 --2- 172.21.15.137:0/2641204446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee0107ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009900 tx=0x7f3ed002a3f0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 -- 172.21.15.137:0/2641204446 shutdown_connections 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 --2- 172.21.15.137:0/2641204446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01020b0 0x7f3ee010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 --2- 172.21.15.137:0/2641204446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01016f0 0x7f3ee0101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 --2- 172.21.15.137:0/2641204446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee0107ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 -- 172.21.15.137:0/2641204446 >> 172.21.15.137:0/2641204446 conn(0x7f3ee00fd1c0 msgr2=0x7f3ee00ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 -- 172.21.15.137:0/2641204446 shutdown_connections 2024-04-25T02:20:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.291+0000 7f3ee5800640 1 -- 172.21.15.137:0/2641204446 wait complete. 2024-04-25T02:20:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.292+0000 7f3ee5800640 1 Processor -- start 2024-04-25T02:20:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.292+0000 7f3ee5800640 1 -- start start 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01016f0 0x7f3ee01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0111c30 con 0x7f3ee01016f0 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0111ab0 con 0x7f3ee0107700 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ee5800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee0111db0 con 0x7f3ee01020b0 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ede000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3edea00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01016f0 0x7f3ee01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3edf400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ede000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:56376/0 (socket says 172.21.15.137:56376) 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.293+0000 7f3ede000640 1 -- 172.21.15.137:0/1736211561 learned_addr learned my addr 172.21.15.137:0/1736211561 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 -- 172.21.15.137:0/1736211561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 msgr2=0x7f3ee0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 -- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01016f0 msgr2=0x7f3ee01981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01016f0 0x7f3ee01981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 -- 172.21.15.137:0/1736211561 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee019d1e0 con 0x7f3ee0107700 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ede000640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3edf400640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee019cab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800da10 tx=0x7f3ed800ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800bd70 con 0x7f3ee0107700 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ed8004030 con 0x7f3ee0107700 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee019d4d0 con 0x7f3ee0107700 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80107e0 con 0x7f3ee0107700 2024-04-25T02:20:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.294+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee01a4d60 con 0x7f3ee0107700 2024-04-25T02:20:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.296+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee0067cd0 con 0x7f3ee0107700 2024-04-25T02:20:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.297+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f3ed80041e0 con 0x7f3ee0107700 2024-04-25T02:20:38.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.299+0000 7f3ed7400640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 0x7f3ec40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:38.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.299+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8727+0+0 (secure 0 0 0) 0x7f3ed80cf810 con 0x7f3ee0107700 2024-04-25T02:20:38.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.299+0000 7f3edea00640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 0x7f3ec40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.300+0000 7f3edea00640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 0x7f3ec40a51c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009230 tx=0x7f3ed00058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:38.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.303+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f3ed809c300 con 0x7f3ee0107700 2024-04-25T02:20:38.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:37 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4012486820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:37 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/2336191425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T02:20:38.389 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mds[62367]: -- 172.21.15.163:0/2827595754 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577be533a40 con 0x5577be506c00 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: starting mds.h at 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mds[62053]: -- 172.21.15.163:0/2556376068 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e178fb7a40 con 0x55e178f8a800 2024-04-25T02:20:38.390 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: starting mds.e at 2024-04-25T02:20:38.391 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: ignoring --setuser ceph since I am not root 2024-04-25T02:20:38.391 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: ignoring --setgroup ceph since I am not root 2024-04-25T02:20:38.391 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mds[62677]: -- 172.21.15.163:0/3200466575 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c070447a40 con 0x55c07041a800 2024-04-25T02:20:38.391 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: starting mds.b at 2024-04-25T02:20:38.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:38.550+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3ee0109c60 con 0x7f3ee0107700 2024-04-25T02:20:39.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.099+0000 7f3ed7400640 1 -- 172.21.15.137:0/1736211561 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f3ed809bc00 con 0x7f3ee0107700 2024-04-25T02:20:39.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.103+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 msgr2=0x7f3ec40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.103+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 0x7f3ec40a51c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009230 tx=0x7f3ed00058d0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.103+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 msgr2=0x7f3ee019cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.103+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee019cab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800da10 tx=0x7f3ed800ded0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 shutdown_connections 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f3ec40a2d00 0x7f3ec40a51c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ee0107700 0x7f3ee019cab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ee01020b0 0x7f3ee0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 --2- 172.21.15.137:0/1736211561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ee01016f0 0x7f3ee01981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 >> 172.21.15.137:0/1736211561 conn(0x7f3ee00fd1c0 msgr2=0x7f3ee00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.104+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 shutdown_connections 2024-04-25T02:20:39.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.105+0000 7f3ee5800640 1 -- 172.21.15.137:0/1736211561 wait complete. 2024-04-25T02:20:39.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T02:20:39.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:20:39.126 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: pgmap v342: 97 pgs: 97 active+clean; 19 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1736211561' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.127 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:38 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.129 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:20:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T02:20:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:20:39.174 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: pgmap v342: 97 pgs: 97 active+clean; 19 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1736211561' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:38 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 -- 172.21.15.137:0/1276452959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400107680 msgr2=0x7f1400107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 --2- 172.21.15.137:0/1276452959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400107680 0x7f1400107a60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009cd0 tx=0x7f13f802a8f0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 -- 172.21.15.137:0/1276452959 shutdown_connections 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 --2- 172.21.15.137:0/1276452959 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1400101fa0 0x7f140010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 --2- 172.21.15.137:0/1276452959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14001015e0 0x7f1400101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 --2- 172.21.15.137:0/1276452959 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400107680 0x7f1400107a60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 -- 172.21.15.137:0/1276452959 >> 172.21.15.137:0/1276452959 conn(0x7f14000fd110 msgr2=0x7f14000ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:39.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 -- 172.21.15.137:0/1276452959 shutdown_connections 2024-04-25T02:20:39.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.331+0000 7f1406400640 1 -- 172.21.15.137:0/1276452959 wait complete. 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.332+0000 7f1406400640 1 Processor -- start 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.332+0000 7f1406400640 1 -- start start 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 0x7f140019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400101fa0 0x7f140019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 0x7f140019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1400111b70 con 0x7f1400107680 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f14001119f0 con 0x7f14001015e0 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1406400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1400111cf0 con 0x7f1400101fa0 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1405a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 0x7f140019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1405000640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 0x7f140019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1405a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 0x7f140019ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46572/0 (socket says 172.21.15.137:46572) 2024-04-25T02:20:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f1405a00640 1 -- 172.21.15.137:0/3808613858 learned_addr learned my addr 172.21.15.137:0/3808613858 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.333+0000 7f13ffe00640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400101fa0 0x7f140019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 -- 172.21.15.137:0/3808613858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400101fa0 msgr2=0x7f140019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400101fa0 0x7f140019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 -- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 msgr2=0x7f140019ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 0x7f140019ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 -- 172.21.15.137:0/3808613858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140019f190 con 0x7f14001015e0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1405000640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 0x7f140019a1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f802ae10 tx=0x7f13f8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8030e10 con 0x7f14001015e0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140019f420 con 0x7f14001015e0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13f8040070 con 0x7f14001015e0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8045c30 con 0x7f14001015e0 2024-04-25T02:20:39.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.334+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14001a6d10 con 0x7f14001015e0 2024-04-25T02:20:39.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.335+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1400068480 con 0x7f14001015e0 2024-04-25T02:20:39.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.337+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f13f8004b40 con 0x7f14001015e0 2024-04-25T02:20:39.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.339+0000 7f13fd600640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 0x7f13e40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:39.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.339+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8727+0+0 (secure 0 0 0) 0x7f13f80f0670 con 0x7f14001015e0 2024-04-25T02:20:39.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.339+0000 7f13ffe00640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 0x7f13e40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:39.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.340+0000 7f13ffe00640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 0x7f13e40a5240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e80095f0 tx=0x7f13e8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:39.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.341+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f13f80bd300 con 0x7f14001015e0 2024-04-25T02:20:39.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-25T02:20:39.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T02:20:39.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:20:39.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-04-25T02:20:39.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/4061221105' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-25T02:20:39.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: osdmap e99: 12 total, 12 up, 12 in 2024-04-25T02:20:39.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-25T02:20:39.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: pgmap v342: 97 pgs: 97 active+clean; 19 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 614 B/s wr, 6 op/s 2024-04-25T02:20:39.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1736211561' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:38 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T02:20:39.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:39.546+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f14001a6ee0 con 0x7f14001015e0 2024-04-25T02:20:40.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.102+0000 7f13fd600640 1 -- 172.21.15.137:0/3808613858 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) ==== 181+0+0 (secure 0 0 0) 0x7f13f80bcc00 con 0x7f14001015e0 2024-04-25T02:20:40.106 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:20:40.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 msgr2=0x7f13e40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:40.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 0x7f13e40a5240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13e80095f0 tx=0x7f13e8005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:40.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 msgr2=0x7f140019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:40.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 0x7f140019a1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f802ae10 tx=0x7f13f8003f10 comp rx=0 tx=0).stop 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 shutdown_connections 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f13e40a2d80 0x7f13e40a5240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1400107680 0x7f140019ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1400101fa0 0x7f140019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 --2- 172.21.15.137:0/3808613858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f14001015e0 0x7f140019a1a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.108+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 >> 172.21.15.137:0/3808613858 conn(0x7f14000fd110 msgr2=0x7f140010c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.109+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 shutdown_connections 2024-04-25T02:20:40.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.109+0000 7f1406400640 1 -- 172.21.15.137:0/3808613858 wait complete. 2024-04-25T02:20:40.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: Cluster is now healthy 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:20:40.175 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6835/480123477,v1:172.21.15.163:6837/480123477] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6834/1537719892,v1:172.21.15.163:6836/1537719892] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6834/1344408610,v1:172.21.15.174:6837/1344408610] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6836/1354857274,v1:172.21.15.174:6839/1354857274] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.174:6835/2575709048,v1:172.21.15.174:6838/2575709048] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: mds.? [v2:172.21.15.163:6838/2144981761,v1:172.21.15.163:6839/2144981761] up:boot 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: fsmap 12 up:standby 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/3808613858' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.176 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:39 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:20:40.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:20:40.193 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: Cluster is now healthy 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6835/480123477,v1:172.21.15.163:6837/480123477] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6834/1537719892,v1:172.21.15.163:6836/1537719892] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6834/1344408610,v1:172.21.15.174:6837/1344408610] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6836/1354857274,v1:172.21.15.174:6839/1354857274] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.174:6835/2575709048,v1:172.21.15.174:6838/2575709048] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: mds.? [v2:172.21.15.163:6838/2144981761,v1:172.21.15.163:6839/2144981761] up:boot 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: fsmap 12 up:standby 2024-04-25T02:20:40.194 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/3808613858' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.195 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:39 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 -- 172.21.15.137:0/3199913099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81015e0 msgr2=0x7f25a8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 --2- 172.21.15.137:0/3199913099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81015e0 0x7f25a8101a60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2590009930 tx=0x7f259002a420 comp rx=0 tx=0).stop 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 -- 172.21.15.137:0/3199913099 shutdown_connections 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 --2- 172.21.15.137:0/3199913099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8101fa0 0x7f25a810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 --2- 172.21.15.137:0/3199913099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a81015e0 0x7f25a8101a60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 --2- 172.21.15.137:0/3199913099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a8107680 0x7f25a8107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 -- 172.21.15.137:0/3199913099 >> 172.21.15.137:0/3199913099 conn(0x7f25a80fd110 msgr2=0x7f25a80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 -- 172.21.15.137:0/3199913099 shutdown_connections 2024-04-25T02:20:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.326+0000 7f25ad200640 1 -- 172.21.15.137:0/3199913099 wait complete. 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.327+0000 7f25ad200640 1 Processor -- start 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.327+0000 7f25ad200640 1 -- start start 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 0x7f25a819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 0x7f25a819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8111b20 con 0x7f25a8101fa0 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 -- 0x7f25a81119a0 con 0x7f25a81015e0 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25ad200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8111ca0 con 0x7f25a8107680 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a6a00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 0x7f25a819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:40.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7400640 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 0x7f25a819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.137:56398/0 (socket says 172.21.15.137:56398) 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 -- 172.21.15.137:0/1261706241 learned_addr learned my addr 172.21.15.137:0/1261706241 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 -- 172.21.15.137:0/1261706241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 msgr2=0x7f25a819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 0x7f25a819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 -- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 msgr2=0x7f25a819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 0x7f25a819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7e00640 1 -- 172.21.15.137:0/1261706241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a819f160 con 0x7f25a8107680 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a7400640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 0x7f25a819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.328+0000 7f25a6a00640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 0x7f25a819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f25a7e00640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25a000eb10 tx=0x7f25a000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004b20 con 0x7f25a8107680 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a819f450 con 0x7f25a8107680 2024-04-25T02:20:40.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a0004cc0 con 0x7f25a8107680 2024-04-25T02:20:40.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a00107f0 con 0x7f25a8107680 2024-04-25T02:20:40.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.329+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a81a6ce0 con 0x7f25a8107680 2024-04-25T02:20:40.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.330+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a8068480 con 0x7f25a8107680 2024-04-25T02:20:40.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.332+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f25a0005020 con 0x7f25a8107680 2024-04-25T02:20:40.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.334+0000 7f259fe00640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 0x7f258c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:20:40.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.334+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8202+0+0 (secure 0 0 0) 0x7f25a00cf830 con 0x7f25a8107680 2024-04-25T02:20:40.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.334+0000 7f25a7400640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 0x7f258c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:20:40.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.335+0000 7f25a7400640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 0x7f258c0a5240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25a8102720 tx=0x7f2598005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:40.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.342+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186147 (secure 0 0 0) 0x7f25a009c530 con 0x7f25a8107680 2024-04-25T02:20:40.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T02:20:40.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T02:20:40.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: Cluster is now healthy 2024-04-25T02:20:40.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-25T02:20:40.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='mgr.15126 172.21.15.137:0/3318231148' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6835/480123477,v1:172.21.15.163:6837/480123477] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6834/1537719892,v1:172.21.15.163:6836/1537719892] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6834/1344408610,v1:172.21.15.174:6837/1344408610] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6836/1354857274,v1:172.21.15.174:6839/1354857274] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.174:6835/2575709048,v1:172.21.15.174:6838/2575709048] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: mds.? [v2:172.21.15.163:6838/2144981761,v1:172.21.15.163:6839/2144981761] up:boot 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: fsmap 12 up:standby 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/3808613858' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:39 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:40.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:40.543+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25a81a6f40 con 0x7f25a8107680 2024-04-25T02:20:41.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.112+0000 7f259fe00640 1 -- 172.21.15.137:0/1261706241 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) ==== 169+0+0 (secure 0 0 0) 0x7f25a009be30 con 0x7f25a8107680 2024-04-25T02:20:41.116 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 msgr2=0x7f258c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 0x7f258c0a5240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f25a8102720 tx=0x7f2598005f90 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 msgr2=0x7f25a819ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25a000eb10 tx=0x7f25a000c2d0 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 shutdown_connections 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:6800/3051730287,v1:172.21.15.137:6801/3051730287] conn(0x7f258c0a2d80 0x7f258c0a5240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25a8107680 0x7f25a819ea30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25a8101fa0 0x7f25a819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 --2- 172.21.15.137:0/1261706241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f25a81015e0 0x7f25a819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.116+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 >> 172.21.15.137:0/1261706241 conn(0x7f25a80fd110 msgr2=0x7f25a810d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.117+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 shutdown_connections 2024-04-25T02:20:41.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-25T02:20:41.117+0000 7f25ad200640 1 -- 172.21.15.137:0/1261706241 wait complete. 2024-04-25T02:20:41.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:20:41.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:20:41.243 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:20:41.270 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T02:20:41.270 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:20:41.326 DEBUG:teuthology.orchestra.run.smithi163:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:20:41.343 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T02:20:41.358 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T02:20:41.358 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-25T02:20:41.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a 2024-04-25T02:20:41.389 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:41 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T02:20:41.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:41 smithi163 ceph-mon[32577]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T02:20:41.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:41 smithi163 ceph-mon[32577]: pgmap v344: 65 pgs: 65 active+clean; 577 KiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:20:41.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:41 smithi163 ceph-mon[32577]: from='client.? 172.21.15.137:0/1261706241' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.390 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:41 smithi163 ceph-mon[32577]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.424 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:41 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T02:20:41.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:41 smithi174 ceph-mon[33171]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T02:20:41.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:41 smithi174 ceph-mon[33171]: pgmap v344: 65 pgs: 65 active+clean; 577 KiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:20:41.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:41 smithi174 ceph-mon[33171]: from='client.? 172.21.15.137:0/1261706241' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.425 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:41 smithi174 ceph-mon[33171]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.434 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-25T02:20:41.435 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-mon[28303]: osdmap e100: 12 total, 12 up, 12 in 2024-04-25T02:20:41.435 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-mon[28303]: pgmap v344: 65 pgs: 65 active+clean; 577 KiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-25T02:20:41.435 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-mon[28303]: from='client.? 172.21.15.137:0/1261706241' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.435 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-mon[28303]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-25T02:20:41.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 systemd[1]: Stopping Ceph mon.a for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:42.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:20:41.939+0000 7fc1a9e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:42.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a[28299]: 2024-04-25T02:20:41.940+0000 7fc1a9e00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T02:20:42.280 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:42 smithi137 podman[86065]: 2024-04-25 02:20:42.084249404 +0000 UTC m=+0.316041460 container died c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T02:20:42.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:42 smithi137 podman[86065]: 2024-04-25 02:20:42.592072905 +0000 UTC m=+0.823864937 container cleanup c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, RELEASE=squid-d2c45d9, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T02:20:42.780 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:42 smithi137 bash[86065]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a 2024-04-25T02:20:43.248 INFO:journalctl@ceph.mon.a.smithi137.stdout:Apr 25 02:20:42 smithi137 podman[86079]: 2024-04-25 02:20:42.783219136 +0000 UTC m=+0.687063784 container remove c1008860790e8bbb4dd00644fc5abdc22c5840b96176a5e2f4fbe00a6df8b2c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-25T02:20:43.280 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.a.service' 2024-04-25T02:20:43.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:43.406 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-25T02:20:43.406 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-25T02:20:43.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.b 2024-04-25T02:20:43.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:43 smithi163 systemd[1]: Stopping Ceph mon.b for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:43.973 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b[32573]: 2024-04-25T02:20:43.694+0000 7fb41f180700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:43.973 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b[32573]: 2024-04-25T02:20:43.694+0000 7fb41f180700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-25T02:20:43.973 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:43 smithi163 podman[68069]: 2024-04-25 02:20:43.787123915 +0000 UTC m=+0.186512425 container died 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:20:44.315 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:44 smithi163 podman[68069]: 2024-04-25 02:20:44.077912245 +0000 UTC m=+0.477300744 container cleanup 0bd69b21d62a5ff5abb65f7aa1c2569a3cd88e61c4e7064df714adcd0d8d54da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-25T02:20:44.315 INFO:journalctl@ceph.mon.b.smithi163.stdout:Apr 25 02:20:44 smithi163 bash[68069]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-b 2024-04-25T02:20:44.452 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.b.service' 2024-04-25T02:20:44.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:44.499 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-25T02:20:44.499 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-25T02:20:44.499 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.c 2024-04-25T02:20:44.822 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:44 smithi174 systemd[1]: Stopping Ceph mon.c for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:45.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c[33167]: 2024-04-25T02:20:44.817+0000 7fe403b5e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:45.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c[33167]: 2024-04-25T02:20:44.817+0000 7fe403b5e700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T02:20:45.172 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:44 smithi174 podman[69492]: 2024-04-25 02:20:44.889933432 +0000 UTC m=+0.200971062 container died 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:20:45.424 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:45 smithi174 podman[69492]: 2024-04-25 02:20:45.268453958 +0000 UTC m=+0.579491605 container cleanup 7c993c27c0d10d2aaaa2ef919b59dab3c1e5cc1c10cd10793cb2f0fd7da7ea53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:20:45.424 INFO:journalctl@ceph.mon.c.smithi174.stdout:Apr 25 02:20:45 smithi174 bash[69492]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mon-c 2024-04-25T02:20:45.702 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mon.c.service' 2024-04-25T02:20:45.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:45.753 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-25T02:20:45.753 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-25T02:20:45.753 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x 2024-04-25T02:20:46.107 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:45 smithi137 systemd[1]: Stopping Ceph mgr.x for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:46.422 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:20:46.326+0000 7f5c01a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:46.422 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x[28537]: 2024-04-25T02:20:46.326+0000 7f5c01a00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-25T02:20:46.714 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:46 smithi137 podman[86186]: 2024-04-25 02:20:46.419482159 +0000 UTC m=+0.246207967 container died 42dc1a9dfb2fe0960742cae7091b58f9ae43964d4a5c4e17e558c641633ab9f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T02:20:47.030 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:46 smithi137 podman[86186]: 2024-04-25 02:20:46.885966134 +0000 UTC m=+0.712691968 container cleanup 42dc1a9dfb2fe0960742cae7091b58f9ae43964d4a5c4e17e558c641633ab9f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:20:47.030 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:46 smithi137 bash[86186]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x 2024-04-25T02:20:47.530 INFO:journalctl@ceph.mgr.x.smithi137.stdout:Apr 25 02:20:47 smithi137 podman[86200]: 2024-04-25 02:20:47.137408922 +0000 UTC m=+0.705606159 container remove 42dc1a9dfb2fe0960742cae7091b58f9ae43964d4a5c4e17e558c641633ab9f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d2c45d977142e024a59b68a8f1dce8f0b9840551, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:20:47.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.x.service' 2024-04-25T02:20:47.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:47.744 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-25T02:20:47.744 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-25T02:20:47.744 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.y 2024-04-25T02:20:48.106 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:20:47 smithi163 systemd[1]: Stopping Ceph mgr.y for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:48.386 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:20:48 smithi163 podman[68192]: 2024-04-25 02:20:48.102468283 +0000 UTC m=+0.170541214 container died 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T02:20:48.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:20:48 smithi163 podman[68192]: 2024-04-25 02:20:48.457480889 +0000 UTC m=+0.525553816 container cleanup 1da1aeb9bfa2ff923eb399344bb1ee376cebad08e3f05b6091de05f1c0ba0b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-25T02:20:48.639 INFO:journalctl@ceph.mgr.y.smithi163.stdout:Apr 25 02:20:48 smithi163 bash[68192]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-y 2024-04-25T02:20:48.906 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.y.service' 2024-04-25T02:20:48.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:48.943 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-25T02:20:48.943 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-25T02:20:48.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.z 2024-04-25T02:20:49.280 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:20:48 smithi174 systemd[1]: Stopping Ceph mgr.z for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:49.560 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:20:49 smithi174 podman[69614]: 2024-04-25 02:20:49.277120119 +0000 UTC m=+0.150312798 container died b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:20:49.924 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:20:49 smithi174 podman[69614]: 2024-04-25 02:20:49.639057205 +0000 UTC m=+0.512249893 container cleanup b5a7022bd229eb101d6efcc46bc936a9e544eb694a8e57c1efff4020e28b480d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T02:20:49.924 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Apr 25 02:20:49 smithi174 bash[69614]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mgr-z 2024-04-25T02:20:50.213 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mgr.z.service' 2024-04-25T02:20:50.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:50.247 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-25T02:20:50.247 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T02:20:50.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.0 2024-04-25T02:20:50.780 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:50 smithi137 systemd[1]: Stopping Ceph osd.0 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:51.280 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0[40304]: 2024-04-25T02:20:50.821+0000 7f51e9200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:51.280 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0[40304]: 2024-04-25T02:20:50.821+0000 7f51e9200700 -1 osd.0 101 *** Got signal Terminated *** 2024-04-25T02:20:51.280 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0[40304]: 2024-04-25T02:20:50.821+0000 7f51e9200700 -1 osd.0 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:20:56.615 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:56 smithi137 podman[86307]: 2024-04-25 02:20:56.360297822 +0000 UTC m=+5.678289220 container died ada4f49a96af6e0544cc1c9a92aa269a3d1529913877517dd663b34ff08f7535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T02:20:56.945 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:56 smithi137 podman[86307]: 2024-04-25 02:20:56.756519321 +0000 UTC m=+6.074510719 container cleanup ada4f49a96af6e0544cc1c9a92aa269a3d1529913877517dd663b34ff08f7535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T02:20:56.945 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:56 smithi137 bash[86307]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0 2024-04-25T02:20:57.279 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:56 smithi137 podman[86326]: 2024-04-25 02:20:56.940946981 +0000 UTC m=+0.564960006 container remove ada4f49a96af6e0544cc1c9a92aa269a3d1529913877517dd663b34ff08f7535 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T02:20:57.861 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:57 smithi137 podman[86411]: 2024-04-25 02:20:57.574992328 +0000 UTC m=+0.123556668 container create 20131f355cde04990f40ca8ac9af3bcf86ddc9ef264bc58b31aeb89869ac38f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True) 2024-04-25T02:20:57.861 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:57 smithi137 podman[86411]: 2024-04-25 02:20:57.485180994 +0000 UTC m=+0.033745298 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:20:57.861 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:57 smithi137 podman[86411]: 2024-04-25 02:20:57.85542718 +0000 UTC m=+0.403991503 container init 20131f355cde04990f40ca8ac9af3bcf86ddc9ef264bc58b31aeb89869ac38f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:20:58.280 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:57 smithi137 podman[86411]: 2024-04-25 02:20:57.867156707 +0000 UTC m=+0.415721054 container start 20131f355cde04990f40ca8ac9af3bcf86ddc9ef264bc58b31aeb89869ac38f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:20:58.280 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:57 smithi137 podman[86411]: 2024-04-25 02:20:57.96091969 +0000 UTC m=+0.509484083 container attach 20131f355cde04990f40ca8ac9af3bcf86ddc9ef264bc58b31aeb89869ac38f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-25T02:20:58.578 INFO:journalctl@ceph.osd.0.smithi137.stdout:Apr 25 02:20:58 smithi137 podman[86411]: 2024-04-25 02:20:58.314510057 +0000 UTC m=+0.863074404 container died 20131f355cde04990f40ca8ac9af3bcf86ddc9ef264bc58b31aeb89869ac38f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T02:20:58.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T02:20:59.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:20:59.043 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T02:20:59.043 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T02:20:59.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.1 2024-04-25T02:20:59.365 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:20:59 smithi163 systemd[1]: Stopping Ceph osd.1 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:20:59.639 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:20:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:20:59.361+0000 7f7e8ded5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:20:59.639 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:20:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:20:59.361+0000 7f7e8ded5700 -1 osd.1 101 *** Got signal Terminated *** 2024-04-25T02:20:59.639 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:20:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1[37228]: 2024-04-25T02:20:59.361+0000 7f7e8ded5700 -1 osd.1 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:05.049 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:04 smithi163 podman[68330]: 2024-04-25 02:21:04.762138278 +0000 UTC m=+5.526745166 container died 5ba846fd70ccff3f6f3c9d44a59d595a5bf1f9e8c5d4ec7678b91a5f6bc61be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-25T02:21:05.389 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68330]: 2024-04-25 02:21:05.120428856 +0000 UTC m=+5.885035738 container cleanup 5ba846fd70ccff3f6f3c9d44a59d595a5bf1f9e8c5d4ec7678b91a5f6bc61be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:05.389 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 bash[68330]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1 2024-04-25T02:21:05.703 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68349]: 2024-04-25 02:21:05.388931972 +0000 UTC m=+0.616849909 container remove 5ba846fd70ccff3f6f3c9d44a59d595a5bf1f9e8c5d4ec7678b91a5f6bc61be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0) 2024-04-25T02:21:05.956 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68440]: 2024-04-25 02:21:05.603663197 +0000 UTC m=+0.018336518 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:05.956 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68440]: 2024-04-25 02:21:05.731550639 +0000 UTC m=+0.146224008 container create 4cea863f6ce08a2623732045fc7862a4cd68ff5215860c34d1f31536231b1639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:05.956 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68440]: 2024-04-25 02:21:05.950309584 +0000 UTC m=+0.364982891 container init 4cea863f6ce08a2623732045fc7862a4cd68ff5215860c34d1f31536231b1639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-25T02:21:05.956 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:05 smithi163 podman[68440]: 2024-04-25 02:21:05.953429387 +0000 UTC m=+0.368102697 container start 4cea863f6ce08a2623732045fc7862a4cd68ff5215860c34d1f31536231b1639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-25T02:21:06.246 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:06 smithi163 podman[68440]: 2024-04-25 02:21:06.050461815 +0000 UTC m=+0.465135141 container attach 4cea863f6ce08a2623732045fc7862a4cd68ff5215860c34d1f31536231b1639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-25T02:21:06.518 INFO:journalctl@ceph.osd.1.smithi163.stdout:Apr 25 02:21:06 smithi163 podman[68440]: 2024-04-25 02:21:06.243377943 +0000 UTC m=+0.658051251 container died 4cea863f6ce08a2623732045fc7862a4cd68ff5215860c34d1f31536231b1639 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:06.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T02:21:06.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:06.897 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T02:21:06.898 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T02:21:06.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.2 2024-04-25T02:21:07.174 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:06 smithi174 systemd[1]: Stopping Ceph osd.2 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:07.674 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2[38384]: 2024-04-25T02:21:07.225+0000 7ff0cd2a7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:07.674 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2[38384]: 2024-04-25T02:21:07.225+0000 7ff0cd2a7700 -1 osd.2 101 *** Got signal Terminated *** 2024-04-25T02:21:07.674 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2[38384]: 2024-04-25T02:21:07.225+0000 7ff0cd2a7700 -1 osd.2 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:12.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:12 smithi174 podman[69736]: 2024-04-25 02:21:12.669660885 +0000 UTC m=+5.575662819 container died 104ac170b953897c5b1f8462d96a6f2ea63f9e98b0dd8390018ba49579de99d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-04-25T02:21:13.196 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69736]: 2024-04-25 02:21:13.008413912 +0000 UTC m=+5.914415833 container cleanup 104ac170b953897c5b1f8462d96a6f2ea63f9e98b0dd8390018ba49579de99d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T02:21:13.196 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 bash[69736]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2 2024-04-25T02:21:13.608 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69753]: 2024-04-25 02:21:13.192977337 +0000 UTC m=+0.524061281 container remove 104ac170b953897c5b1f8462d96a6f2ea63f9e98b0dd8390018ba49579de99d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T02:21:13.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69844]: 2024-04-25 02:21:13.508558373 +0000 UTC m=+0.018030754 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:13.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69844]: 2024-04-25 02:21:13.618769592 +0000 UTC m=+0.128241952 container create dd282a1f39352b5405e8a3a9f979e1ee0d2cdcb6cc29afdfaf0b50b9867b1147 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T02:21:13.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69844]: 2024-04-25 02:21:13.846166618 +0000 UTC m=+0.355638976 container init dd282a1f39352b5405e8a3a9f979e1ee0d2cdcb6cc29afdfaf0b50b9867b1147 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:21:13.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69844]: 2024-04-25 02:21:13.849382061 +0000 UTC m=+0.358854418 container start dd282a1f39352b5405e8a3a9f979e1ee0d2cdcb6cc29afdfaf0b50b9867b1147 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, ceph=True) 2024-04-25T02:21:13.924 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:13 smithi174 podman[69844]: 2024-04-25 02:21:13.921112053 +0000 UTC m=+0.430584411 container attach dd282a1f39352b5405e8a3a9f979e1ee0d2cdcb6cc29afdfaf0b50b9867b1147 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-25T02:21:14.174 INFO:journalctl@ceph.osd.2.smithi174.stdout:Apr 25 02:21:14 smithi174 podman[69844]: 2024-04-25 02:21:14.143650542 +0000 UTC m=+0.653122915 container died dd282a1f39352b5405e8a3a9f979e1ee0d2cdcb6cc29afdfaf0b50b9867b1147 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9) 2024-04-25T02:21:14.804 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T02:21:14.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:14.842 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T02:21:14.842 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T02:21:14.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.3 2024-04-25T02:21:15.280 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:14 smithi137 systemd[1]: Stopping Ceph osd.3 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:15.636 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:15 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3[46970]: 2024-04-25T02:21:15.411+0000 7fb515600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:15.636 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:15 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3[46970]: 2024-04-25T02:21:15.411+0000 7fb515600700 -1 osd.3 101 *** Got signal Terminated *** 2024-04-25T02:21:15.636 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:15 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3[46970]: 2024-04-25T02:21:15.411+0000 7fb515600700 -1 osd.3 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:17.674 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:17.221+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:18.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:17.958+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:18.674 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:18.181+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:19.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:18.982+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:19.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:19.158+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:20.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:20.097+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:20.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:19 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:19.935+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:20.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:20 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:20.005+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:20.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:20.157+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:21.098 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:20 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:20.930+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:21.099 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:20 smithi137 podman[86516]: 2024-04-25 02:21:20.841039573 +0000 UTC m=+5.560508635 container died e96ce0d01274f98c7a8dceb78cb859fac9f608f113e6c196998e56f5ab5989b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424) 2024-04-25T02:21:21.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:20 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:20.972+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:21.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:21.139+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:21.428 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:21 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:21.093+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:21.429 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:21 smithi137 podman[86516]: 2024-04-25 02:21:21.256734625 +0000 UTC m=+5.976203711 container cleanup e96ce0d01274f98c7a8dceb78cb859fac9f608f113e6c196998e56f5ab5989b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-25T02:21:21.429 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:21 smithi137 bash[86516]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3 2024-04-25T02:21:21.780 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:21 smithi137 podman[86544]: 2024-04-25 02:21:21.424614092 +0000 UTC m=+0.563619272 container remove e96ce0d01274f98c7a8dceb78cb859fac9f608f113e6c196998e56f5ab5989b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T02:21:21.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:21.443+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:22.240 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:22 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:22.078+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:22.241 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:21 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:21.967+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:22.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:22 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:22.005+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:22.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:22.113+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:22.530 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:22 smithi137 podman[86634]: 2024-04-25 02:21:22.144844457 +0000 UTC m=+0.036308954 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:22.530 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:22 smithi137 podman[86634]: 2024-04-25 02:21:22.267099388 +0000 UTC m=+0.158563909 container create 22793b38cf119f34dc55987647e80ce6ee4982707a6ec9bb032deec64c15a6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:22.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:22.461+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:23.022 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:22 smithi137 podman[86634]: 2024-04-25 02:21:22.573262626 +0000 UTC m=+0.464727157 container init 22793b38cf119f34dc55987647e80ce6ee4982707a6ec9bb032deec64c15a6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-25T02:21:23.022 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:22 smithi137 podman[86634]: 2024-04-25 02:21:22.584775076 +0000 UTC m=+0.476239572 container start 22793b38cf119f34dc55987647e80ce6ee4982707a6ec9bb032deec64c15a6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-25T02:21:23.022 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:22 smithi137 podman[86634]: 2024-04-25 02:21:22.661244852 +0000 UTC m=+0.552709423 container attach 22793b38cf119f34dc55987647e80ce6ee4982707a6ec9bb032deec64c15a6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-25T02:21:23.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:23 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:23.068+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:23.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:23 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:23.016+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:23.281 INFO:journalctl@ceph.osd.3.smithi137.stdout:Apr 25 02:21:23 smithi137 podman[86634]: 2024-04-25 02:21:23.03163153 +0000 UTC m=+0.923096013 container died 22793b38cf119f34dc55987647e80ce6ee4982707a6ec9bb032deec64c15a6c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:23.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:22 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:22.995+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:23.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:23.141+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:23.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T02:21:23.792 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:23.792 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T02:21:23.792 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T02:21:23.793 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.4 2024-04-25T02:21:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:23.510+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:24.104 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:23 smithi163 systemd[1]: Stopping Ceph osd.4 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:24.104 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:23 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:23.976+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:24.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:24.098+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:24.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:24.015+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:24.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:24 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:24.100+0000 7fe34cbea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:24.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:24 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:24.100+0000 7fe34cbea700 -1 osd.4 101 *** Got signal Terminated *** 2024-04-25T02:21:24.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:24 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:24.100+0000 7fe34cbea700 -1 osd.4 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:24.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:24.123+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:24.517+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:25.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:25 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:25.093+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:25.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:24 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:24.974+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:25.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:24 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:24.980+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:25.440 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:25.172+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:25.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:25.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:26.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:26 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:26.071+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:26.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:26 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:26.009+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:26.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:26 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:26.203+0000 7fe3459d7700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.966008+0000 front 2024-04-25T02:21:01.965956+0000 (oldest deadline 2024-04-25T02:21:25.466006+0000) 2024-04-25T02:21:26.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:26 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:26.026+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:26.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:26 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:26.026+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:26.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:26 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:26.149+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:26.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:26 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:26.149+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:26.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:26 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:26.579+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:26.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:26 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:26.448+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:26.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:26 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:26.448+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:27.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:27 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:27.044+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:27.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:26 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:26.970+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:27.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:27 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:27.177+0000 7fe3459d7700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.966008+0000 front 2024-04-25T02:21:01.965956+0000 (oldest deadline 2024-04-25T02:21:25.466006+0000) 2024-04-25T02:21:27.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:27 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:27.056+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:27.390 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:27 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:27.056+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:27.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:27 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:27.126+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:27.424 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:27 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:27.126+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:27.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:27 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:27.564+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:27.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:27 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:27.423+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:27.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:27 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:27.423+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:28.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:28 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:28.082+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:28.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:27 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:27.996+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:28.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:27 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:27.996+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:28.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4[43750]: 2024-04-25T02:21:28.182+0000 7fe3459d7700 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.966008+0000 front 2024-04-25T02:21:01.965956+0000 (oldest deadline 2024-04-25T02:21:25.466006+0000) 2024-04-25T02:21:28.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:28.049+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:28.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:28.049+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:28.422 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:28 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:28.091+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:28.422 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:28 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:28.091+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:28.422 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:28 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:28.305+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:28.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:28 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:28.418+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:28.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:28 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:28.418+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:28.810 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:28 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:28.515+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:29.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:29 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:29.015+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:29.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:29 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:29.015+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:29.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:29.015+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:29.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:29.015+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:29.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:29.032+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:29.281 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:29.032+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:29.326 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:29 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:29.050+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:29.326 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:29 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:29.050+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:29.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:29 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:29.322+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:29.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:29 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:29.399+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:29.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:29 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:29.399+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:29.788 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:29 smithi163 podman[68569]: 2024-04-25 02:21:29.507377693 +0000 UTC m=+5.517412595 container died e5d9d9a609b975cc89f651fa663bb4c73884c0a0a0516447841d62833cb65a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-25T02:21:29.788 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:29 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:29.516+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:30.121 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:29 smithi163 podman[68569]: 2024-04-25 02:21:29.875881516 +0000 UTC m=+5.885916418 container cleanup e5d9d9a609b975cc89f651fa663bb4c73884c0a0a0516447841d62833cb65a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-25T02:21:30.121 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:29 smithi163 bash[68569]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4 2024-04-25T02:21:30.122 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:30 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:30.002+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:30.122 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:30 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:30.002+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:30.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:30.019+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:30.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:30.019+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:30.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:30.022+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:30.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:30 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:30.022+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:30.320 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:30.029+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:30.320 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:30.029+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:30.389 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68587]: 2024-04-25 02:21:30.118531277 +0000 UTC m=+0.612115448 container remove e5d9d9a609b975cc89f651fa663bb4c73884c0a0a0516447841d62833cb65a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-04-25T02:21:30.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:30.316+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:30.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:30.364+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:30.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:30 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:30.364+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:30.691 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:30 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:30.547+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:30.691 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.427726652 +0000 UTC m=+0.112240602 container create 623be9436e8f4c0f335a6a8ed232432e0e9e76a639853f1462438718593271f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, ceph=True, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-25T02:21:30.691 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.333810694 +0000 UTC m=+0.018324657 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:30.973 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.688273046 +0000 UTC m=+0.372786995 container init 623be9436e8f4c0f335a6a8ed232432e0e9e76a639853f1462438718593271f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:30.973 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.691399176 +0000 UTC m=+0.375913126 container start 623be9436e8f4c0f335a6a8ed232432e0e9e76a639853f1462438718593271f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T02:21:30.973 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.763108445 +0000 UTC m=+0.447622397 container attach 623be9436e8f4c0f335a6a8ed232432e0e9e76a639853f1462438718593271f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T02:21:31.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:31.047+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:31.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:31.047+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:31.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:31.005+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:31.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:31 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:31.005+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:31.293 INFO:journalctl@ceph.osd.4.smithi163.stdout:Apr 25 02:21:30 smithi163 podman[68677]: 2024-04-25 02:21:30.985359063 +0000 UTC m=+0.669873005 container died 623be9436e8f4c0f335a6a8ed232432e0e9e76a639853f1462438718593271f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T02:21:31.294 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:30 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:30.969+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:31.294 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:30 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:30.969+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:31.356 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:31.052+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:31.356 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:31.052+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:31.573 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T02:21:31.610 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:31.610 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T02:21:31.611 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T02:21:31.611 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.5 2024-04-25T02:21:31.637 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:31.353+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:31.637 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:31.374+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:31.637 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:31.374+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:31.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:31 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:31.540+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:31.905 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 systemd[1]: Stopping Ceph osd.5 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:32.174 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:31.902+0000 7f417d4a2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:32.174 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:31.902+0000 7f417d4a2700 -1 osd.5 101 *** Got signal Terminated *** 2024-04-25T02:21:32.174 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:31 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:31.902+0000 7f417d4a2700 -1 osd.5 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:32.174 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:32.095+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:32.175 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:32.095+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:32.279 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:32.046+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:32.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:32.046+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:32.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:32.014+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:32.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:32 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:32.014+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:32.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:31.999+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:32.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:31.999+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:32.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:32.368+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:32.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:32.329+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:32.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:32 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:32.329+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:32.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:32.539+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:33.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:33.060+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:33.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:33.060+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:33.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:33.018+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:33.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:33.018+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:33.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:33 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:33.018+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:33.343 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:33.073+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:33.343 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:33.073+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:33.343 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:33.073+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.079604+0000 front 2024-04-25T02:21:10.079581+0000 (oldest deadline 2024-04-25T02:21:32.979765+0000) 2024-04-25T02:21:33.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:32.963+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:33.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:32 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:32.963+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:33.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:33.339+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:33.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:33.372+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:33.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:33.372+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:33.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:33 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:33.372+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:33.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:33.576+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:34.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:34.105+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:34.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:34.105+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:34.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:34.105+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:34.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:34.004+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:34.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:34.004+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:34.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:34.004+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:34.383 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:34.060+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:34.383 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:34.060+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:34.384 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:34.060+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.079604+0000 front 2024-04-25T02:21:10.079581+0000 (oldest deadline 2024-04-25T02:21:32.979765+0000) 2024-04-25T02:21:34.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:33.989+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:34.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:33 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:33.989+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:34.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:34.380+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:34.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:34.380+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:34.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:34.416+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:34.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:34.416+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:34.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:34 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:34.416+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:34.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:34.589+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:35.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:35.124+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:35.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:35.124+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:35.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:35.124+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:35.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.001+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:35.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.001+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:35.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.001+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:34.966+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:34.966+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:34 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:34.966+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:35.042+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:35.042+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:35.389 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:35.042+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.079604+0000 front 2024-04-25T02:21:10.079581+0000 (oldest deadline 2024-04-25T02:21:32.979765+0000) 2024-04-25T02:21:35.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:35.407+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:35.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:35.407+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:35.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:35.386+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:35.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:35.386+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:35.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:35 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:35.386+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:35.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:35.622+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:35.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:35.622+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:36.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:36.130+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:36.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:36.130+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:36.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:36.130+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:36.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.954+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:36.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.954+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:36.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:35 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:35.954+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:36.378 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:36.030+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:54.278154+0000 front 2024-04-25T02:20:54.277690+0000 (oldest deadline 2024-04-25T02:21:16.577543+0000) 2024-04-25T02:21:36.378 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:36.030+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.278746+0000 front 2024-04-25T02:21:01.278844+0000 (oldest deadline 2024-04-25T02:21:25.378707+0000) 2024-04-25T02:21:36.378 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5[44923]: 2024-04-25T02:21:36.030+0000 7f417628f700 -1 osd.5 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.079604+0000 front 2024-04-25T02:21:10.079581+0000 (oldest deadline 2024-04-25T02:21:32.979765+0000) 2024-04-25T02:21:36.388 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:35.956+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:36.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:35.956+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:36.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:35 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:35.956+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:36.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:36.374+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:36.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:36.374+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:36.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:36.377+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:36.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:36.377+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:36.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:36 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:36.377+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:36.974 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:36.660+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:36.974 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:36.660+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:37.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:37.160+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:37.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:37.160+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:37.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:37.160+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:37.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:36.913+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:37.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:36.913+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:37.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:36 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:36.913+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:37.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:36.971+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:37.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:36.971+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:37.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:36 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:36.971+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:37 smithi174 podman[69965]: 2024-04-25 02:21:37.334938699 +0000 UTC m=+5.540188664 container died 45d86797b9aa3740375e8b41b0b6733e3bc70ba879a4da0e4b0a07c0756a6a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:37.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:37.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:37.358+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:37.358+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:37.655 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:37 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:37.358+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:37.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:37.613+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:37.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:37.613+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:37.924 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:37 smithi174 podman[69965]: 2024-04-25 02:21:37.652098007 +0000 UTC m=+5.857348023 container cleanup 45d86797b9aa3740375e8b41b0b6733e3bc70ba879a4da0e4b0a07c0756a6a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-25T02:21:37.924 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:37 smithi174 bash[69965]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5 2024-04-25T02:21:37.924 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:37 smithi174 podman[69982]: 2024-04-25 02:21:37.86958655 +0000 UTC m=+0.530628105 container remove 45d86797b9aa3740375e8b41b0b6733e3bc70ba879a4da0e4b0a07c0756a6a0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9) 2024-04-25T02:21:38.130 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:37.867+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:38.130 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:37.867+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:38.130 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:37 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:37.867+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:38.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:37.963+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:38.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:37.963+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:38.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:37 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:37.963+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:38.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:38.126+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:38.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:38.126+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:38.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:38.126+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:38.376+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:38.376+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:38.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:38.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:38 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:38.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:38.584 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.175211481 +0000 UTC m=+0.018333311 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:38.585 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.295533402 +0000 UTC m=+0.138655232 container create 24b02c7072f867619bcf645b0db186263de149e8029f039a1088227bbae77110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:38.585 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.506568876 +0000 UTC m=+0.349690715 container init 24b02c7072f867619bcf645b0db186263de149e8029f039a1088227bbae77110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, io.buildah.version=1.33.5) 2024-04-25T02:21:38.585 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.509892669 +0000 UTC m=+0.353014507 container start 24b02c7072f867619bcf645b0db186263de149e8029f039a1088227bbae77110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-25T02:21:38.585 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.580840542 +0000 UTC m=+0.423962384 container attach 24b02c7072f867619bcf645b0db186263de149e8029f039a1088227bbae77110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T02:21:38.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:38.631+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:38.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:38.631+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:38.924 INFO:journalctl@ceph.osd.5.smithi174.stdout:Apr 25 02:21:38 smithi174 podman[70072]: 2024-04-25 02:21:38.79887706 +0000 UTC m=+0.641998903 container died 24b02c7072f867619bcf645b0db186263de149e8029f039a1088227bbae77110 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-d2c45d9, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T02:21:39.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:39.090+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:39.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:39.090+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:39.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:39.090+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:39.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:38.843+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:39.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:38.843+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:39.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:38 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:38.843+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:39.336 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:39.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:39.337 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:39.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:39.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T02:21:39.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:38.993+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:39.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:38.993+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:39.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:38 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:38.993+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:39.435 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:39.435 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T02:21:39.435 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-25T02:21:39.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.6 2024-04-25T02:21:39.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:39.375+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:39.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:39.375+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:39.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:39 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:39.375+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:39.780 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:39 smithi137 systemd[1]: Stopping Ceph osd.6 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:40.045 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:39 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:39.677+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:40.045 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:39 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:39.677+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:40.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.031+0000 7f7efba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:40.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.031+0000 7f7efba00700 -1 osd.6 101 *** Got signal Terminated *** 2024-04-25T02:21:40.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.031+0000 7f7efba00700 -1 osd.6 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:40.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.058+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:40.281 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.058+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:40.281 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:40.058+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:40.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:39.871+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:40.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:39.872+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:40.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:39 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:39.872+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:40.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:40 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:40.041+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:40.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:40 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:40.041+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:40.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:40 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:40.041+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:40.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:40 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:40.336+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:40.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:40 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:40.336+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:40.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:40 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:40.384+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:40.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:40 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:40.384+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:40.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:40 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:40.384+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:41.078 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:40 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:40.692+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:41.078 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:40 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:40.692+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:41.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:41.025+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:41.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:41.025+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:41.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:41.025+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:41.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:40.835+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:41.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:40.835+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:41.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:40.835+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:41.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:41.075+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:41.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:41.075+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:41.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:41.075+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:41.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:41 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:41.305+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:41.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:41 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:41.305+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:41.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:41 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:41.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:41.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:41 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:41.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:41.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:41 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:41.393+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:42.062 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:41.663+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:42.062 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:41.663+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:42.062 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:41 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:41.663+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:42.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:42.042+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:42.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:42.042+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:42.280 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:42.042+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:42.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:41.817+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:42.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:41.817+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:42.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:41.817+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:42.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:41 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:41.817+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:42.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:42.058+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:42.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:42.058+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:42.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:42.058+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:42.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:42.058+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:42.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:42 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:42.343+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:42.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:42 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:42.343+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:42.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:42 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:42.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:42.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:42 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:42.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:42.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:42 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:42.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:43.068 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:42.636+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:43.068 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:42.636+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:43.068 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:42 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:42.636+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:43.092 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:42.785+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:43.092 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:42.785+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:43.092 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:42.785+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:43.092 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:42 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:42.785+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:43.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:43.065+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:43.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:43.065+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:43.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:43.065+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:43.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:43.065+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:43.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:43.088+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:43.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:43.088+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:43.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:43.088+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:43.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:43.313+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:43.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:43.313+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:43.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:43.465+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:43.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:43.465+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:43.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:43.465+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:43.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:43 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:43.465+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:44.030 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:43.774+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:44.030 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:43.774+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:44.030 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:43.774+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:44.030 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:43.774+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:44.080 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:43.666+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:44.080 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:43.666+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:44.080 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:43 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:43.667+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:44.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:44.077+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:44.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:44.077+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:44.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:44.077+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:44.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:44.077+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:44.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:44.133+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.788440+0000 front 2024-04-25T02:20:55.788513+0000 (oldest deadline 2024-04-25T02:21:19.887967+0000) 2024-04-25T02:21:44.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:44.133+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:02.790291+0000 front 2024-04-25T02:21:02.789853+0000 (oldest deadline 2024-04-25T02:21:28.689884+0000) 2024-04-25T02:21:44.530 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6[53650]: 2024-04-25T02:21:44.133+0000 7f7ef7c00700 -1 osd.6 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.192390+0000 front 2024-04-25T02:21:12.192264+0000 (oldest deadline 2024-04-25T02:21:33.892526+0000) 2024-04-25T02:21:44.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:44.269+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:44.269+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:44.269+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:44.482+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:44.482+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:44.482+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:44.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:44 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:44.482+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:45.054 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:44.704+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:45.054 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:44.704+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:45.054 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:44 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:44.704+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:45.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:44.821+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:45.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:44.821+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:45.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:44.821+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:45.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:44 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:44.821+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:45.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:45.050+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:45.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:45.050+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:45.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:45.050+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:45.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:45.050+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:45.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:45.309+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:45.309+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:45.309+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:45.456+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:45.456+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:45.456+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:45.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:45 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:45.456+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:45.681 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:45 smithi137 podman[86737]: 2024-04-25 02:21:45.51067169 +0000 UTC m=+5.604238021 container died 63ea63f0bd52fbcf93c221e4084b3961e9ecacdd3629c4da2676e84b0c72ad94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:45.939 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:45 smithi137 podman[86737]: 2024-04-25 02:21:45.907353258 +0000 UTC m=+6.000919612 container cleanup 63ea63f0bd52fbcf93c221e4084b3961e9ecacdd3629c4da2676e84b0c72ad94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9) 2024-04-25T02:21:45.939 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:45 smithi137 bash[86737]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6 2024-04-25T02:21:45.940 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:45.787+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:45.940 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:45.787+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:45.940 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:45.787+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:45.940 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:45 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:45.787+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:46.079 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:45.657+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:46.080 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:45.657+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:46.080 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:45 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:45.657+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:46.279 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:46 smithi137 podman[86758]: 2024-04-25 02:21:46.174952232 +0000 UTC m=+0.650486469 container remove 63ea63f0bd52fbcf93c221e4084b3961e9ecacdd3629c4da2676e84b0c72ad94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T02:21:46.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:46.076+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:46.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:46.076+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:46.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:46.076+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:46.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:46.076+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:46.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:46.351+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:46.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:46.351+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:46.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:46.351+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:46.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:46.467+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:46.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:46.467+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:46.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:46.467+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:46.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:46 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:46.467+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:46.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:46.618+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:46.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:46.618+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:46.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:46 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:46.618+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:47.030 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:46 smithi137 podman[86860]: 2024-04-25 02:21:46.640580682 +0000 UTC m=+0.039319480 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:47.031 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:46 smithi137 podman[86860]: 2024-04-25 02:21:46.734223508 +0000 UTC m=+0.132962330 container create 28a61c9a7cc1c0a6bee2c37d769e8b8f8ffdf92891a8fd9f1415759cf028e5e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-25T02:21:47.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:46.836+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:47.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:46.836+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:47.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:46.836+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:47.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:46 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:46.836+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:47.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:47.067+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:47.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:47.067+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:47.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:47.067+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:47.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:47.067+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:47.514 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:47 smithi137 podman[86860]: 2024-04-25 02:21:47.055145033 +0000 UTC m=+0.453883862 container init 28a61c9a7cc1c0a6bee2c37d769e8b8f8ffdf92891a8fd9f1415759cf028e5e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T02:21:47.514 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:47 smithi137 podman[86860]: 2024-04-25 02:21:47.067768013 +0000 UTC m=+0.466506813 container start 28a61c9a7cc1c0a6bee2c37d769e8b8f8ffdf92891a8fd9f1415759cf028e5e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True) 2024-04-25T02:21:47.514 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:47 smithi137 podman[86860]: 2024-04-25 02:21:47.153655523 +0000 UTC m=+0.552394399 container attach 28a61c9a7cc1c0a6bee2c37d769e8b8f8ffdf92891a8fd9f1415759cf028e5e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T02:21:47.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:47.361+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:47.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:47.361+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:47.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:47.361+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:47.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:47.445+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:47.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:47.445+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:47.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:47.445+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:47.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:47 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:47.445+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:47.676 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:47.633+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:47.676 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:47.633+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:47.676 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:47 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:47.633+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:47.779 INFO:journalctl@ceph.osd.6.smithi137.stdout:Apr 25 02:21:47 smithi137 podman[86860]: 2024-04-25 02:21:47.510955175 +0000 UTC m=+0.909694003 container died 28a61c9a7cc1c0a6bee2c37d769e8b8f8ffdf92891a8fd9f1415759cf028e5e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5) 2024-04-25T02:21:48.136 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:47.861+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:48.136 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:47.861+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:48.136 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:47.861+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:48.136 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:47 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:47.861+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:48.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.6.service' 2024-04-25T02:21:48.275 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:48.275 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-25T02:21:48.275 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-25T02:21:48.276 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.7 2024-04-25T02:21:48.389 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 systemd[1]: Stopping Ceph osd.7 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:48.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:48.111+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:48.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:48.111+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:48.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:48.111+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:48.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:48.111+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:48.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:48.394+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:48.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:48.394+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:48.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:48.394+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:48.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:48.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:48.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:48.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:48.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:48.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:48.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:48 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:48.472+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.575+0000 7f9ad35e8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.575+0000 7f9ad35e8700 -1 osd.7 101 *** Got signal Terminated *** 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.575+0000 7f9ad35e8700 -1 osd.7 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.585+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.585+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:48.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:48.585+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:49.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:48.824+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:49.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:48.824+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:49.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:48.824+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:49.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:48 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:48.824+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:49.621 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:49.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:49.621 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:49.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:49.621 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:49.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:49.621 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:49.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:49.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:49.382+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:49.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:49.382+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:49.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:49.382+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:49.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:49.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:49.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:49.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:49.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:49.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:49.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:49 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:49.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:49.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:49.616+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:49.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:49.616+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:49.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:49 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:49.616+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:50.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:49 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:49.793+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:50.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:49 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:49.793+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:50.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:49 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:49.793+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:50.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:49 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:49.793+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:50.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:50.129+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:50.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:50.129+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:50.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:50.129+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:50.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:50.129+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:50.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:50.375+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:50.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:50.375+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:50.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:50.375+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:50.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:50.443+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:50.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:50.443+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:50.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:50.443+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:50.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:50 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:50.443+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:51.139 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:50.651+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:51.139 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:50.651+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:51.139 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:50 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:50.651+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:51.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:50.805+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:51.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:50.805+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:51.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:50.805+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:51.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:50.805+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:51.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:50 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:50.805+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:51.618 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:51.153+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:51.618 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:51.153+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:51.618 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:51.153+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:51.618 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:51.153+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:51.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:51.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:51.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:51.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:51.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:51.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:51.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:51.389+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:51.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:51.410+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:51.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:51.410+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:51.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:51.410+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:51.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:51 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:51.410+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:51.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:51.614+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:51.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:51.614+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:51.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:51.614+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:52.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:51.837+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:52.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:51.837+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:52.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:51.837+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:52.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:51.837+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:52.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:51 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:51.837+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:52.600 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:52.183+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:52.600 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:52.183+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:52.600 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:52.183+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:52.600 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:52.183+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:52.601 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:52.183+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:52.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:52.372+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:52.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:52.372+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:52.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:52.372+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:52.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:52.372+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:52.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:52.422+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:52.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:52.422+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:52.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:52.422+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:52.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:52.422+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:52.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:52 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:52.422+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:52.888 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:52.595+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.537865+0000 front 2024-04-25T02:21:01.537923+0000 (oldest deadline 2024-04-25T02:21:25.638063+0000) 2024-04-25T02:21:52.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:52.595+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:12.039551+0000 front 2024-04-25T02:21:12.039610+0000 (oldest deadline 2024-04-25T02:21:34.939554+0000) 2024-04-25T02:21:52.889 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:52 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7[50343]: 2024-04-25T02:21:52.595+0000 7f9acc3d5700 -1 osd.7 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:14.940363+0000 front 2024-04-25T02:21:14.940531+0000 (oldest deadline 2024-04-25T02:21:40.840167+0000) 2024-04-25T02:21:53.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:52.886+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:53.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:52.886+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:53.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:52.886+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:53.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:52.886+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:53.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:52 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:52.886+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:53.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:53.185+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:53.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:53.185+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:53.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:53.185+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:53.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:53.185+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:53.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:53 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:53.185+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:53.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:53.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:53.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:53.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:53.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:53.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:53.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:53.329+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:53.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:53.468+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:53.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:53.468+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:53.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:53.468+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:53.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:53.468+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:53.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:53 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:53.468+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:54.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:53.910+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:54.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:53.910+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:54.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:53.910+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:54.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:53.910+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:54.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:53 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:53.910+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:54 smithi163 podman[68793]: 2024-04-25 02:21:54.050733266 +0000 UTC m=+5.580915082 container died db0edbb131a932008fd64af273b9259f2f74918db3668c264da4c21223bf2160 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:54.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:54.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:54.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:54.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:54.346 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:54 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:54.139+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:54.639 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:54 smithi163 podman[68793]: 2024-04-25 02:21:54.450721202 +0000 UTC m=+5.980903018 container cleanup db0edbb131a932008fd64af273b9259f2f74918db3668c264da4c21223bf2160 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:54.639 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:54 smithi163 bash[68793]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7 2024-04-25T02:21:54.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:54.345+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:54.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:54.345+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:54.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:54.345+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:54.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:54.345+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:54.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:54.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:54.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:54.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:54.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:54.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:54.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:54.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:54.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:54 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:54.437+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:55.083 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:54 smithi163 podman[68811]: 2024-04-25 02:21:54.676728618 +0000 UTC m=+0.628705787 container remove db0edbb131a932008fd64af273b9259f2f74918db3668c264da4c21223bf2160 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7, org.label-schema.build-date=20240424, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:21:55.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:54 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:54.884+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:55.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:54 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:54.884+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:55.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:54 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:54.884+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:55.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:54 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:54.884+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:55.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:54 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:54.884+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:55.126+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:55.126+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:55.126+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:55.126+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:55.126+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:55.363 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:54.983632113 +0000 UTC m=+0.017827539 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:21:55.364 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:55.102507347 +0000 UTC m=+0.136702803 container create 041444334a97137dd73b578eaf373c0037f9ee41e98782dfc45398e134654509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:21:55.364 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:55.360024809 +0000 UTC m=+0.394220223 container init 041444334a97137dd73b578eaf373c0037f9ee41e98782dfc45398e134654509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T02:21:55.639 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:55.363598222 +0000 UTC m=+0.397793636 container start 041444334a97137dd73b578eaf373c0037f9ee41e98782dfc45398e134654509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7-deactivate, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-25T02:21:55.639 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:55.463554486 +0000 UTC m=+0.497749909 container attach 041444334a97137dd73b578eaf373c0037f9ee41e98782dfc45398e134654509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T02:21:55.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:55.335+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:55.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:55.335+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:55.335+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:55.335+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:55.431+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:55.431+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:55.431+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:55.431+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:55.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:55 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:55.431+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:55.935 INFO:journalctl@ceph.osd.7.smithi163.stdout:Apr 25 02:21:55 smithi163 podman[68900]: 2024-04-25 02:21:55.654026371 +0000 UTC m=+0.688221789 container died 041444334a97137dd73b578eaf373c0037f9ee41e98782dfc45398e134654509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-25T02:21:56.194 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:56 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:56.144+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:56.194 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:56 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:56.144+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:56.194 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:56 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:56.144+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:56.195 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:56 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:56.144+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:56.195 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:56 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:56.144+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:56.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.7.service' 2024-04-25T02:21:56.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:21:56.251 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-25T02:21:56.251 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-25T02:21:56.252 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.8 2024-04-25T02:21:56.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:55 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:55.926+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:56.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:55 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:55.926+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:56.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:55 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:55.926+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:56.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:55 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:55.926+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:56.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:55 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:55.926+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:56.531 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:56.442+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:56.531 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:56.442+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:56.531 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:56.442+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:56.532 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:56.442+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:56.532 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:56.442+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:56.533 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 systemd[1]: Stopping Ceph osd.8 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:21:56.533 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.297+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:56.533 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.297+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:56.533 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.297+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:56.534 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.297+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:56.534 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.526+0000 7fe28b2a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:21:56.534 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.526+0000 7fe28b2a1700 -1 osd.8 101 *** Got signal Terminated *** 2024-04-25T02:21:56.924 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:56 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:56.526+0000 7fe28b2a1700 -1 osd.8 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:21:57.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:56 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:56.932+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:57.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:56 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:56.932+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:57.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:56 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:56.932+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:57.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:56 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:56.932+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:57.281 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:56 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:56.932+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:57.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:57 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:57.146+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:57.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:57 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:57.146+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:57.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:57 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:57.146+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:57.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:57 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:57.146+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:57.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:57 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:57.146+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:57.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:57.332+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:57.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:57.332+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:57.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:57.332+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:57.332+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:57.452+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:57.453+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:57.453+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:57.453+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:57.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:57 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:57.453+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:58.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:57 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:57.921+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:58.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:57 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:57.921+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:58.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:57 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:57.921+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:58.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:57 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:57.921+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:58.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:57 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:57.921+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:58.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:58.145+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:58.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:58.145+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:58.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:58.145+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:58.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:58.145+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:58.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:58 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:58.145+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:58.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:58.289+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:58.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:58.289+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:58.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:58.289+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:58.289+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:58.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:58 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:58.494+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:21:59.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:58 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:58.881+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:21:59.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:58 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:58.881+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:21:59.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:58 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:58.881+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:21:59.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:58 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:58.881+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:21:59.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:58 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:58.881+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:21:59.535 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:59.241+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:21:59.535 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:59.241+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:21:59.535 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:59.241+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:21:59.535 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:59.241+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:21:59.535 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:21:59.241+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.877076+0000 front 2024-04-25T02:21:36.877110+0000 (oldest deadline 2024-04-25T02:21:58.577122+0000) 2024-04-25T02:21:59.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:59.162+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:21:59.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:59.162+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:21:59.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:59.162+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:21:59.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:59.162+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:21:59.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:21:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:21:59.162+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:21:59.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:21:59 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:21:59.531+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:00.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:59.866+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:00.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:59.866+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:00.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:59.866+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:00.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:59.866+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:00.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:21:59 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:21:59.866+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:00.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:00 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:00.196+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:00.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:00.242+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:22:00.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:00.242+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:22:00.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:00.242+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:22:00.674 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:00.242+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:00.242+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.877076+0000 front 2024-04-25T02:21:36.877110+0000 (oldest deadline 2024-04-25T02:21:58.577122+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:00.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:00 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:00.487+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:01.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:00.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:01.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:00.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:01.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:00.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:01.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:00.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:01.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:00 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:00.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:01.537 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:01.265+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:01.971712+0000 front 2024-04-25T02:21:01.971769+0000 (oldest deadline 2024-04-25T02:21:27.871787+0000) 2024-04-25T02:22:01.537 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:01.265+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.172695+0000 front 2024-04-25T02:21:10.172726+0000 (oldest deadline 2024-04-25T02:21:34.272877+0000) 2024-04-25T02:22:01.537 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:01.265+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:17.674660+0000 front 2024-04-25T02:21:17.674544+0000 (oldest deadline 2024-04-25T02:21:43.574233+0000) 2024-04-25T02:22:01.537 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:01.265+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.175909+0000 front 2024-04-25T02:21:25.175879+0000 (oldest deadline 2024-04-25T02:21:51.075874+0000) 2024-04-25T02:22:01.537 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8[51555]: 2024-04-25T02:22:01.265+0000 7fe288096700 -1 osd.8 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.877076+0000 front 2024-04-25T02:21:36.877110+0000 (oldest deadline 2024-04-25T02:21:58.577122+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:01.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:01 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:01.172+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:01.883 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:01 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:01.533+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:02.174 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:01 smithi174 podman[70177]: 2024-04-25 02:22:01.880328463 +0000 UTC m=+5.446233395 container died d8eb69936e7904139297f328bdd7df08444c8ed43392b18a41e958b3fdd33e15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T02:22:02.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:01.811+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:02.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:01.811+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:02.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:01.811+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:02.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:01.811+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:02.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:01 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:01.811+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.124+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.124+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.124+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.125+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.125+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:02.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:02 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:02.125+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:02.549 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:02 smithi174 podman[70177]: 2024-04-25 02:22:02.335107887 +0000 UTC m=+5.901012805 container cleanup d8eb69936e7904139297f328bdd7df08444c8ed43392b18a41e958b3fdd33e15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9) 2024-04-25T02:22:02.549 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:02 smithi174 bash[70177]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8 2024-04-25T02:22:02.908 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:02 smithi174 podman[70194]: 2024-04-25 02:22:02.611722538 +0000 UTC m=+0.729605494 container remove d8eb69936e7904139297f328bdd7df08444c8ed43392b18a41e958b3fdd33e15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:02.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:02 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:02.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:03.174 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:02 smithi174 podman[70286]: 2024-04-25 02:22:02.808319941 +0000 UTC m=+0.018159098 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:03.175 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:02 smithi174 podman[70286]: 2024-04-25 02:22:02.929565066 +0000 UTC m=+0.139404247 container create 4c5cef263b99be39ea0f3d40f0051cec4bab23f405fdfd7f29ae36e930a8cfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:22:03.175 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:03 smithi174 podman[70286]: 2024-04-25 02:22:03.149376093 +0000 UTC m=+0.359215235 container init 4c5cef263b99be39ea0f3d40f0051cec4bab23f405fdfd7f29ae36e930a8cfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T02:22:03.175 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:03 smithi174 podman[70286]: 2024-04-25 02:22:03.152402795 +0000 UTC m=+0.362241934 container start 4c5cef263b99be39ea0f3d40f0051cec4bab23f405fdfd7f29ae36e930a8cfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T02:22:03.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:02 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:02.807+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:03.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:02 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:02.807+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:03.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:02 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:02.807+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:03.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:02 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:02.807+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:03.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:02 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:02.807+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:03.451 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:03 smithi174 podman[70286]: 2024-04-25 02:22:03.249538918 +0000 UTC m=+0.459378064 container attach 4c5cef263b99be39ea0f3d40f0051cec4bab23f405fdfd7f29ae36e930a8cfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:03.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:03 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:03.156+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.8.smithi174.stdout:Apr 25 02:22:03 smithi174 podman[70286]: 2024-04-25 02:22:03.449201576 +0000 UTC m=+0.659040717 container died 4c5cef263b99be39ea0f3d40f0051cec4bab23f405fdfd7f29ae36e930a8cfa0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:03.797 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:03 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:03.581+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:04.099 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.8.service' 2024-04-25T02:22:04.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:04.138 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-25T02:22:04.138 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-25T02:22:04.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.9 2024-04-25T02:22:04.217 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:03 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:03.832+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:04.217 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:03 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:03.832+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:04.217 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:03 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:03.832+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:04.217 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:03 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:03.832+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:04.217 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:03 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:03.832+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:04.529 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 systemd[1]: Stopping Ceph osd.9 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:04.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:04 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:04.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:04.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:04.589+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.688+0000 7f93f0800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.688+0000 7f93f0800700 -1 osd.9 101 *** Got signal Terminated *** 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.688+0000 7f93f0800700 -1 osd.9 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:05.031 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:04 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:04.846+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:05.552 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:05.552 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:05.552 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:05.552 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:05.553 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:05.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:05 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:05.206+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:06.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:05.848+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:06.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:05.848+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:06.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:05.848+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:06.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:05.848+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:06.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:05 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:05.848+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:06.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:06 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:06.178+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:05 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:05.548+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:06.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:06.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:06 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:06.552+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:07.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:06 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:06.896+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:07.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:06 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:06.896+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:07.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:06 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:06.896+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:07.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:06 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:06.896+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:07.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:06 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:06.896+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:07.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:07 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:07.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:07.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:07.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:07.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:07.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:07.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:07.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:07.564+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:08.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:07 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:07.923+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:08.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:07 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:07.923+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:08.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:07 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:07.923+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:08.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:07 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:07.923+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:08.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:07 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:07.923+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:08.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:08 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:08.180+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:08.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:08.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:08.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:08.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:08.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:08.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:08 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:08.595+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:09.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:08 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:08.947+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:53.764293+0000 front 2024-04-25T02:20:53.764836+0000 (oldest deadline 2024-04-25T02:21:19.064134+0000) 2024-04-25T02:22:09.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:08 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:08.947+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:03.066913+0000 front 2024-04-25T02:21:03.067149+0000 (oldest deadline 2024-04-25T02:21:27.766839+0000) 2024-04-25T02:22:09.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:08 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:08.947+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:10.668774+0000 front 2024-04-25T02:21:10.668855+0000 (oldest deadline 2024-04-25T02:21:32.968853+0000) 2024-04-25T02:22:09.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:08 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:08.947+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.871266+0000 front 2024-04-25T02:21:18.871628+0000 (oldest deadline 2024-04-25T02:21:41.171618+0000) 2024-04-25T02:22:09.280 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:08 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9[60247]: 2024-04-25T02:22:08.947+0000 7f93eca00700 -1 osd.9 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.574319+0000 front 2024-04-25T02:21:27.574241+0000 (oldest deadline 2024-04-25T02:21:50.474215+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:09.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:09 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:09.142+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:09.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:09 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:09.590+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:10.582 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:10 smithi137 podman[86965]: 2024-04-25 02:22:10.281166241 +0000 UTC m=+5.712285575 container died 9c647476d1aef43650a5632b51dab82828fdcf1aaa252c8bf643c6e47599c725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:10.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:10 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:10.159+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:10.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:10.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:10.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:10.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:10.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:10.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:10 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:10.611+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:10.971 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:10 smithi137 podman[86965]: 2024-04-25 02:22:10.699138386 +0000 UTC m=+6.130257758 container cleanup 9c647476d1aef43650a5632b51dab82828fdcf1aaa252c8bf643c6e47599c725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:22:10.971 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:10 smithi137 bash[86965]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9 2024-04-25T02:22:11.279 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:10 smithi137 podman[86983]: 2024-04-25 02:22:10.967094531 +0000 UTC m=+0.668712670 container remove 9c647476d1aef43650a5632b51dab82828fdcf1aaa252c8bf643c6e47599c725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:11.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:11 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:11.132+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:11.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:11.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:11.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:11.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:11.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:11.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:11.575+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:12.101 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:11 smithi137 podman[87072]: 2024-04-25 02:22:11.713657532 +0000 UTC m=+0.034882092 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:12.101 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:11 smithi137 podman[87072]: 2024-04-25 02:22:11.834718478 +0000 UTC m=+0.155943079 container create e0494b7e36fb64421b343edfe35ee7fd5a24f58958d6d09811bd12a7c5c63952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-25T02:22:12.101 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:12 smithi137 podman[87072]: 2024-04-25 02:22:12.096636545 +0000 UTC m=+0.417861149 container init e0494b7e36fb64421b343edfe35ee7fd5a24f58958d6d09811bd12a7c5c63952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T02:22:12.529 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:12 smithi137 podman[87072]: 2024-04-25 02:22:12.108426121 +0000 UTC m=+0.429650688 container start e0494b7e36fb64421b343edfe35ee7fd5a24f58958d6d09811bd12a7c5c63952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9-deactivate, RELEASE=squid-d2c45d9, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:22:12.530 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:12 smithi137 podman[87072]: 2024-04-25 02:22:12.186831876 +0000 UTC m=+0.508056509 container attach e0494b7e36fb64421b343edfe35ee7fd5a24f58958d6d09811bd12a7c5c63952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, RELEASE=squid-d2c45d9, ceph=True) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:12.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:12 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:12.167+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:12.905 INFO:journalctl@ceph.osd.9.smithi137.stdout:Apr 25 02:22:12 smithi137 podman[87072]: 2024-04-25 02:22:12.560933025 +0000 UTC m=+0.882157650 container died e0494b7e36fb64421b343edfe35ee7fd5a24f58958d6d09811bd12a7c5c63952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-9-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:12.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:12 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:12.612+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:13.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.9.service' 2024-04-25T02:22:13.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:13.373 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-25T02:22:13.373 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-25T02:22:13.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.10 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:13.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.204+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:13.640 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 systemd[1]: Stopping Ceph osd.10 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:13.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:13 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:13.654+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:14.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.659+0000 7f7ab88fd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:14.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.659+0000 7f7ab88fd700 -1 osd.10 101 *** Got signal Terminated *** 2024-04-25T02:22:14.139 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:13 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:13.659+0000 7f7ab88fd700 -1 osd.10 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:14.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:14 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:14.157+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:14.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:14 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:14.619+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:15.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:15 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:15.122+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:15.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:15.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:15.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:15.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:15.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:15.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:15.576+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:16.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:16 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:16.088+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:16.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:16 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:16.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:17.309 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:17 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:17.042+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:17.926 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:17.926 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:17.926 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:17.927 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:17.927 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:17.927 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:17 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:17.573+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:52.778617+0000 front 2024-04-25T02:20:52.778850+0000 (oldest deadline 2024-04-25T02:21:17.478591+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.379696+0000 front 2024-04-25T02:21:00.379717+0000 (oldest deadline 2024-04-25T02:21:25.079897+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:11.481263+0000 front 2024-04-25T02:21:11.481293+0000 (oldest deadline 2024-04-25T02:21:34.881824+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.983198+0000 front 2024-04-25T02:21:18.983076+0000 (oldest deadline 2024-04-25T02:21:41.882751+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:25.383695+0000 front 2024-04-25T02:21:25.383736+0000 (oldest deadline 2024-04-25T02:21:51.283843+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:36.386068+0000 front 2024-04-25T02:21:36.385949+0000 (oldest deadline 2024-04-25T02:21:59.885673+0000) 2024-04-25T02:22:18.389 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:18 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10[56978]: 2024-04-25T02:22:18.074+0000 7f7ab56f2700 -1 osd.10 101 heartbeat_check: no reply from 172.21.15.137:6822 osd.6 since back 2024-04-25T02:21:44.487577+0000 front 2024-04-25T02:21:44.487417+0000 (oldest deadline 2024-04-25T02:22:10.387094+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:18.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:18 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:18.546+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:19.271 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:19 smithi163 podman[69005]: 2024-04-25 02:22:19.015297233 +0000 UTC m=+5.453418710 container died 931ae78d3174d987e605a75c05da9c12fba6fcf974ca35cd604408598baf058a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-25T02:22:19.579 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:19 smithi163 podman[69005]: 2024-04-25 02:22:19.350729233 +0000 UTC m=+5.788850700 container cleanup 931ae78d3174d987e605a75c05da9c12fba6fcf974ca35cd604408598baf058a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-25T02:22:19.579 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:19 smithi163 bash[69005]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10 2024-04-25T02:22:19.888 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:19 smithi163 podman[69035]: 2024-04-25 02:22:19.577034186 +0000 UTC m=+0.555976926 container remove 931ae78d3174d987e605a75c05da9c12fba6fcf974ca35cd604408598baf058a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:19.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:19.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:19 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:19.582+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:20.274 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:19.910944835 +0000 UTC m=+0.018263670 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:20.274 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:20.010895823 +0000 UTC m=+0.118214658 container create ebb56aa5be081184692778713c21d1a363191a7ebd64f2cefa132c44b553704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-25T02:22:20.274 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:20.196384007 +0000 UTC m=+0.303702843 container init ebb56aa5be081184692778713c21d1a363191a7ebd64f2cefa132c44b553704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-04-25T02:22:20.274 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:20.199440588 +0000 UTC m=+0.306759423 container start ebb56aa5be081184692778713c21d1a363191a7ebd64f2cefa132c44b553704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T02:22:20.274 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:20.271343085 +0000 UTC m=+0.378661920 container attach ebb56aa5be081184692778713c21d1a363191a7ebd64f2cefa132c44b553704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:20.639 INFO:journalctl@ceph.osd.10.smithi163.stdout:Apr 25 02:22:20 smithi163 podman[69129]: 2024-04-25 02:22:20.491819407 +0000 UTC m=+0.599138242 container died ebb56aa5be081184692778713c21d1a363191a7ebd64f2cefa132c44b553704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T02:22:20.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:20.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:20.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:20.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:20.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:20.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:20.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:20 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:20.596+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:21.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.10.service' 2024-04-25T02:22:21.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:21.100 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-25T02:22:21.100 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-25T02:22:21.100 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.11 2024-04-25T02:22:21.408 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 systemd[1]: Stopping Ceph osd.11 for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:21.409 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.405+0000 7f0f4518d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:21.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.405+0000 7f0f4518d700 -1 osd.11 101 *** Got signal Terminated *** 2024-04-25T02:22:21.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.405+0000 7f0f4518d700 -1 osd.11 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T02:22:21.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:21.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:21.674 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:21.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:21.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:21.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:21.675 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:21 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:21.605+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:22.909 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:22.910 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:22 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:22.636+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:23.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:23.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:23.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:23 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:23.626+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:24.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:24.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:24.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:24.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:24 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:24.645+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-04-25T02:21:57.912253+0000 front 2024-04-25T02:21:57.912323+0000 (oldest deadline 2024-04-25T02:22:23.812296+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6806 osd.0 since back 2024-04-25T02:20:55.404369+0000 front 2024-04-25T02:20:55.404265+0000 (oldest deadline 2024-04-25T02:21:20.703996+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6804 osd.1 since back 2024-04-25T02:21:00.704575+0000 front 2024-04-25T02:21:00.704594+0000 (oldest deadline 2024-04-25T02:21:24.804459+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-04-25T02:21:08.905649+0000 front 2024-04-25T02:21:08.905679+0000 (oldest deadline 2024-04-25T02:21:33.005650+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.137:6814 osd.3 since back 2024-04-25T02:21:18.207722+0000 front 2024-04-25T02:21:18.207762+0000 (oldest deadline 2024-04-25T02:21:42.907611+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6812 osd.4 since back 2024-04-25T02:21:27.008609+0000 front 2024-04-25T02:21:27.008575+0000 (oldest deadline 2024-04-25T02:21:52.209008+0000) 2024-04-25T02:22:25.924 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-04-25T02:21:32.209228+0000 front 2024-04-25T02:21:32.209259+0000 (oldest deadline 2024-04-25T02:21:58.109339+0000) 2024-04-25T02:22:25.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.163:6820 osd.7 since back 2024-04-25T02:21:52.611936+0000 front 2024-04-25T02:21:52.611874+0000 (oldest deadline 2024-04-25T02:22:17.911758+0000) 2024-04-25T02:22:25.925 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:25 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11[58220]: 2024-04-25T02:22:25.664+0000 7f0f3df7a700 -1 osd.11 101 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-04-25T02:21:57.912253+0000 front 2024-04-25T02:21:57.912323+0000 (oldest deadline 2024-04-25T02:22:23.812296+0000) 2024-04-25T02:22:27.092 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:26 smithi174 podman[70406]: 2024-04-25 02:22:26.822272847 +0000 UTC m=+5.534765435 container died 4a7d5d6fa2bbd69b1685dda07451f5aa3cedd87f212aa8f91ff52cd7cc307f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:22:27.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:27 smithi174 podman[70406]: 2024-04-25 02:22:27.179951029 +0000 UTC m=+5.892443617 container cleanup 4a7d5d6fa2bbd69b1685dda07451f5aa3cedd87f212aa8f91ff52cd7cc307f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T02:22:27.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:27 smithi174 bash[70406]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11 2024-04-25T02:22:27.799 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:27 smithi174 podman[70423]: 2024-04-25 02:22:27.455690996 +0000 UTC m=+0.627429873 container remove 4a7d5d6fa2bbd69b1685dda07451f5aa3cedd87f212aa8f91ff52cd7cc307f04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11, org.label-schema.build-date=20240424, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, io.buildah.version=1.33.5) 2024-04-25T02:22:28.153 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:27 smithi174 podman[70515]: 2024-04-25 02:22:27.699327362 +0000 UTC m=+0.017755346 image pull f68e37b807ef3dfd57708ff7362bfa0edaabe0111536b8e8a4c26de22a72557e quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901 2024-04-25T02:22:28.154 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:27 smithi174 podman[70515]: 2024-04-25 02:22:27.806432114 +0000 UTC m=+0.124860077 container create b03816dfbfc3491487c1f4ca0c1adc1adbb9666bcf4403849dbaa28e28837289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T02:22:28.154 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:28 smithi174 podman[70515]: 2024-04-25 02:22:28.033982553 +0000 UTC m=+0.352410515 container init b03816dfbfc3491487c1f4ca0c1adc1adbb9666bcf4403849dbaa28e28837289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11-deactivate, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-25T02:22:28.154 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:28 smithi174 podman[70515]: 2024-04-25 02:22:28.037458652 +0000 UTC m=+0.355886622 container start b03816dfbfc3491487c1f4ca0c1adc1adbb9666bcf4403849dbaa28e28837289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T02:22:28.154 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:28 smithi174 podman[70515]: 2024-04-25 02:22:28.150525184 +0000 UTC m=+0.468953145 container attach b03816dfbfc3491487c1f4ca0c1adc1adbb9666bcf4403849dbaa28e28837289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424) 2024-04-25T02:22:28.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Apr 25 02:22:28 smithi174 podman[70515]: 2024-04-25 02:22:28.326456941 +0000 UTC m=+0.644884912 container died b03816dfbfc3491487c1f4ca0c1adc1adbb9666bcf4403849dbaa28e28837289 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, RELEASE=squid-d2c45d9, ceph=True, GIT_CLEAN=True) 2024-04-25T02:22:28.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@osd.11.service' 2024-04-25T02:22:28.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:28.949 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-25T02:22:28.949 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-25T02:22:28.949 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.a 2024-04-25T02:22:29.280 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:29 smithi137 systemd[1]: Stopping Ceph mds.a for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:29.780 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a[66908]: 2024-04-25T02:22:29.514+0000 7f19dd000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:29.780 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:29 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a[66908]: 2024-04-25T02:22:29.514+0000 7f19dd000700 -1 mds.a *** got signal Terminated *** 2024-04-25T02:22:33.487 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:33 smithi137 podman[87190]: 2024-04-25 02:22:33.224033692 +0000 UTC m=+3.855274976 container died 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T02:22:33.770 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:33 smithi137 podman[87190]: 2024-04-25 02:22:33.599311337 +0000 UTC m=+4.230552613 container cleanup 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T02:22:33.771 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:33 smithi137 bash[87190]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a 2024-04-25T02:22:34.029 INFO:journalctl@ceph.mds.a.smithi137.stdout:Apr 25 02:22:33 smithi137 podman[87204]: 2024-04-25 02:22:33.766891352 +0000 UTC m=+0.522045301 container remove 711fa5fa2b2a36f5e50c78f14a0bf805f711ebd06b72aafbcdc836f16372b610 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T02:22:34.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.a.service' 2024-04-25T02:22:34.371 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:34.371 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-25T02:22:34.371 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-25T02:22:34.372 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.d 2024-04-25T02:22:34.538 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:34 smithi137 systemd[1]: Stopping Ceph mds.d for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:35.280 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d[65935]: 2024-04-25T02:22:34.926+0000 7f1ce8600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:35.280 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:34 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d[65935]: 2024-04-25T02:22:34.926+0000 7f1ce8600700 -1 mds.d *** got signal Terminated *** 2024-04-25T02:22:38.996 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:38 smithi137 podman[87309]: 2024-04-25 02:22:38.724243825 +0000 UTC m=+3.925761780 container died 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-25T02:22:39.256 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:39 smithi137 podman[87309]: 2024-04-25 02:22:39.08567252 +0000 UTC m=+4.287190501 container cleanup 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T02:22:39.257 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:39 smithi137 bash[87309]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d 2024-04-25T02:22:39.529 INFO:journalctl@ceph.mds.d.smithi137.stdout:Apr 25 02:22:39 smithi137 podman[87322]: 2024-04-25 02:22:39.253681251 +0000 UTC m=+0.519838331 container remove 6de09441d6249f5c044c5fc71182bebdc5935176a584e626a7eb1196ead00972 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T02:22:39.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.d.service' 2024-04-25T02:22:39.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:39.867 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-25T02:22:39.867 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-25T02:22:39.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.g 2024-04-25T02:22:40.474 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:40 smithi137 systemd[1]: Stopping Ceph mds.g for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:40.779 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g[66565]: 2024-04-25T02:22:40.470+0000 7f23efa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:40.780 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:40 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g[66565]: 2024-04-25T02:22:40.470+0000 7f23efa00700 -1 mds.g *** got signal Terminated *** 2024-04-25T02:22:41.738 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:41 smithi137 podman[87429]: 2024-04-25 02:22:41.439690167 +0000 UTC m=+1.079346891 container died 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9) 2024-04-25T02:22:42.029 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:41 smithi137 podman[87429]: 2024-04-25 02:22:41.831046121 +0000 UTC m=+1.470702890 container cleanup 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:42.030 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:41 smithi137 bash[87429]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g 2024-04-25T02:22:42.317 INFO:journalctl@ceph.mds.g.smithi137.stdout:Apr 25 02:22:42 smithi137 podman[87443]: 2024-04-25 02:22:42.106951745 +0000 UTC m=+0.647883883 container remove 16de271b9bc823d71b02d0def95ca23320bfec5f8b3a5815de06f886aa491353 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-g, RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T02:22:42.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.g.service' 2024-04-25T02:22:42.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:42.439 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-25T02:22:42.440 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-25T02:22:42.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.j 2024-04-25T02:22:43.028 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:42 smithi137 systemd[1]: Stopping Ceph mds.j for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:43.280 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j[65589]: 2024-04-25T02:22:43.024+0000 7fc29e400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:43.280 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:43 smithi137 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j[65589]: 2024-04-25T02:22:43.024+0000 7fc29e400700 -1 mds.j *** got signal Terminated *** 2024-04-25T02:22:47.092 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:46 smithi137 podman[87552]: 2024-04-25 02:22:46.791265165 +0000 UTC m=+3.901932410 container died 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-d2c45d9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-04-25T02:22:47.430 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:47 smithi137 podman[87552]: 2024-04-25 02:22:47.201088917 +0000 UTC m=+4.311756208 container cleanup 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:47.431 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:47 smithi137 bash[87552]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j 2024-04-25T02:22:47.779 INFO:journalctl@ceph.mds.j.smithi137.stdout:Apr 25 02:22:47 smithi137 podman[87578]: 2024-04-25 02:22:47.426826196 +0000 UTC m=+0.622780175 container remove 63c3c430f48e13c0bc5be83e6b9aa220db6baa42adac5aa9c6221ccd3291563f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T02:22:47.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.j.service' 2024-04-25T02:22:48.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:48.059 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-25T02:22:48.059 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-25T02:22:48.060 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.b 2024-04-25T02:22:48.368 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:48 smithi163 systemd[1]: Stopping Ceph mds.b for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:48.634 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: 2024-04-25T02:22:48.365+0000 7f589aa22700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:48.634 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:48 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b[62673]: 2024-04-25T02:22:48.365+0000 7f589aa22700 -1 mds.b *** got signal Terminated *** 2024-04-25T02:22:50.476 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:50 smithi163 podman[69235]: 2024-04-25 02:22:50.156958716 +0000 UTC m=+1.904821165 container died 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T02:22:50.476 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:50 smithi163 podman[69235]: 2024-04-25 02:22:50.473395828 +0000 UTC m=+2.221258270 container cleanup 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-d2c45d9, GIT_CLEAN=True) 2024-04-25T02:22:50.876 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:50 smithi163 bash[69235]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b 2024-04-25T02:22:50.876 INFO:journalctl@ceph.mds.b.smithi163.stdout:Apr 25 02:22:50 smithi163 podman[69259]: 2024-04-25 02:22:50.649383259 +0000 UTC m=+0.492937372 container remove 7cce14c4a471ca31eaea72f506fbb7b233c9e629c218fb66086f45c4dbac5057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-b, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-d2c45d9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:50.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.b.service' 2024-04-25T02:22:50.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:50.934 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-25T02:22:50.934 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-25T02:22:50.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.e 2024-04-25T02:22:51.230 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:51 smithi163 systemd[1]: Stopping Ceph mds.e for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:51.638 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: 2024-04-25T02:22:51.227+0000 7f6d52c43700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:51.639 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:51 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e[62049]: 2024-04-25T02:22:51.227+0000 7f6d52c43700 -1 mds.e *** got signal Terminated *** 2024-04-25T02:22:54.421 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:54 smithi163 podman[69367]: 2024-04-25 02:22:54.145452759 +0000 UTC m=+3.001076427 container died e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, RELEASE=squid-d2c45d9, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:54.857 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:54 smithi163 podman[69367]: 2024-04-25 02:22:54.493091295 +0000 UTC m=+3.348715004 container cleanup e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-25T02:22:54.858 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:54 smithi163 bash[69367]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e 2024-04-25T02:22:54.858 INFO:journalctl@ceph.mds.e.smithi163.stdout:Apr 25 02:22:54 smithi163 podman[69381]: 2024-04-25 02:22:54.660637247 +0000 UTC m=+0.506056107 container remove e8aac0e794769c1996f190875a467ee61beb3d3f4c675f6e09cd0171477ab12b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-e, RELEASE=squid-d2c45d9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T02:22:54.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.e.service' 2024-04-25T02:22:54.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:54.907 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-25T02:22:54.907 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-25T02:22:54.907 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.h 2024-04-25T02:22:55.138 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:54 smithi163 systemd[1]: Stopping Ceph mds.h for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:55.639 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: 2024-04-25T02:22:55.221+0000 7f142e751700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:55.639 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:55 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h[62363]: 2024-04-25T02:22:55.221+0000 7f142e751700 -1 mds.h *** got signal Terminated *** 2024-04-25T02:22:58.474 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:58 smithi163 podman[69488]: 2024-04-25 02:22:58.15098804 +0000 UTC m=+3.030067760 container died 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T02:22:58.882 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:58 smithi163 podman[69488]: 2024-04-25 02:22:58.471515239 +0000 UTC m=+3.350594972 container cleanup 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:58.882 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:58 smithi163 bash[69488]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h 2024-04-25T02:22:58.882 INFO:journalctl@ceph.mds.h.smithi163.stdout:Apr 25 02:22:58 smithi163 podman[69502]: 2024-04-25 02:22:58.680943963 +0000 UTC m=+0.526138175 container remove 889b9474540f850a7c6bb80eda73d930e8a5a097fd5537bcb337008dfd96e6f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T02:22:58.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.h.service' 2024-04-25T02:22:58.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:22:58.927 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-25T02:22:58.927 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-25T02:22:58.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.k 2024-04-25T02:22:59.252 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:22:59 smithi163 systemd[1]: Stopping Ceph mds.k for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:22:59.637 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:22:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k[61727]: 2024-04-25T02:22:59.249+0000 7ffbc664e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:22:59.637 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:22:59 smithi163 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k[61727]: 2024-04-25T02:22:59.249+0000 7ffbc664e700 -1 mds.k *** got signal Terminated *** 2024-04-25T02:23:03.286 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:23:03 smithi163 podman[69609]: 2024-04-25 02:23:03.02091872 +0000 UTC m=+3.864344900 container died f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-25T02:23:03.639 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:23:03 smithi163 podman[69609]: 2024-04-25 02:23:03.38265167 +0000 UTC m=+4.226077834 container cleanup f165f37735206ce796098bc08ff2b042cf0ea7c633795525e0a52828ca0ed6cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-d2c45d9, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T02:23:03.639 INFO:journalctl@ceph.mds.k.smithi163.stdout:Apr 25 02:23:03 smithi163 bash[69609]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-k 2024-04-25T02:23:03.809 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.k.service' 2024-04-25T02:23:03.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:23:03.840 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-25T02:23:03.841 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-25T02:23:03.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.c 2024-04-25T02:23:04.123 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:03 smithi174 systemd[1]: Stopping Ceph mds.c for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:23:04.377 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:23:04.118+0000 7f599366d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:23:04.378 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:04 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c[63681]: 2024-04-25T02:23:04.118+0000 7f599366d700 -1 mds.c *** got signal Terminated *** 2024-04-25T02:23:06.424 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:06 smithi174 podman[70621]: 2024-04-25 02:23:06.156241451 +0000 UTC m=+2.132072220 container died bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-d2c45d9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-25T02:23:06.790 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:06 smithi174 podman[70621]: 2024-04-25 02:23:06.502932249 +0000 UTC m=+2.478763056 container cleanup bccf9f57d681ae1774880f211e7370715dbd4349aa37a2f184a4350fdfc54ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T02:23:06.790 INFO:journalctl@ceph.mds.c.smithi174.stdout:Apr 25 02:23:06 smithi174 bash[70621]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-c 2024-04-25T02:23:06.937 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.c.service' 2024-04-25T02:23:06.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:23:06.972 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-25T02:23:06.972 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-25T02:23:06.973 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.f 2024-04-25T02:23:07.424 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:07 smithi174 systemd[1]: Stopping Ceph mds.f for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:23:07.424 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: 2024-04-25T02:23:07.263+0000 7f1ee96f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:23:07.424 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:07 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f[63372]: 2024-04-25T02:23:07.263+0000 7f1ee96f8700 -1 mds.f *** got signal Terminated *** 2024-04-25T02:23:10.424 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:10 smithi174 podman[70752]: 2024-04-25 02:23:10.15522883 +0000 UTC m=+2.971216947 container died 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T02:23:10.726 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:10 smithi174 podman[70752]: 2024-04-25 02:23:10.514679927 +0000 UTC m=+3.330668040 container cleanup 7da23759640ed39e75814d3f667c18c4e2d64b5588b0766db0cf2dcab8ec1c19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-25T02:23:10.726 INFO:journalctl@ceph.mds.f.smithi174.stdout:Apr 25 02:23:10 smithi174 bash[70752]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-f 2024-04-25T02:23:10.943 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.f.service' 2024-04-25T02:23:10.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:23:10.975 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-25T02:23:10.975 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-25T02:23:10.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.i 2024-04-25T02:23:11.297 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:11 smithi174 systemd[1]: Stopping Ceph mds.i for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:23:11.674 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:23:11.292+0000 7f9a832ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:23:11.674 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:11 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i[63987]: 2024-04-25T02:23:11.292+0000 7f9a832ee700 -1 mds.i *** got signal Terminated *** 2024-04-25T02:23:14.424 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:14 smithi174 podman[70872]: 2024-04-25 02:23:14.152356442 +0000 UTC m=+2.964305171 container died 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, org.label-schema.build-date=20240424) 2024-04-25T02:23:14.797 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:14 smithi174 podman[70872]: 2024-04-25 02:23:14.501787599 +0000 UTC m=+3.313736334 container cleanup 3f58871b13529e24badcd971bfc7548c29496bd1fb6d50f16bad40b4675aa391 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-d2c45d9, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-25T02:23:14.797 INFO:journalctl@ceph.mds.i.smithi174.stdout:Apr 25 02:23:14 smithi174 bash[70872]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-i 2024-04-25T02:23:14.921 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.i.service' 2024-04-25T02:23:14.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:23:14.954 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-25T02:23:14.954 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-25T02:23:14.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.l 2024-04-25T02:23:15.174 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:15 smithi174 systemd[1]: Stopping Ceph mds.l for 19106f5e-02a7-11ef-bc93-c7b262605968... 2024-04-25T02:23:15.674 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l[63063]: 2024-04-25T02:23:15.262+0000 7fd8aac0d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T02:23:15.674 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:15 smithi174 ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l[63063]: 2024-04-25T02:23:15.262+0000 7fd8aac0d700 -1 mds.l *** got signal Terminated *** 2024-04-25T02:23:19.542 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:19 smithi174 podman[70994]: 2024-04-25 02:23:19.270967961 +0000 UTC m=+4.109440967 container died e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-d2c45d9, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-25T02:23:19.800 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:19 smithi174 podman[70994]: 2024-04-25 02:23:19.613607865 +0000 UTC m=+4.452080879 container cleanup e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=squid-d2c45d9, GIT_BRANCH=HEAD) 2024-04-25T02:23:19.800 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:19 smithi174 bash[70994]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l 2024-04-25T02:23:20.043 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.l.service' 2024-04-25T02:23:20.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:19 smithi174 podman[71009]: 2024-04-25 02:23:19.797902962 +0000 UTC m=+0.518756908 container remove e37acfb3d3de54b83ba2d48150ee851b1a8533d4e7536fc8ce85353355d0ba5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:a7481a6d0dca93e16a29c8acf1c964b318bd33c455aa5b4e4025b7a00d008901, name=ceph-19106f5e-02a7-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=squid-d2c45d9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-25T02:23:20.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:20 smithi174 systemd[1]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.l.service: Deactivated successfully. 2024-04-25T02:23:20.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:20 smithi174 systemd[1]: Stopped Ceph mds.l for 19106f5e-02a7-11ef-bc93-c7b262605968. 2024-04-25T02:23:20.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Apr 25 02:23:20 smithi174 systemd[1]: ceph-19106f5e-02a7-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.098s CPU time. 2024-04-25T02:23:20.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T02:23:20.074 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-25T02:23:20.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T02:23:20.391 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:23:25.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T02:23:25.566 INFO:teuthology.orchestra.run.smithi163.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:23:27.983 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T02:23:28.171 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:23:30.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:23:30.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:23:30.600 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T02:23:30.626 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T02:23:30.628 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi137/crash 2024-04-25T02:23:30.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash -- . 2024-04-25T02:23:30.715 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T02:23:30.715 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2024-04-25T02:23:30.719 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi163/crash 2024-04-25T02:23:30.720 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash -- . 2024-04-25T02:23:30.759 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T02:23:30.759 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now 2024-04-25T02:23:30.761 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi174/crash 2024-04-25T02:23:30.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash -- . 2024-04-25T02:23:30.792 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T02:23:30.792 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-04-25T02:23:30.793 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T02:23:30.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-25T02:23:30.896 INFO:tasks.cephadm:Compressing logs... 2024-04-25T02:23:30.896 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:23:30.900 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:23:30.902 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:23:30.927 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T02:23:30.927 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-04-25T02:23:30.928 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log 2024-04-25T02:23:30.928 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T02:23:30.928 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.f.log 2024-04-25T02:23:30.928 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.c.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.c.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log: /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.z.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.i.log 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.z.log: 87.2% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T02:23:30.935 INFO:teuthology.orchestra.run.smithi174.stderr: 90.2% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T02:23:30.936 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T02:23:30.936 INFO:teuthology.orchestra.run.smithi163.stderr:: No such file or directory 2024-04-25T02:23:30.936 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log 2024-04-25T02:23:30.936 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T02:23:30.936 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.7.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log: /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.b.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.y.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.h.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.10.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.h.log: 90.2% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr: 87.1% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.e.log 2024-04-25T02:23:30.937 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T02:23:30.938 INFO:teuthology.orchestra.run.smithi174.stderr: 92.1% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.z.log.gz 2024-04-25T02:23:30.940 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T02:23:30.940 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.11.log 2024-04-25T02:23:30.940 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.8.log 2024-04-25T02:23:30.940 INFO:teuthology.orchestra.run.smithi174.stderr: 83.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T02:23:30.941 INFO:teuthology.orchestra.run.smithi163.stderr: 92.0% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.y.log.gz 2024-04-25T02:23:30.941 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T02:23:30.941 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.b.log 2024-04-25T02:23:30.952 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T02:23:30.953 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.k.log 2024-04-25T02:23:30.955 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T02:23:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-04-25T02:23:30.955 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T02:23:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log 2024-04-25T02:23:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T02:23:30.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.g.log 2024-04-25T02:23:30.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.j.log 2024-04-25T02:23:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.g.log: 87.1% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T02:23:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T02:23:30.962 INFO:teuthology.orchestra.run.smithi137.stderr: 90.0% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T02:23:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T02:23:30.963 INFO:teuthology.orchestra.run.smithi137.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T02:23:30.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.x.log 2024-04-25T02:23:30.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.a.log 2024-04-25T02:23:30.965 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.l.log 2024-04-25T02:23:30.966 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.k.log: 94.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.k.log.gz 2024-04-25T02:23:30.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.6.log 2024-04-25T02:23:30.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.a.log: 94.5% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.g.log.gz 2024-04-25T02:23:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T02:23:30.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.a.log 2024-04-25T02:23:30.969 INFO:teuthology.orchestra.run.smithi137.stderr: 94.5% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.j.log.gz 2024-04-25T02:23:30.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log: 83.7% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T02:23:30.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T02:23:30.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.d.log 2024-04-25T02:23:30.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.9.log 2024-04-25T02:23:30.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.9.log: 94.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.a.log.gz 2024-04-25T02:23:30.984 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.l.log: 94.5% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.l.log.gz 2024-04-25T02:23:30.988 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T02:23:30.989 INFO:teuthology.orchestra.run.smithi137.stderr: 94.3% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.d.log.gz 2024-04-25T02:23:30.998 INFO:teuthology.orchestra.run.smithi174.stderr: 91.0% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T02:23:31.121 INFO:teuthology.orchestra.run.smithi163.stderr: 94.3% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.h.log.gz 2024-04-25T02:23:31.128 INFO:teuthology.orchestra.run.smithi163.stderr: 94.3% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.e.log.gz 2024-04-25T02:23:31.355 INFO:teuthology.orchestra.run.smithi137.stderr: 90.2% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mgr.x.log.gz 2024-04-25T02:23:31.408 INFO:teuthology.orchestra.run.smithi174.stderr: 91.8% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.c.log.gz 2024-04-25T02:23:31.520 INFO:teuthology.orchestra.run.smithi163.stderr: 91.8% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.b.log.gz 2024-04-25T02:23:31.926 INFO:teuthology.orchestra.run.smithi137.stderr: 90.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mon.a.log.gz 2024-04-25T02:23:32.253 INFO:teuthology.orchestra.run.smithi174.stderr: 93.9% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.c.log.gz 2024-04-25T02:23:32.519 INFO:teuthology.orchestra.run.smithi174.stderr: 93.9% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.i.log.gz 2024-04-25T02:23:33.094 INFO:teuthology.orchestra.run.smithi163.stderr: 93.7% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T02:23:33.154 INFO:teuthology.orchestra.run.smithi137.stderr: 93.5% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.9.log.gz 2024-04-25T02:23:33.530 INFO:teuthology.orchestra.run.smithi163.stderr: 93.6% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.10.log.gz 2024-04-25T02:23:33.936 INFO:teuthology.orchestra.run.smithi174.stderr: 93.7% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.8.log.gz 2024-04-25T02:23:34.016 INFO:teuthology.orchestra.run.smithi137.stderr: 93.4% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.6.log.gz 2024-04-25T02:23:34.107 INFO:teuthology.orchestra.run.smithi137.stderr: 93.3% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T02:23:34.160 INFO:teuthology.orchestra.run.smithi174.stderr: 95.2% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.f.log.gz 2024-04-25T02:23:34.371 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T02:23:34.383 INFO:teuthology.orchestra.run.smithi137.stderr: 93.5% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T02:23:34.387 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-25T02:23:34.387 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m3.456s 2024-04-25T02:23:34.387 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m12.250s 2024-04-25T02:23:34.388 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m1.021s 2024-04-25T02:23:34.419 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T02:23:34.455 INFO:teuthology.orchestra.run.smithi163.stderr: 93.6% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T02:23:34.648 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.11.log.gz 2024-04-25T02:23:34.649 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-04-25T02:23:34.650 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m3.732s 2024-04-25T02:23:34.650 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m19.593s 2024-04-25T02:23:34.650 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.652s 2024-04-25T02:23:34.685 INFO:teuthology.orchestra.run.smithi163.stderr: 93.7% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-osd.7.log.gz 2024-04-25T02:24:07.052 INFO:teuthology.orchestra.run.smithi163.stderr: 93.1% -- replaced with /var/log/ceph/19106f5e-02a7-11ef-bc93-c7b262605968/ceph-mds.b.log.gz 2024-04-25T02:24:07.054 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-04-25T02:24:07.054 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m36.138s 2024-04-25T02:24:07.054 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m47.541s 2024-04-25T02:24:07.054 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m1.514s 2024-04-25T02:24:07.054 INFO:tasks.cephadm:Archiving logs... 2024-04-25T02:24:07.055 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi137/log 2024-04-25T02:24:07.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:24:09.068 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi163/log 2024-04-25T02:24:09.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:24:16.469 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi174/log 2024-04-25T02:24:16.470 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:24:18.785 INFO:tasks.cephadm:Removing cluster... 2024-04-25T02:24:18.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force 2024-04-25T02:24:19.102 INFO:teuthology.orchestra.run.smithi137.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:24:19.719 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force 2024-04-25T02:24:19.909 INFO:teuthology.orchestra.run.smithi163.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:24:20.253 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19106f5e-02a7-11ef-bc93-c7b262605968 --force 2024-04-25T02:24:20.447 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: 19106f5e-02a7-11ef-bc93-c7b262605968 2024-04-25T02:24:20.793 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T02:24:20.793 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T02:24:20.853 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T02:24:20.870 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T02:24:20.886 INFO:tasks.cephadm:Teardown complete 2024-04-25T02:24:20.886 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:24:20.929 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:24:20.929 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:24:20.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:24:20.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:24:21.100 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:24:21.113 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:24:21.113 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:24:21.122 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:24:21.125 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:24:21.136 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:24:21.139 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:24:21.141 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:24:21.142 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-25T02:24:21.142 INFO:teuthology.orchestra.run.smithi163.stdout:^- hv01.front.sepia.ceph.com 2 6 377 11 +1741us[+1769us] +/- 574ms 2024-04-25T02:24:21.142 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -282us[ -253us] +/- 55ms 2024-04-25T02:24:21.142 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 +334us[ +362us] +/- 62ms 2024-04-25T02:24:21.142 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:24:21.144 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:24:21.144 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-04-25T02:24:21.144 INFO:teuthology.orchestra.run.smithi174.stdout:^- hv01.front.sepia.ceph.com 2 6 377 12 +1771us[+1768us] +/- 574ms 2024-04-25T02:24:21.144 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -292us[ -295us] +/- 55ms 2024-04-25T02:24:21.145 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +326us[ +323us] +/- 62ms 2024-04-25T02:24:21.145 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:24:21.168 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-25T02:24:21.177 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:24:21.177 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-25T02:24:21.178 INFO:teuthology.orchestra.run.smithi137.stdout:^- hv01.front.sepia.ceph.com 2 6 377 10 +1767us[+1789us] +/- 574ms 2024-04-25T02:24:21.178 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -282us[ -260us] +/- 55ms 2024-04-25T02:24:21.178 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +346us[ +346us] +/- 62ms 2024-04-25T02:24:21.178 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:24:21.179 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:24:21.192 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:24:21.192 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:24:21.203 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:24:21.404 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:24:21.469 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:24:21.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:24:21.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:21.633 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:24:21.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:21.660 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T02:24:21.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:21.687 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:24:21.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:24:21.712 INFO:teuthology.task.internal:Duration was 2066.427848 seconds 2024-04-25T02:24:21.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:24:21.724 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:24:21.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:24:21.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:24:21.735 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:24:21.770 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:24:21.771 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:24:21.858 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:24:22.210 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:24:22.210 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-25T02:24:22.210 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:24:22.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-04-25T02:24:22.284 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:24:22.314 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-04-25T02:24:22.315 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:24:22.344 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:24:22.344 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:24:22.353 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:24:22.357 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:24:22.434 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:24:22.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:24:22.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:24:22.445 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:24:22.924 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:24:22.937 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:24:22.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:24:23.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:24:23.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:24:23.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:24:23.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.115 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-04-25T02:24:23.135 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-04-25T02:24:23.186 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-25T02:24:23.228 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:23.277 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:23.291 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:24:23.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:24:23.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:24:23.318 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:24:23.319 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi137 2024-04-25T02:24:23.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:24:23.422 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi163 2024-04-25T02:24:23.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:24:23.458 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351/remote/smithi174 2024-04-25T02:24:23.458 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:24:23.494 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:24:23.494 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:24:23.502 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:24:23.504 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:24:23.552 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:24:23.566 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:24:23.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:24:23.578 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:24:23.579 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:24:23.584 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:24:23.586 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:24:23.598 INFO:teuthology.orchestra.run.smithi163.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:24 /home/ubuntu/cephtest 2024-04-25T02:24:23.600 INFO:teuthology.orchestra.run.smithi174.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:24 /home/ubuntu/cephtest 2024-04-25T02:24:23.629 INFO:teuthology.orchestra.run.smithi137.stdout: 393368 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:24 /home/ubuntu/cephtest 2024-04-25T02:24:23.632 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:24:23.645 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:24:23.674 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T02:24:23.700 DEBUG:teuthology.nuke:shortname: smithi137 2024-04-25T02:24:23.700 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:24:23.725 DEBUG:teuthology.nuke:shortname: smithi163 2024-04-25T02:24:23.725 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:24:23.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.515873', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBATqofvyLPilflkqKG2YgKB70vFTEpC4WceMbVuRl7Pu4V1wYZtUqT/fTfwtPCaazS+YDW+cZeomgpd24YpEdGc='} 2024-04-25T02:24:23.747 DEBUG:teuthology.nuke:shortname: smithi174 2024-04-25T02:24:23.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:24:23.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.519005', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFkqbO+NbXxYVhp91b35e50pMvrr44kJCnsq6esg0Z3cXiOoone9o7hGmCWDc+NhP6dC2gW9zzs5Kkc+QIgPOiI='} 2024-04-25T02:24:23.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672351', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 01:40:53.517543', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCY9lw0Z26HiTCDSpnDf0c5t2vMK85vor2XjFlaadfxIfr80kdo0QkBSOW9Fw6g04xkvzB0RPeZoAQic0+8GpAs='} 2024-04-25T02:24:23.783 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-25T02:24:23.783 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T02:24:23.805 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-25T02:24:23.806 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:23.822 INFO:teuthology.orchestra.console.smithi163:Power off 2024-04-25T02:24:23.822 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T02:24:23.838 INFO:teuthology.orchestra.console.smithi174:Power off 2024-04-25T02:24:23.838 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T02:24:23.848 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-25T02:24:23.848 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-04-25T02:24:23.848 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:23.866 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-04-25T02:24:23.867 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:23.878 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-25T02:24:23.892 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-04-25T02:24:27.849 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:27.880 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:27.894 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:27.960 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-25T02:24:27.991 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-25T02:24:28.005 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-04-25T02:24:31.962 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:31.993 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:32.006 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T02:24:32.073 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-25T02:24:32.103 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-04-25T02:24:32.116 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-04-25T02:24:32.174 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-25T02:24:32.204 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-04-25T02:24:32.216 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-04-25T02:24:32.322 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} duration: 2066.4278478622437 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-25T02:24:32.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:24:32.417 INFO:teuthology.run:FAIL